Data Management explained

Data is the information that drives business. It can be structured in rows and columns, like a customer name, address, and phone; and it can be unstructured, such as an email or a social media post. Structured data is what is populated in Relational Database Management Systems such as those created by Oracle, IBM and Microsoft, and open-source PostgreSQL and MySQL, among others. That data can be accessed using the standard Structured Query Language (SQL). Unstructured data resides in what are called NoSQL databases, such as Cassandra, Couchbase, MongoDB and many, many others. Many organizations today run both kinds of databases.

Once the data is stored, it must be easily retrievable, found amid the mountains of data organizations collect, and made available at scale. Numerous tools exist for those jobs, including Hadoop, Apache Spark and many more. It is through the collection and analysis of data that businesses can make decisions that affect their bottom line.

Getting to the root of your data’s history With the rise of big data platforms such as Apache Hadoop and Spark, more and more enterprises are pouring enterprise information into data lakes and launching related initiatives around data quality, data governance, regulatory compliance, and more reliable business intelligence (BI). In-memory technology: Serving up application data to users on the go Data can be viewed to be as valuable in the digital business world as oil is to the economy. Oil fuels homes, cars, railroads, and even electricity. Data powers the business and revenue. premium How GraphQL is competing with REST The representational state transfer (REST) API has served its purpose of exposing application-level information for web services over the last 15 years, but in an industry that’s constantly evolving, there are always new approaches that are popping up and transforming the way we work. Enter GraphQL. Data

Microsoft and Harvard collaborate on differential privacy

Microsoft and the OpenDP Initiative at Harvard have collaborated on a new platform that will offer differential privacy for large datasets. Differential privacy allows researchers to analyze datasets without having important data withheld, while also preserving the privacy of that data, according to Microsoft. “Differential privacy, the heart of today’s landmark milestone, was invented at … continue reading

SD Times Open-Source Project of the Week: MLflow

MLflow, the open-source machine learning platform created by Databricks, has joined the Linux Foundation. The version update MLflow 1.9.1 was also released this week with bug fixes and improvements. The project has seen more than two million downloads per month and is growing fourfold every year. The project was first introduced at Spark + AI … continue reading

Amazon announces no-code solution Honeycode

Amazon is joining the no-code space with the announcement of Honeycode. The new solution is designed to make it easier for developers to build mobile and web applications with no programming required. Instead of relying on methods like emailing spreadsheets or documents, Honeycode enables developers to use a simple visual application builder and to utilize … continue reading

Data Theorem releases full-stack security analyzer for modern web apps and cloud services

Data Theorem released a new full-stack security analyzer called Web Secure. It is designed to provide vulnerability analysis for modern web applications from the web layer down to its embedded APIs and cloud resources. According to the company, the analyzer was built for DevOps and security teams to improve web application security testing, and help … continue reading

SD Times news digest: erwin updates Data Modeler, Progress DataDirect’s new data connectors, and Mozilla’s front-end developer learning pathway

Data governance company erwin announced a new version of its Data Modeler (DM) to support digital transformation, cloud migration, and infrastructure modernization. Erwin DM now features metadata-driven automation capabilities and support for data warehouse and DBMS modernization to ensure data governance and reduce data management costs and data-related risks. It also includes native support for … continue reading

SD Times news digest: FreeBSD 11.4 released, gRPC-Web for .NET now available, DataRobot updates platform and announces applied data science academy

The FreeBSD 11.4 release includes updates to the clang, llvm, lld, lldb, and compiler-rt utilities as well as updates to OpenSSL, Unbound, and the KDE desktop environment. FreeBSD brings advanced network operating system features to appliance and embedded platforms, from higher-end Intel-based appliances to ARM, PowerPC, and MIPS hardware platforms., according to the development team … continue reading

SD Times news digest: The Coding and Innovation Bootcamp, Axiom’s data funding, and Qualcomm’s Small Business Accelerator program

Coding Dojo and MIT Bootcamps are teaming up to focus on accelerated learning programs through the Coding and Innovation Bootcamp, which teaches core innovation principles. Students will first go through an intensive three-week online bootcamp led by MIT instructor where they’ll learn entrepreneurial problem discovery and problem-solving. Then, they’ll attend a six-week online Coding Dojo … continue reading

Report: Python has overtaken Java in the last year

For the past few years, reports have indicated that Python was quickly rising to the top of the most used programming languages. Python was the 2018 TIOBE Index programming language of the year. TIOBE even predicted in June of last year that Python would soon surpass Java on its index. Additionally, it was the second-most … continue reading

SD Times news digest: erwin Data Intelligence Suite update, Red Hat supports Quarkus, and Gatsby’s round of funding for modern development

The latest version of the erwin Data Intelligence Suite provides new AI-driven metadata matching, data lineage analysis, data model integration, and an enriched business user experience to speed enterprise data governance and literacy. “Business transformation has to be based on accurate data assets within the right context, so organizations have a reliable source of truth … continue reading

CircleCI announces analytics plugin Buildtrakr

CircleCI wants to help developers enhance their speed, efficiency, and usability with new updates to its platforms. Additionally, the company announced its first analytics plugin Buildtrakr. Buildtrakr integrates with CircleCI and Git to synthesize commit and build performance data, and displays critical metrics in a flexible dashboard. “Buildtrakr unleashes the full potential of CircleCI’s API. … continue reading

JetBrains joins the big data space with new tools for DataGrip and PyCharm

JetBrains announced that Big Data Tools is now available as EAP for DataGrip and PyCharm Professional. The news aims to address problems that involve both code and data. The company first announced plans to support more big data tools last year when it announced a preview of the IntelliJ IDEA Ultimate plugin with Apache Zeppelin … continue reading

SD Times news digest: Tech companies react to the USA FREEDOM Reauthorization Act, CData and HULFT’s partnership, and Apache weekly project updates

Mozilla, Reddit, Twitter, Patreon, and other other tech companies are pushing for the House of Representatives to consider the Wyden/Daines amendment when they look at the USA FREEDOM Reauthorization Act. The amendment would expressly prohibit the use of Section 215 of the USA PATRIOT Act for the warrantless collection of search and browsing history. The … continue reading