Topic: data lakes

Databricks open-sources Delta Lake for data lake reliability

Databricks today announced Delta Lake, an open-source project designed to bring reliability to data lakes for both batch and streaming data. The project was revealed during the Spark +AI Summit taking place this week in San Francisco. Data lakes are used as repositories for structured and unstructured data, but factors such as failed writes, schema … continue reading

Getting to the root of your data’s history

With the rise of big data platforms such as Apache Hadoop and Spark, more and more enterprises are pouring enterprise information into data lakes and launching related initiatives around data quality, data governance, regulatory compliance, and more reliable business intelligence (BI). To prevent the new lakes from turning into swamps, however, businesses are organizing their … continue reading

Report: 5 Big Data trends to monitor in 2018

Syncsort has released the results of its fourth annual Big Data survey, detailing the top use cases and challenges organizations face with Big Data initiatives. Based on the results, there are five key trends that organizations should monitor in 2018. 1. The composition of the data lake has been shifting. The amount of Relational Database … continue reading

SD Times news digest: Databricks Delta, SciPy 1.0, and Neo4j’s Native Graph Platform

Databricks has released a new unified data management system that combines the best features from data lakes, data warehouses and streaming systems. The company made the announcement at its annual Spark Summit Europe conference. Databricks Delta takes the scale and cost-efficiency from a data lake; the reliability and performance from a data warehouse, and the … continue reading

HTML Snippets Powered By : XYZScripts.com

Get access to this and other exclusive articles for FREE!

There's no charge and it only takes a few seconds.

Sign up now!