Databricks has announced its open-source machine learning platform MLflow has reached 1.0. MLflow was announced last year as a way to help data scientists track and share experiments and models. Since then, the project has grown to more than 100 contributors with its PyPl package download rate reaching about 600K a month, the company explained. … continue reading
Databricks today announced Delta Lake, an open-source project designed to bring reliability to data lakes for both batch and streaming data. The project was revealed during the Spark +AI Summit taking place this week in San Francisco. Data lakes are used as repositories for structured and unstructured data, but factors such as failed writes, schema … continue reading
Databricks announced a massive Series E round of funding for $250 million, bringing the company’s total amount raised to $489.5 million. According to the company, this could not be possible without its Unified Analytics Platform. The platform is designed to help enterprises build data pipelines across siloed data storage systems and make data science on … continue reading
Databricks released a new version of MLflow, which is an open-source machine learning framework for multi-cloud environments. In collaboration with RStudio, it has developed an R API for MLflow v0.7.0. “In many organizations machine learning workflows are far too ad-hoc, with no systematic tracking of experiments, inadequate protocols around reproducibility, and no consistent way to … continue reading
The Nim team has released Nim 0.19.0. Nim is a systems programming language with a focus on performance, portability, and expressiveness, the team explained. This release adds changes to strings and sequences that provide more flexibility in how they are implemented. According to the team, alternative implementations are currently in development. Other features include async … continue reading
Google is releasing a new research framework for prototyping reinforcement learning algorithms. Dopamine is a Tensorflow-based framework designed with ease-of-use, reproducibility, and benchmarking in mind. Along with the framework, the company will provide a set of colabs for using the framework. For ease-of-use, Google will provide code that is compact and well-documented. For reproducibility, the … continue reading
Puppet announces $42 million funding round Puppet has received new funding to help it grow its automation and DevOps business. The funding was led by Cisco along with EDBI, Kleiner Perkins, True Ventures, and VMware. “Our rapid growth and international expansion is a testament to the rising demand for DevOps transformation, software automation and the … continue reading
Databricks has announced new capabilities to its Unified Analytics platform designed to help lower the barrier for enterprises utilizing AI. The company introduced MLflow, Databricks runtime for ML and Databricks Delta at the Spark + AI Summit in San Francisco this week. According to the company, the new capabilities aim to simplify distributed machine learning … continue reading
Databricks has announced the release of Apache Spark 2.3.0 as part of the Databricks Runtime 4.0 beta. According to the company, this release focuses on usability, stability and refinement. A major milestone of the release is that it introduces Structured Streaming. According to the team, this enables low-latency continuous processing and stream-to-stream joins. Other features … continue reading
Databricks has released a new unified data management system that combines the best features from data lakes, data warehouses and streaming systems. The company made the announcement at its annual Spark Summit Europe conference. Databricks Delta takes the scale and cost-efficiency from a data lake; the reliability and performance from a data warehouse, and the … continue reading
Leading companies in the food supply chain are coming together for a major blockchain collaboration with IBM so they can strengthen consumers’ confidence in the global food system. The consortium includes Dole, Driscoll’s, Golden State Foods, Kroger, McCormick and Company, McLane Company, Nestlé, Tyson Foods, Unilever and Walmart. These companies will work with IBM and blockchain technology to address some of the challenges impacting food safety, like … continue reading
Databricks announced new plans to make working with deep learning and analytics easier for the Apache Spark community at this week’s Spark Summit in San Francisco. The company unveiled a new serverless platform, a new Apache Spark library for deep learning, and the availability of its stream processing solution. Databricks Serverless is a fully managed … continue reading
