Databricks has introduced Spark Datasets, an extension of the DataFrames API that provides a type-safe, object-oriented programming interface. Spark 1.6 includes an API preview of Datasets, and they will be a development focus for the next several versions of Spark. Databricks was founded out of UC Berkeley’s AMPLab by the creators of Apache Spark, and … continue reading
It happens all the time. You are out somewhere and your phone dies, or you are working on your laptop and it runs out of battery. To solve this problem, researchers from MIT and Samsung are working on a way for batteries to last forever. The researchers are developing a new approach to batteries, focusing … continue reading
Databricks has announced the general availability of its cloud-hosted data platform, formerly known as Databricks Cloud. Less than a week after announcing the release of Apache Spark 1.4, Databricks debuted its cloud platform at Spark Summit, which has support for R-language notebooks; version-control and source-code change tracking from within Databricks; private notebook permissions management; and … continue reading
Databricks has announced the general availability of Apache Spark 1.4, including SparkR, a new R API for data scientists. Version 1.4 of the open-source Big Data processing and streaming engine also enhances Spark’s DataFrame API features, Python 3 support, a component upgrade past alpha for Spark’s machine learning pipeline, and new visualization and monitoring capabilities … continue reading
If you have any dark tattoos on your wrist, Apple Watch may not work for you. According to iMore, a website dedicated to Apple, a user’s tattoo can interfere with the watch’s ability to track his or her heart rate. It also affects the watch’s ability to detect skin contact. Users experiencing this problem can … continue reading
Apache Spark stole the show at the Big Data TechCon in Boston this week. Thanks to a keynote address from Spark’s creator, and a number of tutorials focused on the project, attendees had plenty of Spark information on hand to learn at the event. While Spark was not the only Big Data topic being discussed … continue reading
The inaugural Spark Summit East conference is taking place in New York City this week, and many Big Data companies have seized the opportunity to announce new partnerships, product releases, integrations and Apache Spark services. Databricks announces ‘Jobs’ cloud feature, partnership with Tresata Databricks has announced a new feature for its Databricks Cloud called “Jobs” … continue reading
Databricks announces DataFrames for Spark Apache Spark platform provider Databricks has announced DataFrames, a new API for Apache Spark 1.3 designed to simplify distributed data processing for more immediate Spark use. The DataFrames API was built to resemble R and Python data frames, providing a familiar interface for data scientists and building on the Spark … continue reading
Developers can now become Apache Spark certified. Databricks, the company that founded the open-source Big Data processing engine, and O’Reilly Media are teaming up to launch the Apache Spark Developer Certification Program. Spark made strides earlier this year when the Apache Software Foundation moved it from Apache Incubator to a top-level project. “The adoption of … continue reading
