LinkedIn open sources Kafka Cruise Control

Although Apache Kafka is widely adopted, there are still operational challenges that teams run into when they try to run Kafka at scale. In order to restore balance to Kafka clusters, LinkedIn open sourced and developed Cruise Control, its general-purpose system that continuously monitors clusters and automatically adjusts the resources needed to meet pre-defined performance … continue reading

Apache Beam goes top level

The Apache Foundation this morning announced the promotion of Apache Beam to the top level. That’s good news for the many contributors and users of this unified programming model, which allows them to write batch and streaming jobs at the same time, and to run the resulting artifact on various execution engines. Within the Hadoop … continue reading

Yelp offers up Kafka tools to open source

Yelp saved itself US$10 million by building out its Apache Kafka-based Data Pipeline, and now it wants to spread that love to other enterprises. Just before the holidays, Yelp open-sourced its Data Pipeline and assorted utilities used to maintain and build out this streaming data platform. Data Pipeline is now available on GitHub under the … continue reading

Confluent Platform 3 brings new Kafka, control center

Confluent this week introduced its first commercial product, Confluent Control Center, as part of the newly released Confluent Platform 3.0 and Apache Kafka 0.10.0. The combined package is aimed at operationalizing Kafka-based streaming applications and near real-time data processing efforts. Neha Narkhede, cofounder and CTO of Confluent (and one of the creators of Kafka), said, … continue reading

Kafka summit highlights lack of bugs

Jay Kreps, the creator of Kafka, gave the keynote yesterday at the first Kafka Summit in San Francisco, where attendees learned about this Apache real-time stream processing platform and how fast it is growing. Originally built by Kreps at LinkedIn, Kafka has grown to become one of the most popular stream processing platforms out there. … continue reading

Volvo to launch autonomous driving trial, Heroku Kafka early access, and WebKit updates prefixing policy—SD Times news digest: April 27, 2016

As an attempt to stop car accidents and free the road of congestion, Volvo Cars is joining other carmakers in establishing an autonomous driving (AD) trial next year in the U.K. The company wants to make sure no one is seriously injured or killed in a new Volvo by 2020, according to a company announcement. … continue reading

Forecast 2016: Predictions from around the industry

To paraphrase that great thinker, Ferris Bueller: “Technology moves pretty fast. It you don’t look around once in a while, you could miss it.” So, to get 2016  rolling, we’ve asked luminaries and thought leaders in the software development space to look around and tell us what they expect from the field this year. Kelly … continue reading

MapR introduces publish/subscribe streaming for Hadoop

While many in the Big Data space are talking about stream processing, MapR today announced the availability of Streams, a new product in its Hadoop stack that can be used to stream events across clusters distributed around the world. The new product offers a publish-and-subscribe model for event-driven data access and decision-making. While MapR Streams … continue reading

Apache Kafka updates to 0.9

As Apache developers awoke one morning from uneasy dreams, they found themselves transformed in their beds into a giant new version of Apache Kafka. Version 0.9, released yesterday, adds security support for SSL for the first time, as well as new consumer APIs. This latest version of Kafka includes updates that should make it easier … continue reading

SD Times Blog: A fresh crop of open-source projects

How about that open-source software from Microsoft, eh? What is going on with the world when the biggest news in open source is from Microsoft? While we sip our coffee and think wistfully of closed-source projects past, we figured we’d take this moment to update you on some of the other open-source announcements made this … continue reading

HTML Snippets Powered By : XYZScripts.com