Two more projects are graduating from the Apache Software Foundation’s (ASF) incubator this week. The organization has announced that both Apache BookKeeper and Apache Samza have become Top-Level Projects (TLPs).
Apache Samza is an open-source Big Data distributed streaming processing framework designed to handle stateful processing, message durability, fault tolerance and scalability. Samza was originally created at LinkedIn to process tracking data, service log data and provide real-time services for data ingestion pipelines. The project entered into the Apache Incubator in July 2013.
The ASF recently announced version 0.8 of Samza’s incubator release, which included performance and usability improvements, added support for Java 8, and an in-memory key-value store.
“The incubation process at Apache has been great. It has helped us cultivate a strong community, and provided us with the support and infrastructure to make Samza grow,” said Chris Riccomini, vice president of Apache Samza.
Samza utilizes Apache Hadoop YARN in order to provide security, processor isolation, fault tolerance and resource management, and uses Apache Kafka to allow organizations to communicate and understand their data in real-time. The project is currently involved in a variety of apps, industries and organizations for powering analytics, streaming data, replicating data, providing real-time visibility and processing user activity data.
“I’ve been involved in Apache Samza’s community since its inception,” said Riccomini. “It’s been thrilling to watch the community grow, and I’m very proud and excited to see that the project is graduating. Samza has a bright future, and I’m looking forward to what’s to come.”
The ASF’s other TLP, Apache BookKeeper, is a replicated log service that was established in 2011 as part of Apache ZooKeeper, an open-source API designed for reliable distributed coordination. According to the ASF, BookKeeper can be applied to distributed systems such as messaging systems, file systems, transaction processing systems, and state machines such as databases.
“We’re very proud to have BookKeeper become a Top-Level Project,” said Ivan Kelly, vice president of Apache BookKeeper. “It is a testament to the hard work that my fellow committers have put in over the years that the ASF would give us their stamp of approval. We hope that the increased exposure will bring even more contributions and use cases to the community.”
BookKeeper is currently used as a persistence layer for Yahoo’s cloud messaging infrastructure and as a replicated persistence back end for Twitter’s different messaging use cases.
More information can be found here.