The Apache Foundation has announced that the Beam big data tool is now a top-level project. Part of the Hadoop ecosystem, Beam offers a unified programming model that allows enterprise application development teams to work with batch and streaming data together.
“The graduation of Apache Beam as a top-level project is a great achievement and, in the fast-paced Big Data world we live in, recognition of the importance of a unified, portable, and extensible abstraction framework to build complex batch and streaming data-processing pipelines,” said Laurent Bride, CTO of Talend. “Customers don’t like to be locked in, so they will appreciate the runtime flexibility Apache Beam provides. With four mature runners already available (and I’m sure more to come), Beam represents the future and will be a key element of Talend’s strategic technology stack moving forward.”