You are viewing a plain text version of this content. The canonical link for it is here.
Posted to cvs@incubator.apache.org by Apache Wiki <wi...@apache.org> on 2016/08/02 15:30:20 UTC
[Incubator Wiki] Update of "August2016" by JamesMalone
Dear Wiki user,
You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.
The "August2016" page has been changed by JamesMalone:
https://wiki.apache.org/incubator/August2016?action=diff&rev1=18&rev2=19
Comment:
Adding podling report for Apache Beam
--------------------
Beam
+ Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Beam pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes such as Apache Flink, Apache Gearpump, Apache Spark, and Google Cloud Dataflow (a cloud service). Beam also brings SDKs in different languages, allowing users to easily implement their data integration processes.
- Apache Beam is an open source, unified model and set of language-specific SDKs
- for defining and executing data processing workflows, and also data ingestion
- and integration flows, supporting Enterprise Integration Patterns (EIPs) and
- Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of
- large-scale batch and streaming data processing and can run on a number of
- runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow (a cloud
- service). Beam also brings DSL in different languages, allowing users to
- easily implement their data integration processes.
Beam has been incubating since 2016-02-01.
Three most important issues to address in the move towards graduation:
+ 1. Additional and continued Beam releases
+ 2. Grow the community of Beam users and contributors
+ 3. Add to and improve upon documentation, code samples, and project website
- 1.
- 2.
- 3.
-
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
+ None.
-
-
- How has the community developed since the last report?
-
-
-
- How has the project developed since the last report?
+ How has the community developed since the last report?
+ * 425 closed/merged pull requests
+ * High engagement on dev and user mailing lists (590 / 455 messages)
+ * Several public talks, articles, and videos including:
+ * Hadoop Summit San Jose ("Apache Beam: A Unified Model for Batch and Streaming Data Processing" & "The Next Generation of Data Processing & OSS" )
+ * O’Reilly & The New Stack ("Future-proof and scale-proof your code")
+ * QCon NY ("Apache Beam: The Case for Unifying Streaming API's")
+ * JBCN Barcelona ("Introduction to Apache Beam")
+ How has the project developed since the last report?
+ Major developments on the project since last report include the following:
+ * First incubating release (0.1.0-incubating)
+ * Addition of Apache Beam Python SDK
+ * Addition of the Apache Gearpump runner
+ * Added support for writing to Apache Kafka clusters
+ * Added support for reading from and writing to Java Message Services, including Apache ActiveMQ, GeronimoJMS, and RabbitMQ
+ * Ratified new Beam model APIs to improve efficiency and failure handling: DoFn setup, teardown, and reuse
+ * Optimized key components such as data serialization and shuffle
+ * Continued improvements to the Flink, Spark, and Dataflow runners
+ * Continued reorganization and refactoring of the project
+ * Continued improvements to documentation and testing
-
Date of last release:
+ * 2016/06/15 - 0.1.0-incubating
+ * 2016/07/28 - 0.2.0-incubating (RC proposal sent to Incubator PMC)
- XXXX-XX-XX
-
When were the last committers or PMC members elected?
+ N/A - no changes since last report.
-
-
Signed-off-by:
- [ ](beam) Jean-Baptiste Onofre
+ [ ](beam) Jean-Baptiste Onofre
- [ ](beam) Jim Jagielski
- [ ](beam) Venkatesh Seetharam
+ [ ](beam) Venkatesh Seetharam
- [ ](beam) Bertrand Delacretaz
+ [ ](beam) Bertrand Delacretaz
- [ ](beam) Ted Dunning
+ [ ](beam) Ted Dunning
Shepherd/Mentor notes:
-
--------------------
---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org