You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2018/10/25 18:56:12 UTC
[beam] branch asf-site updated: Publishing website 2018/10/25
18:56:08 at commit 85ef4d0
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 868266d Publishing website 2018/10/25 18:56:08 at commit 85ef4d0
868266d is described below
commit 868266d84a7bed3034bc405f4db715dfc78d80e0
Author: jenkins <bu...@apache.org>
AuthorDate: Thu Oct 25 18:56:08 2018 +0000
Publishing website 2018/10/25 18:56:08 at commit 85ef4d0
---
.../capability/2016/03/17/capability-matrix.html | 3 +
.../2016/04/03/presentation-materials.html | 3 +
.../sdk/2016/02/25/python-sdk-now-public.html | 3 +
.../beam/release/2016/06/15/first-release.html | 3 +
.../2016/10/11/strata-hadoop-world-and-beam.html | 3 +
.../update/website/2016/02/22/beam-has-a-logo.html | 3 +
.../blog/2016/05/18/splitAtFraction-method.html | 3 +
.../05/27/where-is-my-pcollection-dot-map.html | 3 +
.../2016/06/13/flink-batch-runner-milestone.html | 3 +
.../blog/2016/08/03/six-months.html | 3 +
.../blog/2016/10/20/test-stream.html | 3 +
.../blog/2017/01/09/added-apex-runner.html | 3 +
.../blog/2017/01/10/beam-graduates.html | 3 +
.../blog/2017/02/01/graduation-media-recap.html | 3 +
.../blog/2017/02/13/stateful-processing.html | 3 +
.../blog/2017/03/16/python-sdk-release.html | 3 +
.../blog/2017/05/17/beam-first-stable-release.html | 3 +
.../blog/2017/08/16/splittable-do-fn.html | 3 +
.../blog/2017/08/28/timely-processing.html | 3 +
.../blog/2018/01/09/beam-a-look-back.html | 3 +
.../blog/2018/02/19/beam-2.3.0.html | 3 +
.../blog/2018/06/26/beam-2.5.0.html | 3 +
.../blog/2018/08/10/beam-2.6.0.html | 3 +
.../08/20/review-input-streaming-connectors.html | 3 +
.../blog/2018/08/21/beam-summit-europe.html | 3 +
.../blog/2018/10/03/beam-2.7.0.html | 3 +
website/generated-content/blog/index.html | 3 +
website/generated-content/coming-soon.html | 3 +
.../community/contact-us/index.html | 3 +
.../generated-content/community/logos/index.html | 3 +
.../community/policies/index.html | 3 +
.../community/presentation-materials/index.html | 3 +
.../community/youtube-channel/index.html | 3 +
.../contribute/become-a-committer/index.html | 4 +-
.../contribute/committer-guide/index.html | 4 +-
.../contribute/dependencies/index.html | 4 +-
.../contribute/design-documents/index.html | 4 +-
.../contribute/docker-images/index.html | 4 +-
website/generated-content/contribute/index.html | 166 +------
.../contribute/portability/index.html | 528 +--------------------
.../contribute/postcommits-guides/index.html | 4 +-
.../postcommits-policies-details/index.html | 4 +-
.../contribute/postcommits-policies/index.html | 4 +-
.../contribute/precommit-policies/index.html | 4 +-
.../contribute/precommit-triage-guide/index.html | 4 +-
.../contribute/ptransform-style-guide/index.html | 4 +-
.../contribute/release-guide/index.html | 4 +-
.../contribute/runner-guide/index.html | 4 +-
.../contribute/testing/index.html | 4 +-
.../dsls/sql/aggregate-functions/index.html | 3 +
.../dsls/sql/create-external-table/index.html | 3 +
.../documentation/dsls/sql/data-types/index.html | 3 +
.../documentation/dsls/sql/joins/index.html | 3 +
.../documentation/dsls/sql/lexical/index.html | 3 +
.../documentation/dsls/sql/overview/index.html | 3 +
.../dsls/sql/scalar-functions/index.html | 3 +
.../documentation/dsls/sql/select/index.html | 3 +
.../documentation/dsls/sql/set/index.html | 3 +
.../documentation/dsls/sql/shell/index.html | 3 +
.../dsls/sql/user-defined-functions/index.html | 3 +
.../documentation/dsls/sql/walkthrough/index.html | 3 +
.../dsls/sql/windowing-and-triggering/index.html | 3 +
.../documentation/execution-model/index.html | 3 +
website/generated-content/documentation/index.html | 3 +
.../documentation/io/authoring-java/index.html | 3 +
.../documentation/io/authoring-overview/index.html | 3 +
.../documentation/io/authoring-python/index.html | 3 +
.../io/built-in/google-bigquery/index.html | 3 +
.../documentation/io/built-in/hadoop/index.html | 3 +
.../documentation/io/built-in/hcatalog/index.html | 3 +
.../documentation/io/built-in/index.html | 3 +
.../documentation/io/contributing/index.html | 3 +
.../documentation/io/io-toc/index.html | 3 +
.../documentation/io/testing/index.html | 3 +
.../pipelines/create-your-pipeline/index.html | 3 +
.../pipelines/design-your-pipeline/index.html | 3 +
.../pipelines/test-your-pipeline/index.html | 3 +
.../documentation/programming-guide/index.html | 3 +
.../documentation/resources/index.html | 3 +
.../documentation/runners/apex/index.html | 3 +
.../runners/capability-matrix/index.html | 3 +
.../documentation/runners/dataflow/index.html | 3 +
.../documentation/runners/direct/index.html | 3 +
.../documentation/runners/flink/index.html | 3 +
.../documentation/runners/gearpump/index.html | 3 +
.../documentation/runners/jstorm/index.html | 3 +
.../documentation/runners/mapreduce/index.html | 3 +
.../documentation/runners/samza/index.html | 3 +
.../documentation/runners/spark/index.html | 3 +
.../sdks/feature-comparison/index.html | 3 +
.../documentation/sdks/go/index.html | 3 +
.../documentation/sdks/java-extensions/index.html | 3 +
.../documentation/sdks/java-thirdparty/index.html | 3 +
.../documentation/sdks/java/euphoria/index.html | 3 +
.../documentation/sdks/java/index.html | 3 +
.../documentation/sdks/java/nexmark/index.html | 3 +
.../documentation/sdks/python-custom-io/index.html | 3 +
.../sdks/python-pipeline-dependencies/index.html | 3 +
.../documentation/sdks/python-streaming/index.html | 3 +
.../sdks/python-type-safety/index.html | 3 +
.../documentation/sdks/python/index.html | 3 +
.../get-started/beam-overview/index.html | 3 +
.../get-started/downloads/index.html | 3 +
website/generated-content/get-started/index.html | 3 +
.../get-started/mobile-gaming-example/index.html | 3 +
.../get-started/quickstart-go/index.html | 3 +
.../get-started/quickstart-java/index.html | 3 +
.../get-started/quickstart-py/index.html | 3 +
.../get-started/wordcount-example/index.html | 3 +
website/generated-content/index.html | 3 +
.../generated-content/privacy_policy/index.html | 3 +
.../apex-runner}/index.html | 70 ++-
.../dataflow-runner}/index.html | 70 ++-
.../{get-started => roadmap/euphoria}/index.html | 71 ++-
.../flink-runner}/index.html | 70 ++-
.../gearpump-runner}/index.html | 70 ++-
.../{get-started => roadmap/go-sdk}/index.html | 78 ++-
.../precommit-policies => roadmap}/index.html | 158 +++---
.../{get-started => roadmap/java-sdk}/index.html | 72 ++-
.../{contribute => roadmap}/portability/index.html | 137 ++----
.../{get-started => roadmap/python-sdk}/index.html | 74 +--
.../samza-runner}/index.html | 70 ++-
.../spark-runner}/index.html | 70 ++-
.../{get-started => roadmap/sql}/index.html | 70 ++-
124 files changed, 799 insertions(+), 1316 deletions(-)
diff --git a/website/generated-content/beam/capability/2016/03/17/capability-matrix.html b/website/generated-content/beam/capability/2016/03/17/capability-matrix.html
index 99ff2cd..baebf01 100644
--- a/website/generated-content/beam/capability/2016/03/17/capability-matrix.html
+++ b/website/generated-content/beam/capability/2016/03/17/capability-matrix.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/beam/capability/2016/04/03/presentation-materials.html b/website/generated-content/beam/capability/2016/04/03/presentation-materials.html
index 427ceee..cc2a5ab 100644
--- a/website/generated-content/beam/capability/2016/04/03/presentation-materials.html
+++ b/website/generated-content/beam/capability/2016/04/03/presentation-materials.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/beam/python/sdk/2016/02/25/python-sdk-now-public.html b/website/generated-content/beam/python/sdk/2016/02/25/python-sdk-now-public.html
index b9477e4..83e1350 100644
--- a/website/generated-content/beam/python/sdk/2016/02/25/python-sdk-now-public.html
+++ b/website/generated-content/beam/python/sdk/2016/02/25/python-sdk-now-public.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/beam/release/2016/06/15/first-release.html b/website/generated-content/beam/release/2016/06/15/first-release.html
index 3ca79c7..1cd7823 100644
--- a/website/generated-content/beam/release/2016/06/15/first-release.html
+++ b/website/generated-content/beam/release/2016/06/15/first-release.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/beam/update/2016/10/11/strata-hadoop-world-and-beam.html b/website/generated-content/beam/update/2016/10/11/strata-hadoop-world-and-beam.html
index e1e5f7e..2cc7f17 100644
--- a/website/generated-content/beam/update/2016/10/11/strata-hadoop-world-and-beam.html
+++ b/website/generated-content/beam/update/2016/10/11/strata-hadoop-world-and-beam.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/beam/update/website/2016/02/22/beam-has-a-logo.html b/website/generated-content/beam/update/website/2016/02/22/beam-has-a-logo.html
index 33787e5..5ca1079 100644
--- a/website/generated-content/beam/update/website/2016/02/22/beam-has-a-logo.html
+++ b/website/generated-content/beam/update/website/2016/02/22/beam-has-a-logo.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2016/05/18/splitAtFraction-method.html b/website/generated-content/blog/2016/05/18/splitAtFraction-method.html
index d61597c..89bd574 100644
--- a/website/generated-content/blog/2016/05/18/splitAtFraction-method.html
+++ b/website/generated-content/blog/2016/05/18/splitAtFraction-method.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2016/05/27/where-is-my-pcollection-dot-map.html b/website/generated-content/blog/2016/05/27/where-is-my-pcollection-dot-map.html
index bf53976..58a597a 100644
--- a/website/generated-content/blog/2016/05/27/where-is-my-pcollection-dot-map.html
+++ b/website/generated-content/blog/2016/05/27/where-is-my-pcollection-dot-map.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2016/06/13/flink-batch-runner-milestone.html b/website/generated-content/blog/2016/06/13/flink-batch-runner-milestone.html
index b9304be..c83d92b 100644
--- a/website/generated-content/blog/2016/06/13/flink-batch-runner-milestone.html
+++ b/website/generated-content/blog/2016/06/13/flink-batch-runner-milestone.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2016/08/03/six-months.html b/website/generated-content/blog/2016/08/03/six-months.html
index 142fe32..2a70c7b 100644
--- a/website/generated-content/blog/2016/08/03/six-months.html
+++ b/website/generated-content/blog/2016/08/03/six-months.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2016/10/20/test-stream.html b/website/generated-content/blog/2016/10/20/test-stream.html
index 5ee443d..34da27a 100644
--- a/website/generated-content/blog/2016/10/20/test-stream.html
+++ b/website/generated-content/blog/2016/10/20/test-stream.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2017/01/09/added-apex-runner.html b/website/generated-content/blog/2017/01/09/added-apex-runner.html
index f91c700..d730273 100644
--- a/website/generated-content/blog/2017/01/09/added-apex-runner.html
+++ b/website/generated-content/blog/2017/01/09/added-apex-runner.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2017/01/10/beam-graduates.html b/website/generated-content/blog/2017/01/10/beam-graduates.html
index 0190456..2967b0f 100644
--- a/website/generated-content/blog/2017/01/10/beam-graduates.html
+++ b/website/generated-content/blog/2017/01/10/beam-graduates.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2017/02/01/graduation-media-recap.html b/website/generated-content/blog/2017/02/01/graduation-media-recap.html
index a8b1bc5..369ae89 100644
--- a/website/generated-content/blog/2017/02/01/graduation-media-recap.html
+++ b/website/generated-content/blog/2017/02/01/graduation-media-recap.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2017/02/13/stateful-processing.html b/website/generated-content/blog/2017/02/13/stateful-processing.html
index 31924e9..1685e5e 100644
--- a/website/generated-content/blog/2017/02/13/stateful-processing.html
+++ b/website/generated-content/blog/2017/02/13/stateful-processing.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2017/03/16/python-sdk-release.html b/website/generated-content/blog/2017/03/16/python-sdk-release.html
index 7c1192c..3721f8e 100644
--- a/website/generated-content/blog/2017/03/16/python-sdk-release.html
+++ b/website/generated-content/blog/2017/03/16/python-sdk-release.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2017/05/17/beam-first-stable-release.html b/website/generated-content/blog/2017/05/17/beam-first-stable-release.html
index a7127bd..9978b5c 100644
--- a/website/generated-content/blog/2017/05/17/beam-first-stable-release.html
+++ b/website/generated-content/blog/2017/05/17/beam-first-stable-release.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2017/08/16/splittable-do-fn.html b/website/generated-content/blog/2017/08/16/splittable-do-fn.html
index 7e1e7a8..e90115f 100644
--- a/website/generated-content/blog/2017/08/16/splittable-do-fn.html
+++ b/website/generated-content/blog/2017/08/16/splittable-do-fn.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2017/08/28/timely-processing.html b/website/generated-content/blog/2017/08/28/timely-processing.html
index 34a68c3..f721837 100644
--- a/website/generated-content/blog/2017/08/28/timely-processing.html
+++ b/website/generated-content/blog/2017/08/28/timely-processing.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2018/01/09/beam-a-look-back.html b/website/generated-content/blog/2018/01/09/beam-a-look-back.html
index e1fbd42..a19f406 100644
--- a/website/generated-content/blog/2018/01/09/beam-a-look-back.html
+++ b/website/generated-content/blog/2018/01/09/beam-a-look-back.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2018/02/19/beam-2.3.0.html b/website/generated-content/blog/2018/02/19/beam-2.3.0.html
index dbcc776..9d38ff7 100644
--- a/website/generated-content/blog/2018/02/19/beam-2.3.0.html
+++ b/website/generated-content/blog/2018/02/19/beam-2.3.0.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2018/06/26/beam-2.5.0.html b/website/generated-content/blog/2018/06/26/beam-2.5.0.html
index 019e9c6..82216d6 100644
--- a/website/generated-content/blog/2018/06/26/beam-2.5.0.html
+++ b/website/generated-content/blog/2018/06/26/beam-2.5.0.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2018/08/10/beam-2.6.0.html b/website/generated-content/blog/2018/08/10/beam-2.6.0.html
index 473ed2a..be02ed4 100644
--- a/website/generated-content/blog/2018/08/10/beam-2.6.0.html
+++ b/website/generated-content/blog/2018/08/10/beam-2.6.0.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2018/08/20/review-input-streaming-connectors.html b/website/generated-content/blog/2018/08/20/review-input-streaming-connectors.html
index e6e253e..108b74f 100644
--- a/website/generated-content/blog/2018/08/20/review-input-streaming-connectors.html
+++ b/website/generated-content/blog/2018/08/20/review-input-streaming-connectors.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2018/08/21/beam-summit-europe.html b/website/generated-content/blog/2018/08/21/beam-summit-europe.html
index 224c7f7..1abcb77 100644
--- a/website/generated-content/blog/2018/08/21/beam-summit-europe.html
+++ b/website/generated-content/blog/2018/08/21/beam-summit-europe.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/2018/10/03/beam-2.7.0.html b/website/generated-content/blog/2018/10/03/beam-2.7.0.html
index d64bf81..b3c4bb0 100644
--- a/website/generated-content/blog/2018/10/03/beam-2.7.0.html
+++ b/website/generated-content/blog/2018/10/03/beam-2.7.0.html
@@ -96,6 +96,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/blog/index.html b/website/generated-content/blog/index.html
index 62b7b21..62bb523 100644
--- a/website/generated-content/blog/index.html
+++ b/website/generated-content/blog/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/coming-soon.html b/website/generated-content/coming-soon.html
index cdc6204..bb94bac 100644
--- a/website/generated-content/coming-soon.html
+++ b/website/generated-content/coming-soon.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/community/contact-us/index.html b/website/generated-content/community/contact-us/index.html
index 483e1b2..c0e0e5f 100644
--- a/website/generated-content/community/contact-us/index.html
+++ b/website/generated-content/community/contact-us/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/community/logos/index.html b/website/generated-content/community/logos/index.html
index 4fa1c4a..c32d6eb 100644
--- a/website/generated-content/community/logos/index.html
+++ b/website/generated-content/community/logos/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/community/policies/index.html b/website/generated-content/community/policies/index.html
index 49ecf0b..e0e399b 100644
--- a/website/generated-content/community/policies/index.html
+++ b/website/generated-content/community/policies/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/community/presentation-materials/index.html b/website/generated-content/community/presentation-materials/index.html
index 8ae66e0..cd8c8d3 100644
--- a/website/generated-content/community/presentation-materials/index.html
+++ b/website/generated-content/community/presentation-materials/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/community/youtube-channel/index.html b/website/generated-content/community/youtube-channel/index.html
index 7339a3c..961d3e8 100644
--- a/website/generated-content/community/youtube-channel/index.html
+++ b/website/generated-content/community/youtube-channel/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/contribute/become-a-committer/index.html b/website/generated-content/contribute/become-a-committer/index.html
index fce322f..28aaa49 100644
--- a/website/generated-content/contribute/become-a-committer/index.html
+++ b/website/generated-content/contribute/become-a-committer/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/committer-guide/index.html b/website/generated-content/contribute/committer-guide/index.html
index 315c0b3..d936ecb 100644
--- a/website/generated-content/contribute/committer-guide/index.html
+++ b/website/generated-content/contribute/committer-guide/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/dependencies/index.html b/website/generated-content/contribute/dependencies/index.html
index 03851cc..1460219 100644
--- a/website/generated-content/contribute/dependencies/index.html
+++ b/website/generated-content/contribute/dependencies/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/design-documents/index.html b/website/generated-content/contribute/design-documents/index.html
index 488b43f..f13c3f3 100644
--- a/website/generated-content/contribute/design-documents/index.html
+++ b/website/generated-content/contribute/design-documents/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/docker-images/index.html b/website/generated-content/contribute/docker-images/index.html
index 9a247df..ee750e8 100644
--- a/website/generated-content/contribute/docker-images/index.html
+++ b/website/generated-content/contribute/docker-images/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/index.html b/website/generated-content/contribute/index.html
index 2a5bddf..8e51e53 100644
--- a/website/generated-content/contribute/index.html
+++ b/website/generated-content/contribute/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
@@ -221,24 +223,7 @@
</ul>
</li>
<li><a href="#contributing-to-the-website">Contributing to the website</a></li>
- <li><a href="#works-in-progress">Works in progress</a>
- <ul>
- <li><a href="#portability-framework">Portability Framework</a></li>
- <li><a href="#apache-spark-20-runner">Apache Spark 2.0 Runner</a></li>
- <li><a href="#jstorm-runner">JStorm Runner</a></li>
- <li><a href="#mapreduce-runner">MapReduce Runner</a></li>
- <li><a href="#tez-runner">Tez Runner</a></li>
- <li><a href="#go-sdk">Go SDK</a></li>
- <li><a href="#python-3-support">Python 3 Support</a></li>
- <li><a href="#next-java-lts-version-support-java-11--189">Next Java LTS version support (Java 11 / 18.9)</a></li>
- <li><a href="#io-performance-testing">IO Performance Testing</a></li>
- <li><a href="#euphoria-java-8-dsl">Euphoria Java 8 DSL</a></li>
- <li><a href="#improving-the-contributor-experience">Improving the contributor experience</a></li>
- <li><a href="#beam-sql">Beam SQL</a></li>
- <li><a href="#add-benchmarks-to-continuous-integration">Add benchmarks to continuous integration</a></li>
- <li><a href="#extract-metrics-in-a-runner-agnostic-way">Extract metrics in a runner agnostic way</a></li>
- </ul>
- </li>
+ <li><a href="#works-in-progress">Works in progress</a></li>
<li><a href="#stale-pull-requests">Stale pull requests</a></li>
</ul>
@@ -562,146 +547,9 @@ component in JIRA.</p>
<h2 id="works-in-progress">Works in progress</h2>
-<p>A great way to contribute is to join an existing effort. There are many
-works in progress, some on branches because they are very incomplete.</p>
-
-<h3 id="portability-framework">Portability Framework</h3>
-
-<p>The primary Beam vision: Any SDK on any runner. This is a cross-cutting effort
-across Java, Python, and Go, and every Beam runner.</p>
-
-<ul>
- <li><a href="/contribute/portability/">Read more</a></li>
-</ul>
-
-<h3 id="apache-spark-20-runner">Apache Spark 2.0 Runner</h3>
-
-<ul>
- <li>Feature branch: <a href="https://github.com/apache/beam/tree/runners-spark2">runners-spark2</a></li>
- <li>Contact: <a href="mailto:jbonofre@apache.org">Jean-Baptiste Onofré</a></li>
-</ul>
-
-<h3 id="jstorm-runner">JStorm Runner</h3>
-
-<ul>
- <li><a href="/documentation/runners/jstorm">Docs</a></li>
- <li>Feature branch: <a href="https://github.com/apache/beam/tree/jstorm-runner">jstorm-runner</a></li>
- <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-jstorm">runner-jstorm</a> / <a href="https://issues.apache.org/jira/browse/BEAM-1899">BEAM-1899</a></li>
- <li>Contact: <a href="mailto:pei@apache.org">Pei He</a></li>
-</ul>
-
-<h3 id="mapreduce-runner">MapReduce Runner</h3>
-
-<ul>
- <li>Feature branch: <a href="https://github.com/apache/beam/tree/mr-runner">mr-runner</a></li>
- <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-mapreduce">runner-mapreduce</a> / <a href="https://issues.apache.org/jira/browse/BEAM-165">BEAM-165</a></li>
- <li>Contact: <a href="mailto:pei@apache.org">Pei He</a></li>
-</ul>
-
-<h3 id="tez-runner">Tez Runner</h3>
-
-<ul>
- <li>Feature branch: <a href="https://github.com/apache/beam/tree/tez-runner">tez-runner</a></li>
- <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-tez">runner-tez</a> / <a href="https://issues.apache.org/jira/browse/BEAM-2709">BEAM-2709</a></li>
-</ul>
-
-<h3 id="go-sdk">Go SDK</h3>
-
-<ul>
- <li>
- <table>
- <tbody>
- <tr>
- <td>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20sdk-go">sdk-go</a> / <a href="https://issues.apache.org/jira/browse/BEAM-2083">BEAM-2083</a></td>
- </tr>
- </tbody>
- </table>
- </li>
- <li>Contact: <a href="mailto:herohde@google.com">Henning Rohde</a></li>
-</ul>
-
-<h3 id="python-3-support">Python 3 Support</h3>
-
-<p>Work is in progress to add Python 3 support to Beam. Current goal is to make Beam codebase compatible both with Python 2.7 and Python 3.4.</p>
-
-<ul>
- <li><a href="https://docs.google.com/document/d/1xDG0MWVlDKDPu_IW9gtMvxi2S9I0GB0VDTkPhjXT0nE">Proposal</a></li>
- <li><a href="https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=245&view=detail">Kanban Board</a></li>
- <li><a href="https://docs.google.com/document/d/1s1BJVCY65LB_SYK1SU1u7NbZiFANoq-nEYaEvzRbYlA">Python 3 Conversion Quick Start Guide</a></li>
-</ul>
-
-<p>Contributions are welcome! If you are interested to help, you can select an unassigned issue in the Kanban board and assign it to yourself. Comment on the issue if you cannot assign it yourself.
-When submitting a new PR, please tag <a href="https://github.com/robbesneyders">@RobbeSneyders</a>, <a href="https://github.com/aaltay">@aaltay</a>, and <a href="https://github.com/tvalentyn">@tvalentyn</a>.</p>
-
-<h3 id="next-java-lts-version-support-java-11--189">Next Java LTS version support (Java 11 / 18.9)</h3>
-
-<p>Work to support the next LTS release of Java is in progress. For more details about the scope and info on the various tasks please see the JIRA ticket.</p>
-
-<ul>
- <li>JIRA: <a href="https://issues.apache.org/jira/browse/BEAM-2530">BEAM-2530</a></li>
- <li>Contact: <a href="mailto:iemejia@gmail.com">Ismaël Mejía</a></li>
-</ul>
-
-<h3 id="io-performance-testing">IO Performance Testing</h3>
-
-<p>We are also working on writing Performance Tests for IOs and developing a Performance Testing Framework for them. Contributions are welcome in the following areas:</p>
-
-<ul>
- <li>developing more IO Performance Tests (IOITs)</li>
- <li>providing necessary kubernetes infrastructure (eg. for databases or filesystems to be used in tests)</li>
- <li>running Performance Tests on runners other than Dataflow and Direct</li>
- <li>improving existing Performance Testing Framework and it’s documentation</li>
-</ul>
-
-<p>See the <a href="/documentation/io/testing/#i-o-transform-integration-tests">documentation</a> and the <a href="https://docs.google.com/document/d/1dA-5s6OHiP_cz-NRAbwapoKF5MEC1wKps4A5tFbIPKE/edit?usp=sharing">initial proposal</a>(for file based tests).</p>
-
-<p>If you’re willing to help in this area, tag the following people in PRs: <a href="https://github.com/chamikaramj">@chamikaramj</a>, <a href="https://github.com/dariuszaniszewski">@DariuszAniszewski</a>, <a href="https://github.com/lgajowy">@lgajowy</a>, <a href="https://github.com/szewi">@szewi</a>, <a href="https://github.com/kkucharc">@kkucharc</a></p>
-
-<h3 id="euphoria-java-8-dsl">Euphoria Java 8 DSL</h3>
-
-<p>Easy to use Java 8 DSL for the Beam Java SDK. Provides a high-level abstraction of Beam transformations, which is both easy to read and write. Can be used as a complement to existing Beam pipelines (convertible back and forth). You can have a glimpse of the API at <a href="/documentation/sdks/java/euphoria/#wordcount-example">WordCount example</a>.</p>
-
-<ul>
- <li>Feature branch: <a href="https://github.com/apache/beam/tree/dsl-euphoria">dsl-euphoria</a></li>
- <li>JIRA: <a href="https://issues.apache.org/jira/browse/BEAM-4366?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20dsl-euphoria">dsl-euphoria</a> / <a href="https://issues.apache.org/jira/browse/BEAM-3900">BEAM-3900</a></li>
- <li>Contact: <a href="mailto:david.moravek@gmail.com">David Moravek</a></li>
-</ul>
-
-<h3 id="improving-the-contributor-experience">Improving the contributor experience</h3>
-
-<p>Making it easier to write code, run tests, and release. Investigating using docker for jenkins builds, automating the release process, and improving the reliability of tests.</p>
-
-<p>Ideas and help welcome! Contact: <a href="mailto:amyrvold@google.com">Alan Myrvold</a>, <a href="mailto:markliu@google.com">Mark Liu</a>, <a href="mailto:yifanzou@google.com">Yifan Zou</a></p>
-
-<h3 id="beam-sql">Beam SQL</h3>
-
-<p>Beam SQL has lots of areas to contribute: support for new operators, new
-connectors, performance measurement and improvement, more full specification
-and testing, etc.</p>
-
-<ul>
- <li>JIRA: <a href="https://issues.apache.org/jira/issues/?filter=12343977">dsl-sql</a></li>
- <li>Contact: <a href="mailto:kenn@apache.org">Kenneth Knowles</a></li>
-</ul>
-
-<h3 id="add-benchmarks-to-continuous-integration">Add benchmarks to continuous integration</h3>
-
-<p>Run Nexmark benchmark queries after each commit for Spark, Flink and Direct Runner and export response times to performance dashboards</p>
-
-<ul>
- <li>JIRA: <a href="https://issues.apache.org/jira/browse/BEAM-4225">nexmark-perfkit</a></li>
- <li>Contact: <a href="mailto:echauchot@apache.org">Etienne Chauchot</a></li>
-</ul>
-
-<h3 id="extract-metrics-in-a-runner-agnostic-way">Extract metrics in a runner agnostic way</h3>
-
-<p>Metrics are pushed by the runners to configurable sinks (HTTP REST sink available).
-It is already enabled in Filnk and Spark runner. Work is in progress for Dataflow</p>
-
-<ul>
- <li>JIRA: <a href="https://issues.apache.org/jira/browse/BEAM-3310">runner-agnostic-metrics</a></li>
- <li>Contact: <a href="mailto:echauchot@apache.org">Etienne Chauchot</a></li>
-</ul>
+<p>A great way to contribute is to join an existing effort. For the most
+intensive efforts, check out the <a href="/roadmap/">roadmap</a>.
+You can also find a more exhaustive list on the <a href="https://cwiki.apache.org/confluence/display/BEAM/Apache+Beam">Beam developers’ wiki</a></p>
<h2 id="stale-pull-requests">Stale pull requests</h2>
diff --git a/website/generated-content/contribute/portability/index.html b/website/generated-content/contribute/portability/index.html
index bf8700d..15b66bf 100644
--- a/website/generated-content/contribute/portability/index.html
+++ b/website/generated-content/contribute/portability/index.html
@@ -1,522 +1,10 @@
<!DOCTYPE html>
-<!--
- Licensed under the Apache License, Version 2.0 (the "License");
- you may not use this file except in compliance with the License.
- You may obtain a copy of the License at
- http://www.apache.org/licenses/LICENSE-2.0
- Unless required by applicable law or agreed to in writing, software
- distributed under the License is distributed on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- See the License for the specific language governing permissions and
- limitations under the License. See accompanying LICENSE file.
--->
-
-<html lang="en">
- <!--
- Licensed under the Apache License, Version 2.0 (the "License");
- you may not use this file except in compliance with the License.
- You may obtain a copy of the License at
- http://www.apache.org/licenses/LICENSE-2.0
- Unless required by applicable law or agreed to in writing, software
- distributed under the License is distributed on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- See the License for the specific language governing permissions and
- limitations under the License. See accompanying LICENSE file.
--->
-
-<head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Portability Framework</title>
- <meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
-">
- <link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
- <link rel="stylesheet" href="/css/site.css">
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"></script>
- <script src="/js/bootstrap.min.js"></script>
- <script src="/js/language-switch.js"></script>
- <script src="/js/fix-menu.js"></script>
- <script src="/js/section-nav.js"></script>
- <script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/contribute/portability/" data-proofer-ignore>
- <link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
- <link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
- <link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
- ga('create', 'UA-73650088-1', 'auto');
- ga('send', 'pageview');
- </script>
-</head>
-
- <body class="body" data-spy="scroll" data-target=".page-nav" data-offset="0">
- <!--
- Licensed under the Apache License, Version 2.0 (the "License");
- you may not use this file except in compliance with the License.
- You may obtain a copy of the License at
- http://www.apache.org/licenses/LICENSE-2.0
- Unless required by applicable law or agreed to in writing, software
- distributed under the License is distributed on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- See the License for the specific language governing permissions and
- limitations under the License. See accompanying LICENSE file.
--->
-
-<nav class="header navbar navbar-fixed-top">
- <div class="navbar-header">
- <button type="button" class="navbar-toggle" aria-expanded="false" aria-controls="navbar">
- <span class="sr-only">Toggle navigation</span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
-
- <a href="/" class="navbar-brand" >
- <img alt="Brand" style="height: 25px" src="/images/beam_logo_navbar.png">
- </a>
- </div>
-
- <div class="navbar-mask closed"></div>
-
- <div id="navbar" class="navbar-container closed">
- <ul class="nav navbar-nav">
- <li>
- <a href="/get-started/beam-overview/">Get Started</a>
- </li>
- <li>
- <a href="/documentation/">Documentation</a>
- </li>
- <li>
- <a href="/documentation/sdks/java/">Languages</a>
- </li>
- <li>
- <a href="/documentation/runners/capability-matrix/">RUNNERS</a>
- </li>
- <li>
- <a href="/contribute/">Contribute</a>
- </li>
- <li>
- <a href="/community/contact-us/">Community</a>
- </li>
- <li><a href="/blog">Blog</a></li>
- </ul>
- <ul class="nav navbar-nav navbar-right">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false"><img src="https://www.apache.org/foundation/press/kit/feather_small.png" alt="Apache Logo" style="height:20px;"><span class="caret"></span></a>
- <ul class="dropdown-menu dropdown-menu-right">
- <li><a href="http://www.apache.org/">ASF Homepage</a></li>
- <li><a href="http://www.apache.org/licenses/">License</a></li>
- <li><a href="http://www.apache.org/security/">Security</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html">Sponsorship</a></li>
- <li><a href="https://www.apache.org/foundation/policies/conduct">Code of Conduct</a></li>
- </ul>
- </li>
- <li>
- <a href="https://github.com/apache/beam/edit/master/website/src/contribute/portability.md">
- <i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
- </a>
- </li>
- </ul>
- </div>
-</nav>
-
- <div class="clearfix container-main-content">
- <div class="section-nav closed" data-offset-top="90" data-offset-bottom="500">
- <span class="section-nav-back glyphicon glyphicon-menu-left"></span>
- <nav>
- <ul class="section-nav-list" data-section-nav>
- <!--
- Licensed under the Apache License, Version 2.0 (the "License");
- you may not use this file except in compliance with the License.
- You may obtain a copy of the License at
- http://www.apache.org/licenses/LICENSE-2.0
- Unless required by applicable law or agreed to in writing, software
- distributed under the License is distributed on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- See the License for the specific language governing permissions and
- limitations under the License. See accompanying LICENSE file.
--->
-
-<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute/">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">IDE tips</span>
-
- <ul class="section-nav-list">
- <li><a href="https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips">Using IntelliJ IDE</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/BEAM/Eclipse+Tips">Eclipse Tips</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Technical Docs</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/testing/">Testing guide</a></li>
- <ul>
- <li><a href="/contribute/precommit-triage-guide/">Pre-commit Slowness Triage Guide</a></li>
- </ul>
- <li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
- <li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
- <li><a href="/contribute/design-documents/">Design documents</a></li>
- <li><a href="/contribute/dependencies/">Dependencies guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Policies</span>
- <ul class="section-nav-list">
- <li><a href="/contribute/precommit-policies/">Pre-commit test policies</a></li>
- <li><a href="/contribute/postcommits-policies/">Post-commit test policies</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
- </ul>
-</li>
-<li><a href="/community/contact-us/">Contact Us</a></li>
- </ul>
- </nav>
- </div>
-
- <nav class="page-nav clearfix" data-offset-top="90" data-offset-bottom="500">
- <!--
- Licensed under the Apache License, Version 2.0 (the "License");
- you may not use this file except in compliance with the License.
- You may obtain a copy of the License at
- http://www.apache.org/licenses/LICENSE-2.0
- Unless required by applicable law or agreed to in writing, software
- distributed under the License is distributed on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- See the License for the specific language governing permissions and
- limitations under the License. See accompanying LICENSE file.
--->
-
-
-
-<ul class="nav">
- <li><a href="#overview">Overview</a></li>
- <li><a href="#design">Design</a></li>
- <li><a href="#development">Development</a>
- <ul>
- <li><a href="#roadmap">Roadmap</a></li>
- <li><a href="#issues">Issues</a></li>
- <li><a href="#status">Status</a></li>
- </ul>
- </li>
-</ul>
-
-
- </nav>
-
- <div class="body__contained body__section-nav">
- <!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-
-http://www.apache.org/licenses/LICENSE-2.0
-
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-
-<h1 id="portability-framework">Portability Framework</h1>
-
-<ul id="markdown-toc">
- <li><a href="#overview" id="markdown-toc-overview">Overview</a></li>
- <li><a href="#design" id="markdown-toc-design">Design</a></li>
- <li><a href="#development" id="markdown-toc-development">Development</a> <ul>
- <li><a href="#roadmap" id="markdown-toc-roadmap">Roadmap</a></li>
- <li><a href="#issues" id="markdown-toc-issues">Issues</a></li>
- <li><a href="#status" id="markdown-toc-status">Status</a> <ul>
- <li><a href="#running-python-wordcount-on-flink" id="markdown-toc-running-python-wordcount-on-flink">Running Python wordcount on Flink</a></li>
- </ul>
- </li>
- </ul>
- </li>
-</ul>
-
-<h2 id="overview">Overview</h2>
-
-<p>Interoperability between SDKs and runners is a key aspect of Apache
-Beam. So far, however, the reality is that most runners support the
-Java SDK only, because each SDK-runner combination requires non-trivial
-work on both sides. All runners are also currently written in Java,
-which makes support of non-Java SDKs far more expensive. The
-<em>portability framework</em> aims to rectify this situation and provide
-full interoperability across the Beam ecosystem.</p>
-
-<p>The portability framework introduces well-defined, language-neutral
-data structures and protocols between the SDK and runner. This interop
-layer – called the <em>portability API</em> – ensures that SDKs and runners
-can work with each other uniformly, reducing the interoperability
-burden for both SDKs and runners to a constant effort. It notably
-ensures that <em>new</em> SDKs automatically work with existing runners and
-vice versa. The framework introduces a new runner, the <em>Universal
-Local Runner (ULR)</em>, as a practical reference implementation that
-complements the direct runners. Finally, it enables cross-language
-pipelines (sharing I/O or transformations across SDKs) and
-user-customized execution environments (“custom containers”).</p>
-
-<p>The portability API consists of a set of smaller contracts that
-isolate SDKs and runners for job submission, management and
-execution. These contracts use protobufs and gRPC for broad language
-support.</p>
-
-<ul>
- <li>
- <p><strong>Job submission and management</strong>: The <em>Runner API</em> defines a
-language-neutral pipeline representation with transformations
-specifying the execution environment as a docker container
-image. The latter both allows the execution side to set up the
-right environment as well as opens the door for custom containers
-and cross-environment pipelines. The <em>Job API</em> allows pipeline
-execution and configuration to be managed uniformly.</p>
- </li>
- <li>
- <p><strong>Job execution</strong>: The <em>SDK harness</em> is a SDK-provided
-program responsible for executing user code and is run separately
-from the runner. The <em>Fn API</em> defines an execution-time binary
-contract between the SDK harness and the runner that describes how
-execution tasks are managed and how data is transferred. In
-addition, the runner needs to handle progress and monitoring in an
-efficient and language-neutral way. SDK harness initialization
-relies on the <em>Provision</em> and <em>Artifact APIs</em> for obtaining staged
-files, pipeline options and environment information. Docker
-provides isolation between the runner and SDK/user environments to
-the benefit of both as defined by the <em>container contract</em>. The
-containerization of the SDK gives it (and the user, unless the SDK
-is closed) full control over its own environment without risk of
-dependency conflicts. The runner has significant freedom regarding
-how it manages the SDK harness containers.</p>
- </li>
-</ul>
-
-<p>The goal is that all (non-direct) runners and SDKs eventually support
-the portability API, perhaps exclusively.</p>
-
-<h2 id="design">Design</h2>
-
-<p>The <a href="https://github.com/apache/beam/tree/master/model">model protos</a>
-contain all aspects of the portability API and is the truth on the
-ground. The proto definitions supercede any design documents. The main
-design documents are the following:</p>
-
-<ul>
- <li>
- <p><a href="https://s.apache.org/beam-runner-api">Runner API</a>. Pipeline
-representation and discussion on primitive/composite transforms and
-optimizations.</p>
- </li>
- <li>
- <p><a href="https://s.apache.org/beam-job-api">Job API</a>. Job submission and
-management protocol.</p>
- </li>
- <li>
- <p><a href="https://s.apache.org/beam-fn-api">Fn API</a>. Execution-side control
-and data protocols and overview.</p>
- </li>
- <li>
- <p><a href="https://s.apache.org/beam-fn-api-container-contract">Container
-contract</a>.
-Execution-side docker container invocation and provisioning
-protocols. See
-<a href="https://github.com/apache/beam/blob/master/sdks/CONTAINERS.md">CONTAINERS.md</a>
-for how to build container images.</p>
- </li>
-</ul>
-
-<p>In discussion:</p>
-
-<ul>
- <li><a href="https://s.apache.org/beam-mixed-language-pipelines">Cross
-language</a>. Options
-and tradeoffs for how to handle various kinds of
-multi-language/multi-SDK pipelines.</li>
-</ul>
-
-<h2 id="development">Development</h2>
-
-<p>The portability framework is a substantial effort that touches every
-Beam component. In addition to the sheer magnitude, a major challenge
-is engineering an interop layer that does not significantly compromise
-performance due to the additional serialization overhead of a
-language-neutral protocol.</p>
-
-<h3 id="roadmap">Roadmap</h3>
-
-<p>The proposed project phases are roughly as follows and are not
-strictly sequential, as various components will likely move at
-different speeds. Additionally, there have been (and continues to be)
-supporting refactorings that are not always tracked as part of the
-portability effort. Work already done is not tracked here either.</p>
-
-<ul>
- <li>
- <p><strong>P1 [MVP]</strong>: Implement the fundamental plumbing for portable SDKs
-and runners for batch and streaming, including containers and the
-ULR
-[<a href="https://issues.apache.org/jira/browse/BEAM-2899">BEAM-2899</a>]. Each
-SDK and runner should use the portability framework at least to the
-extent that wordcount
-[<a href="https://issues.apache.org/jira/browse/BEAM-2896">BEAM-2896</a>] and
-windowed wordcount
-[<a href="https://issues.apache.org/jira/browse/BEAM-2941">BEAM-2941</a>] run
-portably.</p>
- </li>
- <li>
- <p><strong>P2 [Feature complete]</strong>: Design and implement portability support
-for remaining execution-side features, so that any pipeline from
-any SDK can run portably on any runner. These features include side
-inputs
-[<a href="https://issues.apache.org/jira/browse/BEAM-2863">BEAM-2863</a>], User state [<a href="https://issues.apache.org/jira/browse/BEAM-2862">BEAM-2862</a>], User
-timers
-[<a href="https://issues.apache.org/jira/browse/BEAM-2925">BEAM-2925</a>],
-Splittable DoFn
-[<a href="https://issues.apache.org/jira/browse/BEAM-2896">BEAM-2896</a>] and
-more. Each SDK and runner should use the portability framework at
-least to the extent that the mobile gaming examples
-[<a href="https://issues.apache.org/jira/browse/BEAM-2940">BEAM-2940</a>] run
-portably.</p>
- </li>
- <li>
- <p><strong>P3 [Performance]</strong>: Measure and tune performance of portable
-pipelines using benchmarks such as Nexmark. Features such as
-progress reporting
-[<a href="https://issues.apache.org/jira/browse/BEAM-2940">BEAM-2940</a>],
-combiner lifting
-[<a href="https://issues.apache.org/jira/browse/BEAM-2937">BEAM-2937</a>] and
-fusion are expected to be needed.</p>
- </li>
- <li>
- <p><strong>P4 [Cross language]</strong>: Design and implement cross-language
-pipeline support, including how the ecosystem of shared transforms
-should work.</p>
- </li>
-</ul>
-
-<h3 id="issues">Issues</h3>
-
-<p>The portability effort touches every component, so the “portability”
-label is used to identify all portability-related issues. Pure
-design or proto definitions should use the “beam-model” component. A
-common pattern for new portability features is that the overall
-feature is in “beam-model” with subtasks for each SDK and runner in
-their respective components.</p>
-
-<p><strong>JIRA:</strong> <a href="https://issues.apache.org/jira/issues/?filter=12341256">query</a></p>
-
-<h3 id="status">Status</h3>
-
-<p>MVP in progress (near completion for Flink runner). See the
-<a href="https://s.apache.org/apache-beam-portability-support-table">Portability support table</a>
-for details.</p>
-
-<h4 id="running-python-wordcount-on-flink">Running Python wordcount on Flink</h4>
-
-<p>The Flink runner is currently the only runner to support portable pipeline execution.
-To run a basic Python wordcount (in batch mode) with embedded Flink:</p>
-
-<ol>
- <li>Run once to build the SDK harness container: <code class="highlighter-rouge">./gradlew :beam-sdks-python-container:docker</code></li>
- <li>Start the Flink portable JobService endpoint: <code class="highlighter-rouge">./gradlew :beam-runners-flink_2.11-job-server:runShadow</code></li>
- <li>Submit the wordcount pipeline to above endpoint: <code class="highlighter-rouge">./gradlew :beam-sdks-python:portableWordCount -PjobEndpoint=localhost:8099</code></li>
-</ol>
-
-<p>To run the pipeline in streaming mode: <code class="highlighter-rouge">./gradlew :beam-sdks-python:portableWordCount -PjobEndpoint=localhost:8099 -Pstreaming</code></p>
-
-<p>To run on a separate <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.5/quickstart/setup_quickstart.html">Flink cluster</a>:</p>
-
-<ol>
- <li>Start local Flink cluster</li>
- <li>Create shaded JobService jar: <code class="highlighter-rouge">./gradlew :beam-runners-flink_2.11-job-server:installShadowDist</code></li>
- <li>Optional optimization step: Place the generated JobServer Jar <code class="highlighter-rouge">beam/runners/flink/job-server/build/libs/beam-runners-flink_2.11-job-server-2.7.0-SNAPSHOT.jar</code> in <code class="highlighter-rouge">flink/lib</code> and change class loading order for Flink by adding <code class="highlighter-rouge">classloader.resolve-order: parent-first</code> to <code class="highlighter-rouge">conf/flink-conf.yaml</code>.</li>
- <li>Start JobService with Flink web service endpoint: <code class="highlighter-rouge">./gradlew :beam-runners-flink_2.11-job-server:runShadow -PflinkMasterUrl=localhost:8081</code></li>
- <li>Submit the pipeline.</li>
-</ol>
-
-
- </div>
- </div>
- <!--
- Licensed under the Apache License, Version 2.0 (the "License");
- you may not use this file except in compliance with the License.
- You may obtain a copy of the License at
- http://www.apache.org/licenses/LICENSE-2.0
- Unless required by applicable law or agreed to in writing, software
- distributed under the License is distributed on an "AS IS" BASIS,
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- See the License for the specific language governing permissions and
- limitations under the License. See accompanying LICENSE file.
--->
-
-<footer class="footer">
- <div class="footer__contained">
- <div class="footer__cols">
- <div class="footer__cols__col">
- <div class="footer__cols__col__logo">
- <img src="/images/beam_logo_circle.svg" class="footer__logo" alt="Beam logo">
- </div>
- <div class="footer__cols__col__logo">
- <img src="/images/apache_logo_circle.svg" class="footer__logo" alt="Apache logo">
- </div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Start</div>
- <div class="footer__cols__col__link"><a href="/get-started/beam-overview/">Overview</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-java/">Quickstart (Java)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-py/">Quickstart (Python)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-go/">Quickstart (Go)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/downloads/">Downloads</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Docs</div>
- <div class="footer__cols__col__link"><a href="/documentation/programming-guide/">Concepts</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/pipelines/design-your-pipeline/">Pipelines</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/runners/capability-matrix/">Runners</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Community</div>
- <div class="footer__cols__col__link"><a href="/contribute/">Contribute</a></div>
- <div class="footer__cols__col__link"><a href="https://projects.apache.org/committee.html?beam" target="_blank">Team<img src="/images/external-link-icon.png"
- width="14" height="14"
- alt="External link."></a></div>
- <div class="footer__cols__col__link"><a href="/contribute/presentation-materials/">Media</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Resources</div>
- <div class="footer__cols__col__link"><a href="/blog/">Blog</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/support/">Support</a></div>
- <div class="footer__cols__col__link"><a href="https://github.com/apache/beam">GitHub</a></div>
- </div>
- </div>
- </div>
- <div class="footer__bottom">
- ©
- <a href="http://www.apache.org">The Apache Software Foundation</a>
- | <a href="/privacy_policy">Privacy Policy</a>
- | <a href="/feed.xml">RSS Feed</a>
- <br><br>
- Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are
- either registered trademarks or trademarks of The Apache Software
- Foundation. All other products or name brands are trademarks of their
- respective holders, including The Apache Software Foundation.
- </div>
-</footer>
-
- </body>
+<html lang="en-US">
+<meta charset="utf-8">
+<title>Redirecting…</title>
+<link rel="canonical" href="https://beam.apache.org/roadmap/portability/">
+<meta http-equiv="refresh" content="0; url=https://beam.apache.org/roadmap/portability/">
+<h1>Redirecting…</h1>
+<a href="https://beam.apache.org/roadmap/portability/">Click here if you are not redirected.</a>
+<script>location="https://beam.apache.org/roadmap/portability/"</script>
</html>
diff --git a/website/generated-content/contribute/postcommits-guides/index.html b/website/generated-content/contribute/postcommits-guides/index.html
index 61e7e2a..12ce4c0 100644
--- a/website/generated-content/contribute/postcommits-guides/index.html
+++ b/website/generated-content/contribute/postcommits-guides/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/postcommits-policies-details/index.html b/website/generated-content/contribute/postcommits-policies-details/index.html
index a4fdefe..9f37a60 100644
--- a/website/generated-content/contribute/postcommits-policies-details/index.html
+++ b/website/generated-content/contribute/postcommits-policies-details/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/postcommits-policies/index.html b/website/generated-content/contribute/postcommits-policies/index.html
index f8b1709..e17fe56 100644
--- a/website/generated-content/contribute/postcommits-policies/index.html
+++ b/website/generated-content/contribute/postcommits-policies/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/precommit-policies/index.html b/website/generated-content/contribute/precommit-policies/index.html
index 8c63f6c..495e746 100644
--- a/website/generated-content/contribute/precommit-policies/index.html
+++ b/website/generated-content/contribute/precommit-policies/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/precommit-triage-guide/index.html b/website/generated-content/contribute/precommit-triage-guide/index.html
index 41cae29..ddbba37 100644
--- a/website/generated-content/contribute/precommit-triage-guide/index.html
+++ b/website/generated-content/contribute/precommit-triage-guide/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/ptransform-style-guide/index.html b/website/generated-content/contribute/ptransform-style-guide/index.html
index 7a3e494..1498d92 100644
--- a/website/generated-content/contribute/ptransform-style-guide/index.html
+++ b/website/generated-content/contribute/ptransform-style-guide/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/release-guide/index.html b/website/generated-content/contribute/release-guide/index.html
index 87bf425..88b9fe6 100644
--- a/website/generated-content/contribute/release-guide/index.html
+++ b/website/generated-content/contribute/release-guide/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/runner-guide/index.html b/website/generated-content/contribute/runner-guide/index.html
index fd09f7e..efeca97 100644
--- a/website/generated-content/contribute/runner-guide/index.html
+++ b/website/generated-content/contribute/runner-guide/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/contribute/testing/index.html b/website/generated-content/contribute/testing/index.html
index 1bff291..56ba798 100644
--- a/website/generated-content/contribute/testing/index.html
+++ b/website/generated-content/contribute/testing/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -162,7 +165,6 @@
</ul>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
<li><a href="/contribute/docker-images/">Docker images</a></li>
<li><a href="/contribute/design-documents/">Design documents</a></li>
<li><a href="/contribute/dependencies/">Dependencies guide</a></li>
diff --git a/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html b/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html
index ec48538..2400201 100644
--- a/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html
+++ b/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/create-external-table/index.html b/website/generated-content/documentation/dsls/sql/create-external-table/index.html
index b67b261..6113ff4 100644
--- a/website/generated-content/documentation/dsls/sql/create-external-table/index.html
+++ b/website/generated-content/documentation/dsls/sql/create-external-table/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/data-types/index.html b/website/generated-content/documentation/dsls/sql/data-types/index.html
index 3b4fd88..bb387bc 100644
--- a/website/generated-content/documentation/dsls/sql/data-types/index.html
+++ b/website/generated-content/documentation/dsls/sql/data-types/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/joins/index.html b/website/generated-content/documentation/dsls/sql/joins/index.html
index b76f2bc..43a19bc 100644
--- a/website/generated-content/documentation/dsls/sql/joins/index.html
+++ b/website/generated-content/documentation/dsls/sql/joins/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/lexical/index.html b/website/generated-content/documentation/dsls/sql/lexical/index.html
index 19de8ad..b2dda41 100644
--- a/website/generated-content/documentation/dsls/sql/lexical/index.html
+++ b/website/generated-content/documentation/dsls/sql/lexical/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/overview/index.html b/website/generated-content/documentation/dsls/sql/overview/index.html
index 323183b..2dee2e5 100644
--- a/website/generated-content/documentation/dsls/sql/overview/index.html
+++ b/website/generated-content/documentation/dsls/sql/overview/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/scalar-functions/index.html b/website/generated-content/documentation/dsls/sql/scalar-functions/index.html
index f5bf049..3e65ca8 100644
--- a/website/generated-content/documentation/dsls/sql/scalar-functions/index.html
+++ b/website/generated-content/documentation/dsls/sql/scalar-functions/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/select/index.html b/website/generated-content/documentation/dsls/sql/select/index.html
index 15bda9a..7ddfc8c 100644
--- a/website/generated-content/documentation/dsls/sql/select/index.html
+++ b/website/generated-content/documentation/dsls/sql/select/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/set/index.html b/website/generated-content/documentation/dsls/sql/set/index.html
index b7efc60..dcacb75 100644
--- a/website/generated-content/documentation/dsls/sql/set/index.html
+++ b/website/generated-content/documentation/dsls/sql/set/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/shell/index.html b/website/generated-content/documentation/dsls/sql/shell/index.html
index 0e83bde..7353213 100644
--- a/website/generated-content/documentation/dsls/sql/shell/index.html
+++ b/website/generated-content/documentation/dsls/sql/shell/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/user-defined-functions/index.html b/website/generated-content/documentation/dsls/sql/user-defined-functions/index.html
index 1c163e1..c62e424 100644
--- a/website/generated-content/documentation/dsls/sql/user-defined-functions/index.html
+++ b/website/generated-content/documentation/dsls/sql/user-defined-functions/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/walkthrough/index.html b/website/generated-content/documentation/dsls/sql/walkthrough/index.html
index f50bad0..0b49457 100644
--- a/website/generated-content/documentation/dsls/sql/walkthrough/index.html
+++ b/website/generated-content/documentation/dsls/sql/walkthrough/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/dsls/sql/windowing-and-triggering/index.html b/website/generated-content/documentation/dsls/sql/windowing-and-triggering/index.html
index d989312..3ac92aa 100644
--- a/website/generated-content/documentation/dsls/sql/windowing-and-triggering/index.html
+++ b/website/generated-content/documentation/dsls/sql/windowing-and-triggering/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/execution-model/index.html b/website/generated-content/documentation/execution-model/index.html
index efe33a3..c7e28bf 100644
--- a/website/generated-content/documentation/execution-model/index.html
+++ b/website/generated-content/documentation/execution-model/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/index.html b/website/generated-content/documentation/index.html
index 1e8a2fd..42439e3 100644
--- a/website/generated-content/documentation/index.html
+++ b/website/generated-content/documentation/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/io/authoring-java/index.html b/website/generated-content/documentation/io/authoring-java/index.html
index d66877a..3264b2c 100644
--- a/website/generated-content/documentation/io/authoring-java/index.html
+++ b/website/generated-content/documentation/io/authoring-java/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/io/authoring-overview/index.html b/website/generated-content/documentation/io/authoring-overview/index.html
index 9f2a697..bf74bf1 100644
--- a/website/generated-content/documentation/io/authoring-overview/index.html
+++ b/website/generated-content/documentation/io/authoring-overview/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/io/authoring-python/index.html b/website/generated-content/documentation/io/authoring-python/index.html
index 3d99a7f..bbfda88 100644
--- a/website/generated-content/documentation/io/authoring-python/index.html
+++ b/website/generated-content/documentation/io/authoring-python/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/io/built-in/google-bigquery/index.html b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
index 9be64f0..07a90b0 100644
--- a/website/generated-content/documentation/io/built-in/google-bigquery/index.html
+++ b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/io/built-in/hadoop/index.html b/website/generated-content/documentation/io/built-in/hadoop/index.html
index 7d6db7e..4f2a26d 100644
--- a/website/generated-content/documentation/io/built-in/hadoop/index.html
+++ b/website/generated-content/documentation/io/built-in/hadoop/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/io/built-in/hcatalog/index.html b/website/generated-content/documentation/io/built-in/hcatalog/index.html
index d50e3f6..ff83c35 100644
--- a/website/generated-content/documentation/io/built-in/hcatalog/index.html
+++ b/website/generated-content/documentation/io/built-in/hcatalog/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/io/built-in/index.html b/website/generated-content/documentation/io/built-in/index.html
index d3f816a..a45f008 100644
--- a/website/generated-content/documentation/io/built-in/index.html
+++ b/website/generated-content/documentation/io/built-in/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/io/contributing/index.html b/website/generated-content/documentation/io/contributing/index.html
index 0d3ce39..3226c9f 100644
--- a/website/generated-content/documentation/io/contributing/index.html
+++ b/website/generated-content/documentation/io/contributing/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/io/io-toc/index.html b/website/generated-content/documentation/io/io-toc/index.html
index 9dcd99f..8e4c2a0 100644
--- a/website/generated-content/documentation/io/io-toc/index.html
+++ b/website/generated-content/documentation/io/io-toc/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/io/testing/index.html b/website/generated-content/documentation/io/testing/index.html
index 9065714..b04665a 100644
--- a/website/generated-content/documentation/io/testing/index.html
+++ b/website/generated-content/documentation/io/testing/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/pipelines/create-your-pipeline/index.html b/website/generated-content/documentation/pipelines/create-your-pipeline/index.html
index 04543d2..2f8c9e8 100644
--- a/website/generated-content/documentation/pipelines/create-your-pipeline/index.html
+++ b/website/generated-content/documentation/pipelines/create-your-pipeline/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/pipelines/design-your-pipeline/index.html b/website/generated-content/documentation/pipelines/design-your-pipeline/index.html
index 71a21f5..622b3dd 100644
--- a/website/generated-content/documentation/pipelines/design-your-pipeline/index.html
+++ b/website/generated-content/documentation/pipelines/design-your-pipeline/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/pipelines/test-your-pipeline/index.html b/website/generated-content/documentation/pipelines/test-your-pipeline/index.html
index 9b9d75e..b74d281 100644
--- a/website/generated-content/documentation/pipelines/test-your-pipeline/index.html
+++ b/website/generated-content/documentation/pipelines/test-your-pipeline/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/programming-guide/index.html b/website/generated-content/documentation/programming-guide/index.html
index 1c92103..d6946e3 100644
--- a/website/generated-content/documentation/programming-guide/index.html
+++ b/website/generated-content/documentation/programming-guide/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/resources/index.html b/website/generated-content/documentation/resources/index.html
index d47f2c7..a706213 100644
--- a/website/generated-content/documentation/resources/index.html
+++ b/website/generated-content/documentation/resources/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/runners/apex/index.html b/website/generated-content/documentation/runners/apex/index.html
index da7f903..5c01c24 100644
--- a/website/generated-content/documentation/runners/apex/index.html
+++ b/website/generated-content/documentation/runners/apex/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/runners/capability-matrix/index.html b/website/generated-content/documentation/runners/capability-matrix/index.html
index 2b0205e..69e0aac 100644
--- a/website/generated-content/documentation/runners/capability-matrix/index.html
+++ b/website/generated-content/documentation/runners/capability-matrix/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/runners/dataflow/index.html b/website/generated-content/documentation/runners/dataflow/index.html
index f2a158a..a0aad72 100644
--- a/website/generated-content/documentation/runners/dataflow/index.html
+++ b/website/generated-content/documentation/runners/dataflow/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/runners/direct/index.html b/website/generated-content/documentation/runners/direct/index.html
index e764492..1da5588 100644
--- a/website/generated-content/documentation/runners/direct/index.html
+++ b/website/generated-content/documentation/runners/direct/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/runners/flink/index.html b/website/generated-content/documentation/runners/flink/index.html
index c2b8e0d..1fbb314 100644
--- a/website/generated-content/documentation/runners/flink/index.html
+++ b/website/generated-content/documentation/runners/flink/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/runners/gearpump/index.html b/website/generated-content/documentation/runners/gearpump/index.html
index f854a72..0894063 100644
--- a/website/generated-content/documentation/runners/gearpump/index.html
+++ b/website/generated-content/documentation/runners/gearpump/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/runners/jstorm/index.html b/website/generated-content/documentation/runners/jstorm/index.html
index 1ffbd28..f692405 100644
--- a/website/generated-content/documentation/runners/jstorm/index.html
+++ b/website/generated-content/documentation/runners/jstorm/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/runners/mapreduce/index.html b/website/generated-content/documentation/runners/mapreduce/index.html
index cf5b79c..1ffccf1 100644
--- a/website/generated-content/documentation/runners/mapreduce/index.html
+++ b/website/generated-content/documentation/runners/mapreduce/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/runners/samza/index.html b/website/generated-content/documentation/runners/samza/index.html
index 9c2c229..b154db1 100644
--- a/website/generated-content/documentation/runners/samza/index.html
+++ b/website/generated-content/documentation/runners/samza/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/runners/spark/index.html b/website/generated-content/documentation/runners/spark/index.html
index 8c33ee4..03b29af 100644
--- a/website/generated-content/documentation/runners/spark/index.html
+++ b/website/generated-content/documentation/runners/spark/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/feature-comparison/index.html b/website/generated-content/documentation/sdks/feature-comparison/index.html
index fdbb249..6e22dea 100644
--- a/website/generated-content/documentation/sdks/feature-comparison/index.html
+++ b/website/generated-content/documentation/sdks/feature-comparison/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/go/index.html b/website/generated-content/documentation/sdks/go/index.html
index f22a059..1f3d364 100644
--- a/website/generated-content/documentation/sdks/go/index.html
+++ b/website/generated-content/documentation/sdks/go/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/java-extensions/index.html b/website/generated-content/documentation/sdks/java-extensions/index.html
index bf4afbc..6a0e50a 100644
--- a/website/generated-content/documentation/sdks/java-extensions/index.html
+++ b/website/generated-content/documentation/sdks/java-extensions/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/java-thirdparty/index.html b/website/generated-content/documentation/sdks/java-thirdparty/index.html
index c95b6b9..b5f2d5a 100644
--- a/website/generated-content/documentation/sdks/java-thirdparty/index.html
+++ b/website/generated-content/documentation/sdks/java-thirdparty/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/java/euphoria/index.html b/website/generated-content/documentation/sdks/java/euphoria/index.html
index a57b74d..fd3f716 100644
--- a/website/generated-content/documentation/sdks/java/euphoria/index.html
+++ b/website/generated-content/documentation/sdks/java/euphoria/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/java/index.html b/website/generated-content/documentation/sdks/java/index.html
index 3fb5c86..4998b8c 100644
--- a/website/generated-content/documentation/sdks/java/index.html
+++ b/website/generated-content/documentation/sdks/java/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/java/nexmark/index.html b/website/generated-content/documentation/sdks/java/nexmark/index.html
index 26c984d..5ac98b1 100644
--- a/website/generated-content/documentation/sdks/java/nexmark/index.html
+++ b/website/generated-content/documentation/sdks/java/nexmark/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/python-custom-io/index.html b/website/generated-content/documentation/sdks/python-custom-io/index.html
index 5f04795..6262862 100644
--- a/website/generated-content/documentation/sdks/python-custom-io/index.html
+++ b/website/generated-content/documentation/sdks/python-custom-io/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/python-pipeline-dependencies/index.html b/website/generated-content/documentation/sdks/python-pipeline-dependencies/index.html
index 845e9ab..7552e62 100644
--- a/website/generated-content/documentation/sdks/python-pipeline-dependencies/index.html
+++ b/website/generated-content/documentation/sdks/python-pipeline-dependencies/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/python-streaming/index.html b/website/generated-content/documentation/sdks/python-streaming/index.html
index cb8ccef..ff5ea1c 100644
--- a/website/generated-content/documentation/sdks/python-streaming/index.html
+++ b/website/generated-content/documentation/sdks/python-streaming/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/python-type-safety/index.html b/website/generated-content/documentation/sdks/python-type-safety/index.html
index 0bbe3f8..3fe4b97 100644
--- a/website/generated-content/documentation/sdks/python-type-safety/index.html
+++ b/website/generated-content/documentation/sdks/python-type-safety/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/documentation/sdks/python/index.html b/website/generated-content/documentation/sdks/python/index.html
index fa483ef..42729b8 100644
--- a/website/generated-content/documentation/sdks/python/index.html
+++ b/website/generated-content/documentation/sdks/python/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/get-started/beam-overview/index.html b/website/generated-content/get-started/beam-overview/index.html
index dab58cc..62762b3 100644
--- a/website/generated-content/get-started/beam-overview/index.html
+++ b/website/generated-content/get-started/beam-overview/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/get-started/downloads/index.html b/website/generated-content/get-started/downloads/index.html
index a482d71..ee15402 100644
--- a/website/generated-content/get-started/downloads/index.html
+++ b/website/generated-content/get-started/downloads/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/get-started/index.html
index 7747fcf..8e9606c 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/get-started/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/get-started/mobile-gaming-example/index.html b/website/generated-content/get-started/mobile-gaming-example/index.html
index d77128c..ea5b3b5 100644
--- a/website/generated-content/get-started/mobile-gaming-example/index.html
+++ b/website/generated-content/get-started/mobile-gaming-example/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/get-started/quickstart-go/index.html b/website/generated-content/get-started/quickstart-go/index.html
index 2d53f6c..52c010b 100644
--- a/website/generated-content/get-started/quickstart-go/index.html
+++ b/website/generated-content/get-started/quickstart-go/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/get-started/quickstart-java/index.html b/website/generated-content/get-started/quickstart-java/index.html
index cf9dcc3..c363402 100644
--- a/website/generated-content/get-started/quickstart-java/index.html
+++ b/website/generated-content/get-started/quickstart-java/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/get-started/quickstart-py/index.html b/website/generated-content/get-started/quickstart-py/index.html
index d417c37..ff15e0c 100644
--- a/website/generated-content/get-started/quickstart-py/index.html
+++ b/website/generated-content/get-started/quickstart-py/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/get-started/wordcount-example/index.html b/website/generated-content/get-started/wordcount-example/index.html
index a320fe2..c3daab0 100644
--- a/website/generated-content/get-started/wordcount-example/index.html
+++ b/website/generated-content/get-started/wordcount-example/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/index.html b/website/generated-content/index.html
index 4d45232..b7bef81 100644
--- a/website/generated-content/index.html
+++ b/website/generated-content/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/privacy_policy/index.html b/website/generated-content/privacy_policy/index.html
index f3ef9a9..028eb38 100644
--- a/website/generated-content/privacy_policy/index.html
+++ b/website/generated-content/privacy_policy/index.html
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/roadmap/apex-runner/index.html
similarity index 83%
copy from website/generated-content/get-started/index.html
copy to website/generated-content/roadmap/apex-runner/index.html
index 7747fcf..af02f13 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/roadmap/apex-runner/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Use Beam</title>
+ <title>Samza Runner Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/get-started/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/apex-runner/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/get-started/index.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/apex-runner.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,26 +145,32 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Get started</span></li>
-<li><a href="/get-started/beam-overview/">Beam Overview</a></li>
-<li>
- <span class="section-nav-list-title">Quickstarts</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li>
- <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li>
- <li><a href="/get-started/quickstart-go/">Quickstart - Go</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Example Walkthroughs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
+
<ul class="section-nav-list">
- <li><a href="/get-started/wordcount-example/">WordCount</a></li>
- <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li>
- </ul>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
+ </ul>
</li>
-<li><a href="/get-started/downloads">Downloads</a></li>
-
</ul>
</nav>
@@ -201,34 +210,15 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="get-started-with-apache-beam">Get Started with Apache Beam</h1>
-<p>Learn to use Beam to create data processing pipelines that run on supported processing back-ends:</p>
-
-<h4 id="beam-overview"><a href="/get-started/beam-overview">Beam Overview</a></h4>
-
-<p>Learn about the Beam model, the currently available Beam SDKs and Runners, and Beam’s native I/O connectors.</p>
+<h1 id="apache-apex-runner-roadmap">Apache Apex Runner Roadmap</h1>
-<h4 id="quickstart-for-java-python-or-go">Quickstart for <a href="/get-started/quickstart-java">Java</a>, <a href="/get-started/quickstart-py">Python</a> or <a href="/get-started/quickstart-go">Go</a></h4>
-
-<p>Learn how to set up a Beam project and run a simple example Beam pipeline on your local machine.</p>
-
-<h4 id="example-walkthroughs">Example Walkthroughs</h4>
-
-<p>See detailed walkthroughs of complete Beam pipelines.</p>
+<p>This roadmap is in progress. In the meantime, here are available resources:</p>
<ul>
- <li><a href="/get-started/wordcount-example">WordCount</a>: Simple example pipelines that demonstrate basic Beam programming, including debugging and testing</li>
- <li><a href="/get-started/mobile-gaming-example">Mobile Gaming</a>: A series of more advanced pipelines that demonstrate use cases in the mobile gaming domain</li>
+ <li><a href="/documentation/runners/apex">Runner documentation</a></li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-apex">runner-apex</a></li>
</ul>
-<h4 id="downloads-and-releases"><a href="/get-started/downloads">Downloads and Releases</a></h4>
-
-<p>Find download links and information on the latest Beam releases, including versioning and release notes.</p>
-
-<h4 id="support"><a href="/get-started/support">Support</a></h4>
-
-<p>Find resources, such as mailing lists and issue tracking, to help you use Beam. Ask questions and discuss topics via <a href="http://stackoverflow.com/questions/tagged/apache-beam">Stack Overflow</a> or on Beam’s <a href="http://apachebeam.slack.com">Slack Channel</a>.</p>
-
</div>
</div>
<!--
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/roadmap/dataflow-runner/index.html
similarity index 83%
copy from website/generated-content/get-started/index.html
copy to website/generated-content/roadmap/dataflow-runner/index.html
index 7747fcf..55e1a9b 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/roadmap/dataflow-runner/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Use Beam</title>
+ <title>Flink Runner Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/get-started/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/dataflow-runner/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/get-started/index.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/dataflow-runner.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,26 +145,32 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Get started</span></li>
-<li><a href="/get-started/beam-overview/">Beam Overview</a></li>
-<li>
- <span class="section-nav-list-title">Quickstarts</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li>
- <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li>
- <li><a href="/get-started/quickstart-go/">Quickstart - Go</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Example Walkthroughs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
+
<ul class="section-nav-list">
- <li><a href="/get-started/wordcount-example/">WordCount</a></li>
- <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li>
- </ul>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
+ </ul>
</li>
-<li><a href="/get-started/downloads">Downloads</a></li>
-
</ul>
</nav>
@@ -201,34 +210,15 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="get-started-with-apache-beam">Get Started with Apache Beam</h1>
-<p>Learn to use Beam to create data processing pipelines that run on supported processing back-ends:</p>
-
-<h4 id="beam-overview"><a href="/get-started/beam-overview">Beam Overview</a></h4>
-
-<p>Learn about the Beam model, the currently available Beam SDKs and Runners, and Beam’s native I/O connectors.</p>
+<h1 id="google-cloud-dataflow-runner-roadmap">Google Cloud Dataflow Runner Roadmap</h1>
-<h4 id="quickstart-for-java-python-or-go">Quickstart for <a href="/get-started/quickstart-java">Java</a>, <a href="/get-started/quickstart-py">Python</a> or <a href="/get-started/quickstart-go">Go</a></h4>
-
-<p>Learn how to set up a Beam project and run a simple example Beam pipeline on your local machine.</p>
-
-<h4 id="example-walkthroughs">Example Walkthroughs</h4>
-
-<p>See detailed walkthroughs of complete Beam pipelines.</p>
+<p>This roadmap is in progress. In the meantime, here are available resources:</p>
<ul>
- <li><a href="/get-started/wordcount-example">WordCount</a>: Simple example pipelines that demonstrate basic Beam programming, including debugging and testing</li>
- <li><a href="/get-started/mobile-gaming-example">Mobile Gaming</a>: A series of more advanced pipelines that demonstrate use cases in the mobile gaming domain</li>
+ <li><a href="/documentation/runners/dataflow">Runner documentation</a></li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-dataflow">runner-dataflow</a></li>
</ul>
-<h4 id="downloads-and-releases"><a href="/get-started/downloads">Downloads and Releases</a></h4>
-
-<p>Find download links and information on the latest Beam releases, including versioning and release notes.</p>
-
-<h4 id="support"><a href="/get-started/support">Support</a></h4>
-
-<p>Find resources, such as mailing lists and issue tracking, to help you use Beam. Ask questions and discuss topics via <a href="http://stackoverflow.com/questions/tagged/apache-beam">Stack Overflow</a> or on Beam’s <a href="http://apachebeam.slack.com">Slack Channel</a>.</p>
-
</div>
</div>
<!--
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/roadmap/euphoria/index.html
similarity index 83%
copy from website/generated-content/get-started/index.html
copy to website/generated-content/roadmap/euphoria/index.html
index 7747fcf..003214f 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/roadmap/euphoria/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Use Beam</title>
+ <title>Euphoria API Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/get-started/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/euphoria/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/get-started/index.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/euphoria.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,26 +145,32 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Get started</span></li>
-<li><a href="/get-started/beam-overview/">Beam Overview</a></li>
-<li>
- <span class="section-nav-list-title">Quickstarts</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li>
- <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li>
- <li><a href="/get-started/quickstart-go/">Quickstart - Go</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Example Walkthroughs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
+
<ul class="section-nav-list">
- <li><a href="/get-started/wordcount-example/">WordCount</a></li>
- <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li>
- </ul>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
+ </ul>
</li>
-<li><a href="/get-started/downloads">Downloads</a></li>
-
</ul>
</nav>
@@ -201,34 +210,18 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="get-started-with-apache-beam">Get Started with Apache Beam</h1>
-<p>Learn to use Beam to create data processing pipelines that run on supported processing back-ends:</p>
-
-<h4 id="beam-overview"><a href="/get-started/beam-overview">Beam Overview</a></h4>
-
-<p>Learn about the Beam model, the currently available Beam SDKs and Runners, and Beam’s native I/O connectors.</p>
+<h1 id="euphoria-api">Euphoria API</h1>
-<h4 id="quickstart-for-java-python-or-go">Quickstart for <a href="/get-started/quickstart-java">Java</a>, <a href="/get-started/quickstart-py">Python</a> or <a href="/get-started/quickstart-go">Go</a></h4>
+<p>Easy to use Java 8 DSL for the Beam Java SDK. Provides a high-level abstraction of Beam transformations, which is both easy to read and write. Can be used as a complement to existing Beam pipelines (convertible back and forth). You can have a glimpse of the API at <a href="/documentation/sdks/java/euphoria/#wordcount-example">WordCount example</a>.</p>
-<p>Learn how to set up a Beam project and run a simple example Beam pipeline on your local machine.</p>
-
-<h4 id="example-walkthroughs">Example Walkthroughs</h4>
-
-<p>See detailed walkthroughs of complete Beam pipelines.</p>
+<p>This roadmap is in progress. In the meantime, here are some resources:</p>
<ul>
- <li><a href="/get-started/wordcount-example">WordCount</a>: Simple example pipelines that demonstrate basic Beam programming, including debugging and testing</li>
- <li><a href="/get-started/mobile-gaming-example">Mobile Gaming</a>: A series of more advanced pipelines that demonstrate use cases in the mobile gaming domain</li>
+ <li>Feature branch: <a href="https://github.com/apache/beam/tree/dsl-euphoria">dsl-euphoria</a></li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/browse/BEAM-4366?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20dsl-euphoria">dsl-euphoria</a> / <a href="https://issues.apache.org/jira/browse/BEAM-3900">BEAM-3900</a></li>
+ <li>Contact: <a href="mailto:david.moravek@gmail.com">David Moravek</a></li>
</ul>
-<h4 id="downloads-and-releases"><a href="/get-started/downloads">Downloads and Releases</a></h4>
-
-<p>Find download links and information on the latest Beam releases, including versioning and release notes.</p>
-
-<h4 id="support"><a href="/get-started/support">Support</a></h4>
-
-<p>Find resources, such as mailing lists and issue tracking, to help you use Beam. Ask questions and discuss topics via <a href="http://stackoverflow.com/questions/tagged/apache-beam">Stack Overflow</a> or on Beam’s <a href="http://apachebeam.slack.com">Slack Channel</a>.</p>
-
</div>
</div>
<!--
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/roadmap/flink-runner/index.html
similarity index 83%
copy from website/generated-content/get-started/index.html
copy to website/generated-content/roadmap/flink-runner/index.html
index 7747fcf..ca3cba4 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/roadmap/flink-runner/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Use Beam</title>
+ <title>Flink Runner Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/get-started/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/flink-runner/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/get-started/index.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/flink-runner.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,26 +145,32 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Get started</span></li>
-<li><a href="/get-started/beam-overview/">Beam Overview</a></li>
-<li>
- <span class="section-nav-list-title">Quickstarts</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li>
- <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li>
- <li><a href="/get-started/quickstart-go/">Quickstart - Go</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Example Walkthroughs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
+
<ul class="section-nav-list">
- <li><a href="/get-started/wordcount-example/">WordCount</a></li>
- <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li>
- </ul>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
+ </ul>
</li>
-<li><a href="/get-started/downloads">Downloads</a></li>
-
</ul>
</nav>
@@ -201,34 +210,15 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="get-started-with-apache-beam">Get Started with Apache Beam</h1>
-<p>Learn to use Beam to create data processing pipelines that run on supported processing back-ends:</p>
-
-<h4 id="beam-overview"><a href="/get-started/beam-overview">Beam Overview</a></h4>
-
-<p>Learn about the Beam model, the currently available Beam SDKs and Runners, and Beam’s native I/O connectors.</p>
+<h1 id="apache-flink-runner-roadmap">Apache Flink Runner Roadmap</h1>
-<h4 id="quickstart-for-java-python-or-go">Quickstart for <a href="/get-started/quickstart-java">Java</a>, <a href="/get-started/quickstart-py">Python</a> or <a href="/get-started/quickstart-go">Go</a></h4>
-
-<p>Learn how to set up a Beam project and run a simple example Beam pipeline on your local machine.</p>
-
-<h4 id="example-walkthroughs">Example Walkthroughs</h4>
-
-<p>See detailed walkthroughs of complete Beam pipelines.</p>
+<p>This roadmap is in progress. In the meantime, here are available resources:</p>
<ul>
- <li><a href="/get-started/wordcount-example">WordCount</a>: Simple example pipelines that demonstrate basic Beam programming, including debugging and testing</li>
- <li><a href="/get-started/mobile-gaming-example">Mobile Gaming</a>: A series of more advanced pipelines that demonstrate use cases in the mobile gaming domain</li>
+ <li><a href="/documentation/runners/flink">Runner documentation</a></li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-flink">runner-flink</a></li>
</ul>
-<h4 id="downloads-and-releases"><a href="/get-started/downloads">Downloads and Releases</a></h4>
-
-<p>Find download links and information on the latest Beam releases, including versioning and release notes.</p>
-
-<h4 id="support"><a href="/get-started/support">Support</a></h4>
-
-<p>Find resources, such as mailing lists and issue tracking, to help you use Beam. Ask questions and discuss topics via <a href="http://stackoverflow.com/questions/tagged/apache-beam">Stack Overflow</a> or on Beam’s <a href="http://apachebeam.slack.com">Slack Channel</a>.</p>
-
</div>
</div>
<!--
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/roadmap/gearpump-runner/index.html
similarity index 83%
copy from website/generated-content/get-started/index.html
copy to website/generated-content/roadmap/gearpump-runner/index.html
index 7747fcf..7245e4a 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/roadmap/gearpump-runner/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Use Beam</title>
+ <title>Samza Runner Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/get-started/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/gearpump-runner/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/get-started/index.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/gearpump-runner.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,26 +145,32 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Get started</span></li>
-<li><a href="/get-started/beam-overview/">Beam Overview</a></li>
-<li>
- <span class="section-nav-list-title">Quickstarts</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li>
- <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li>
- <li><a href="/get-started/quickstart-go/">Quickstart - Go</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Example Walkthroughs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
+
<ul class="section-nav-list">
- <li><a href="/get-started/wordcount-example/">WordCount</a></li>
- <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li>
- </ul>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
+ </ul>
</li>
-<li><a href="/get-started/downloads">Downloads</a></li>
-
</ul>
</nav>
@@ -201,34 +210,15 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="get-started-with-apache-beam">Get Started with Apache Beam</h1>
-<p>Learn to use Beam to create data processing pipelines that run on supported processing back-ends:</p>
-
-<h4 id="beam-overview"><a href="/get-started/beam-overview">Beam Overview</a></h4>
-
-<p>Learn about the Beam model, the currently available Beam SDKs and Runners, and Beam’s native I/O connectors.</p>
+<h1 id="gearpump-runner-roadmap">Gearpump Runner Roadmap</h1>
-<h4 id="quickstart-for-java-python-or-go">Quickstart for <a href="/get-started/quickstart-java">Java</a>, <a href="/get-started/quickstart-py">Python</a> or <a href="/get-started/quickstart-go">Go</a></h4>
-
-<p>Learn how to set up a Beam project and run a simple example Beam pipeline on your local machine.</p>
-
-<h4 id="example-walkthroughs">Example Walkthroughs</h4>
-
-<p>See detailed walkthroughs of complete Beam pipelines.</p>
+<p>This roadmap is in progress. In the meantime, here are available resources:</p>
<ul>
- <li><a href="/get-started/wordcount-example">WordCount</a>: Simple example pipelines that demonstrate basic Beam programming, including debugging and testing</li>
- <li><a href="/get-started/mobile-gaming-example">Mobile Gaming</a>: A series of more advanced pipelines that demonstrate use cases in the mobile gaming domain</li>
+ <li><a href="/documentation/runners/gearpump">Runner documentation</a></li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-gearpump">runner-gearpump</a></li>
</ul>
-<h4 id="downloads-and-releases"><a href="/get-started/downloads">Downloads and Releases</a></h4>
-
-<p>Find download links and information on the latest Beam releases, including versioning and release notes.</p>
-
-<h4 id="support"><a href="/get-started/support">Support</a></h4>
-
-<p>Find resources, such as mailing lists and issue tracking, to help you use Beam. Ask questions and discuss topics via <a href="http://stackoverflow.com/questions/tagged/apache-beam">Stack Overflow</a> or on Beam’s <a href="http://apachebeam.slack.com">Slack Channel</a>.</p>
-
</div>
</div>
<!--
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/roadmap/go-sdk/index.html
similarity index 83%
copy from website/generated-content/get-started/index.html
copy to website/generated-content/roadmap/go-sdk/index.html
index 7747fcf..88ccbda 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/roadmap/go-sdk/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Use Beam</title>
+ <title>Go SDK Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/get-started/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/go-sdk/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/get-started/index.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/go-sdk.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,26 +145,32 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Get started</span></li>
-<li><a href="/get-started/beam-overview/">Beam Overview</a></li>
-<li>
- <span class="section-nav-list-title">Quickstarts</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li>
- <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li>
- <li><a href="/get-started/quickstart-go/">Quickstart - Go</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Example Walkthroughs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
+
<ul class="section-nav-list">
- <li><a href="/get-started/wordcount-example/">WordCount</a></li>
- <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li>
- </ul>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
+ </ul>
</li>
-<li><a href="/get-started/downloads">Downloads</a></li>
-
</ul>
</nav>
@@ -201,34 +210,23 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="get-started-with-apache-beam">Get Started with Apache Beam</h1>
-<p>Learn to use Beam to create data processing pipelines that run on supported processing back-ends:</p>
-
-<h4 id="beam-overview"><a href="/get-started/beam-overview">Beam Overview</a></h4>
-
-<p>Learn about the Beam model, the currently available Beam SDKs and Runners, and Beam’s native I/O connectors.</p>
+<h1 id="go-sdk-roadmap">Go SDK Roadmap</h1>
-<h4 id="quickstart-for-java-python-or-go">Quickstart for <a href="/get-started/quickstart-java">Java</a>, <a href="/get-started/quickstart-py">Python</a> or <a href="/get-started/quickstart-go">Go</a></h4>
-
-<p>Learn how to set up a Beam project and run a simple example Beam pipeline on your local machine.</p>
-
-<h4 id="example-walkthroughs">Example Walkthroughs</h4>
-
-<p>See detailed walkthroughs of complete Beam pipelines.</p>
+<p>This roadmap is in progress. In the meantime, here are available resources:</p>
<ul>
- <li><a href="/get-started/wordcount-example">WordCount</a>: Simple example pipelines that demonstrate basic Beam programming, including debugging and testing</li>
- <li><a href="/get-started/mobile-gaming-example">Mobile Gaming</a>: A series of more advanced pipelines that demonstrate use cases in the mobile gaming domain</li>
+ <li>
+ <table>
+ <tbody>
+ <tr>
+ <td>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20sdk-go">sdk-go</a> / <a href="https://issues.apache.org/jira/browse/BEAM-2083">BEAM-2083</a></td>
+ </tr>
+ </tbody>
+ </table>
+ </li>
+ <li>Contact: <a href="mailto:herohde@google.com">Henning Rohde</a></li>
</ul>
-<h4 id="downloads-and-releases"><a href="/get-started/downloads">Downloads and Releases</a></h4>
-
-<p>Find download links and information on the latest Beam releases, including versioning and release notes.</p>
-
-<h4 id="support"><a href="/get-started/support">Support</a></h4>
-
-<p>Find resources, such as mailing lists and issue tracking, to help you use Beam. Ask questions and discuss topics via <a href="http://stackoverflow.com/questions/tagged/apache-beam">Stack Overflow</a> or on Beam’s <a href="http://apachebeam.slack.com">Slack Channel</a>.</p>
-
</div>
</div>
<!--
diff --git a/website/generated-content/contribute/precommit-policies/index.html b/website/generated-content/roadmap/index.html
similarity index 75%
copy from website/generated-content/contribute/precommit-policies/index.html
copy to website/generated-content/roadmap/index.html
index 8c63f6c..14c12d5 100644
--- a/website/generated-content/contribute/precommit-policies/index.html
+++ b/website/generated-content/roadmap/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Pre-commit Test Policies</title>
+ <title>Apache Beam Roadmap Highlights</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/contribute/precommit-policies/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/contribute/precommit-policies.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/index.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,49 +145,33 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute/">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">IDE tips</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips">Using IntelliJ IDE</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/BEAM/Eclipse+Tips">Eclipse Tips</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Technical Docs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
<ul class="section-nav-list">
- <li><a href="/contribute/testing/">Testing guide</a></li>
- <ul>
- <li><a href="/contribute/precommit-triage-guide/">Pre-commit Slowness Triage Guide</a></li>
- </ul>
- <li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
- <li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
- <li><a href="/contribute/design-documents/">Design documents</a></li>
- <li><a href="/contribute/dependencies/">Dependencies guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Policies</span>
- <ul class="section-nav-list">
- <li><a href="/contribute/precommit-policies/">Pre-commit test policies</a></li>
- <li><a href="/contribute/postcommits-policies/">Post-commit test policies</a></li>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
- </ul>
-</li>
-<li><a href="/community/contact-us/">Contact Us</a></li>
</ul>
</nav>
</div>
@@ -205,14 +192,13 @@
<ul class="nav">
- <li><a href="#definitions">Definitions</a></li>
- <li><a href="#policies">Policies</a>
- <ul>
- <li><a href="#pull-requests">Pull Requests</a></li>
- <li><a href="#problems">Problems</a></li>
- <li><a href="#problem-resolution">Problem Resolution</a></li>
- </ul>
- </li>
+ <li><a href="#portability-framework">Portability Framework</a></li>
+ <li><a href="#python-on-flink">Python on Flink</a></li>
+ <li><a href="#go-sdk">Go SDK</a></li>
+ <li><a href="#python-3-support">Python 3 support</a></li>
+ <li><a href="#java-11-support">Java 11 support</a></li>
+ <li><a href="#sql">SQL</a></li>
+ <li><a href="#euphoria">Euphoria</a></li>
</ul>
@@ -233,64 +219,62 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="pre-commit-test-policies">Pre-commit test policies</h1>
+<h1 id="apache-beam-roadmap">Apache Beam Roadmap</h1>
-<h2 id="definitions">Definitions</h2>
+<p>Apache Beam is not governed or steered by any one commercial entity, but by its
+Project Management Committee (PMC), so we do not have a roadmap in the sense of
+a plan with a specific timeline.
+Instead, we share our vision for the future and major initiatives receiving
+and attention and contribution that users can look forward to.</p>
-<ul>
- <li>Pre-commit test - Any single test in a pre-commit test suite.</li>
- <li>Pre-commit test suite - A collection of pre-commit tests that have a common
-denominator. A test suite runs in a single Jenkins job. Currently, suites are
-grouped by SDK languages, e.g., Python, Java, and Go.</li>
-</ul>
+<p>The major components of Beam each have their own roadmap which you can find
+via the menu.
+Below are some highlights for the project as a whole.</p>
-<h2 id="policies">Policies</h2>
+<h2 id="portability-framework">Portability Framework</h2>
-<h3 id="pull-requests">Pull Requests</h3>
+<p>Portability is the primary Beam vision: running pipelines authors with <em>any SDK</em>
+on <em>any runner</em>. This is a cross-cutting effort across Java, Python, and Go,
+and every Beam runner.</p>
-<ul>
- <li>A PR must pass pre-commit tests before being committed to the main Beam repo.
- <ul>
- <li>The relevant pre-commit test suites are automatically launched according to
-PR contents.</li>
- </ul>
- </li>
-</ul>
+<p>See the details on the <a href="/roadmap/portability/">Portability Roadmap</a></p>
-<h3 id="problems">Problems</h3>
+<h2 id="python-on-flink">Python on Flink</h2>
-<h4 id="breakage">Breakage</h4>
+<p>A major highlight of the portability effort is the effort in running Python pipelines
+the Flink runner.</p>
-<p>Breakage is when one or more tests in a pre-commit test suite fails or
-is flaky (occasionally fails).</p>
+<p>You can <a href="/roadmap/portability/#python-on-flink">follow the instructions to try it out</a></p>
-<ul>
- <li>Breakages should be fixed within 8 hours.</li>
-</ul>
+<h2 id="go-sdk">Go SDK</h2>
-<h4 id="slowness">Slowness</h4>
+<p>The Go SDK is the newest SDK, and is the first SDK built entirely on the
+portability framework. See the <a href="/roadmap/go-sdk">Go SDK’s Roadmap</a> if this piques your
+interest.</p>
-<p>Slowness is when the total time to run a pre-commit suite exceeds 30 minutes*,
-including the time the job spends in the Jenkins queue.</p>
+<h2 id="python-3-support">Python 3 support</h2>
-<ul>
- <li>Slowness should be fixed within 24 hours.</li>
-</ul>
+<p>The Python SDK is near to supporting Python 3. See details on
+the <a href="/roadmap/python-sdk/#python-3-support">Python SDK’s Roadmap</a>.
+This is also a great opportunity for lightweight contribution!</p>
-<p>* See the <a href="/contribute/precommit-triage-guide/">Pre-commit Slowness Triage
-Guide</a> for a precise definition of slowness
-and for information on dealing with slowness.</p>
+<h2 id="java-11-support">Java 11 support</h2>
-<h3 id="problem-resolution">Problem Resolution</h3>
+<p>The Java SDK is eager to add support for Java’s first new LTS (Long Term Support)
+version. See details on
+the <a href="/roadmap/java-sdk/#java-11-support">Java SDK’s Roadmap</a>.</p>
-<p>For any problem, the options are, one of:</p>
+<h2 id="sql">SQL</h2>
-<ul>
- <li>Roll back the culprit PR.</li>
- <li>Roll out a fix within 24 hours.</li>
- <li>Disable the slow test or feature temporarily (make sure there’s a tracking
-issue to re-enable it).</li>
-</ul>
+<p>Beam’s SQL module is rapidly maturing to allow users to author batch and
+streaming pipelines using only SQL, but also to allow Beam Java developers
+to use SQL in components of their pipeline for added efficiency. See the
+<a href="/roadmap/sql/">Beam SQL Roadmap</a></p>
+
+<h2 id="euphoria">Euphoria</h2>
+
+<p>Euphoria is Beam’s newest API, offering a high-level, fluent style for
+Beam Java developers. See the <a href="/roadmap/euphoria">Euphoria API Roadmap</a>.</p>
</div>
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/roadmap/java-sdk/index.html
similarity index 83%
copy from website/generated-content/get-started/index.html
copy to website/generated-content/roadmap/java-sdk/index.html
index 7747fcf..ab9415b 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/roadmap/java-sdk/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Use Beam</title>
+ <title>Java SDK Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/get-started/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/java-sdk/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/get-started/index.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/java-sdk.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,26 +145,32 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Get started</span></li>
-<li><a href="/get-started/beam-overview/">Beam Overview</a></li>
-<li>
- <span class="section-nav-list-title">Quickstarts</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li>
- <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li>
- <li><a href="/get-started/quickstart-go/">Quickstart - Go</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Example Walkthroughs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
+
<ul class="section-nav-list">
- <li><a href="/get-started/wordcount-example/">WordCount</a></li>
- <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li>
- </ul>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
+ </ul>
</li>
-<li><a href="/get-started/downloads">Downloads</a></li>
-
</ul>
</nav>
@@ -182,6 +191,9 @@
+<ul class="nav">
+ <li><a href="#next-java-lts-version-support-java-11--189">Next Java LTS version support (Java 11 / 18.9)</a></li>
+</ul>
</nav>
@@ -201,33 +213,17 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="get-started-with-apache-beam">Get Started with Apache Beam</h1>
-<p>Learn to use Beam to create data processing pipelines that run on supported processing back-ends:</p>
-
-<h4 id="beam-overview"><a href="/get-started/beam-overview">Beam Overview</a></h4>
+<h1 id="java-sdk-roadmap">Java SDK Roadmap</h1>
-<p>Learn about the Beam model, the currently available Beam SDKs and Runners, and Beam’s native I/O connectors.</p>
+<h2 id="next-java-lts-version-support-java-11--189">Next Java LTS version support (Java 11 / 18.9)</h2>
-<h4 id="quickstart-for-java-python-or-go">Quickstart for <a href="/get-started/quickstart-java">Java</a>, <a href="/get-started/quickstart-py">Python</a> or <a href="/get-started/quickstart-go">Go</a></h4>
-
-<p>Learn how to set up a Beam project and run a simple example Beam pipeline on your local machine.</p>
-
-<h4 id="example-walkthroughs">Example Walkthroughs</h4>
-
-<p>See detailed walkthroughs of complete Beam pipelines.</p>
+<p>Work to support the next LTS release of Java is in progress. For more details about the scope and info on the various tasks please see the JIRA ticket.</p>
<ul>
- <li><a href="/get-started/wordcount-example">WordCount</a>: Simple example pipelines that demonstrate basic Beam programming, including debugging and testing</li>
- <li><a href="/get-started/mobile-gaming-example">Mobile Gaming</a>: A series of more advanced pipelines that demonstrate use cases in the mobile gaming domain</li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/browse/BEAM-2530">BEAM-2530</a></li>
+ <li>Contact: <a href="mailto:iemejia@gmail.com">Ismaël Mejía</a></li>
</ul>
-<h4 id="downloads-and-releases"><a href="/get-started/downloads">Downloads and Releases</a></h4>
-
-<p>Find download links and information on the latest Beam releases, including versioning and release notes.</p>
-
-<h4 id="support"><a href="/get-started/support">Support</a></h4>
-
-<p>Find resources, such as mailing lists and issue tracking, to help you use Beam. Ask questions and discuss topics via <a href="http://stackoverflow.com/questions/tagged/apache-beam">Stack Overflow</a> or on Beam’s <a href="http://apachebeam.slack.com">Slack Channel</a>.</p>
</div>
</div>
diff --git a/website/generated-content/contribute/portability/index.html b/website/generated-content/roadmap/portability/index.html
similarity index 82%
copy from website/generated-content/contribute/portability/index.html
copy to website/generated-content/roadmap/portability/index.html
index bf8700d..9950a2f 100644
--- a/website/generated-content/contribute/portability/index.html
+++ b/website/generated-content/roadmap/portability/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Portability Framework</title>
+ <title>Portability Framework Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/contribute/portability/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/portability/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/contribute/portability.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/portability.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,49 +145,33 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute/">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">IDE tips</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips">Using IntelliJ IDE</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/BEAM/Eclipse+Tips">Eclipse Tips</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Technical Docs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
<ul class="section-nav-list">
- <li><a href="/contribute/testing/">Testing guide</a></li>
- <ul>
- <li><a href="/contribute/precommit-triage-guide/">Pre-commit Slowness Triage Guide</a></li>
- </ul>
- <li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
- <li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
- <li><a href="/contribute/design-documents/">Design documents</a></li>
- <li><a href="/contribute/dependencies/">Dependencies guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Policies</span>
- <ul class="section-nav-list">
- <li><a href="/contribute/precommit-policies/">Pre-commit test policies</a></li>
- <li><a href="/contribute/postcommits-policies/">Post-commit test policies</a></li>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
- </ul>
-</li>
-<li><a href="/community/contact-us/">Contact Us</a></li>
</ul>
</nav>
</div>
@@ -206,12 +193,11 @@
<ul class="nav">
<li><a href="#overview">Overview</a></li>
- <li><a href="#design">Design</a></li>
- <li><a href="#development">Development</a>
+ <li><a href="#milestones">Milestones</a></li>
+ <li><a href="#issues">Issues</a></li>
+ <li><a href="#status">Status</a>
<ul>
- <li><a href="#roadmap">Roadmap</a></li>
- <li><a href="#issues">Issues</a></li>
- <li><a href="#status">Status</a></li>
+ <li><a href="#python-on-flink">Running Python wordcount on Flink</a></li>
</ul>
</li>
</ul>
@@ -234,21 +220,7 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="portability-framework">Portability Framework</h1>
-
-<ul id="markdown-toc">
- <li><a href="#overview" id="markdown-toc-overview">Overview</a></li>
- <li><a href="#design" id="markdown-toc-design">Design</a></li>
- <li><a href="#development" id="markdown-toc-development">Development</a> <ul>
- <li><a href="#roadmap" id="markdown-toc-roadmap">Roadmap</a></li>
- <li><a href="#issues" id="markdown-toc-issues">Issues</a></li>
- <li><a href="#status" id="markdown-toc-status">Status</a> <ul>
- <li><a href="#running-python-wordcount-on-flink" id="markdown-toc-running-python-wordcount-on-flink">Running Python wordcount on Flink</a></li>
- </ul>
- </li>
- </ul>
- </li>
-</ul>
+<h1 id="portability-framework-roadmap">Portability Framework Roadmap</h1>
<h2 id="overview">Overview</h2>
@@ -309,47 +281,10 @@ how it manages the SDK harness containers.</p>
<p>The goal is that all (non-direct) runners and SDKs eventually support
the portability API, perhaps exclusively.</p>
-<h2 id="design">Design</h2>
-
-<p>The <a href="https://github.com/apache/beam/tree/master/model">model protos</a>
-contain all aspects of the portability API and is the truth on the
-ground. The proto definitions supercede any design documents. The main
-design documents are the following:</p>
-
-<ul>
- <li>
- <p><a href="https://s.apache.org/beam-runner-api">Runner API</a>. Pipeline
-representation and discussion on primitive/composite transforms and
-optimizations.</p>
- </li>
- <li>
- <p><a href="https://s.apache.org/beam-job-api">Job API</a>. Job submission and
-management protocol.</p>
- </li>
- <li>
- <p><a href="https://s.apache.org/beam-fn-api">Fn API</a>. Execution-side control
-and data protocols and overview.</p>
- </li>
- <li>
- <p><a href="https://s.apache.org/beam-fn-api-container-contract">Container
-contract</a>.
-Execution-side docker container invocation and provisioning
-protocols. See
-<a href="https://github.com/apache/beam/blob/master/sdks/CONTAINERS.md">CONTAINERS.md</a>
-for how to build container images.</p>
- </li>
-</ul>
+<p>If you are interested in digging in to the designs, you can find
+them on the <a href="https://cwiki.apache.org/confluence/display/BEAM/Apache+Beam">Beam developers’ wiki</a>.</p>
-<p>In discussion:</p>
-
-<ul>
- <li><a href="https://s.apache.org/beam-mixed-language-pipelines">Cross
-language</a>. Options
-and tradeoffs for how to handle various kinds of
-multi-language/multi-SDK pipelines.</li>
-</ul>
-
-<h2 id="development">Development</h2>
+<h2 id="milestones">Milestones</h2>
<p>The portability framework is a substantial effort that touches every
Beam component. In addition to the sheer magnitude, a major challenge
@@ -357,8 +292,6 @@ is engineering an interop layer that does not significantly compromise
performance due to the additional serialization overhead of a
language-neutral protocol.</p>
-<h3 id="roadmap">Roadmap</h3>
-
<p>The proposed project phases are roughly as follows and are not
strictly sequential, as various components will likely move at
different speeds. Additionally, there have been (and continues to be)
@@ -409,7 +342,7 @@ should work.</p>
</li>
</ul>
-<h3 id="issues">Issues</h3>
+<h2 id="issues">Issues</h2>
<p>The portability effort touches every component, so the “portability”
label is used to identify all portability-related issues. Pure
@@ -420,13 +353,13 @@ their respective components.</p>
<p><strong>JIRA:</strong> <a href="https://issues.apache.org/jira/issues/?filter=12341256">query</a></p>
-<h3 id="status">Status</h3>
+<h2 id="status">Status</h2>
<p>MVP in progress (near completion for Flink runner). See the
<a href="https://s.apache.org/apache-beam-portability-support-table">Portability support table</a>
for details.</p>
-<h4 id="running-python-wordcount-on-flink">Running Python wordcount on Flink</h4>
+<h3 id="python-on-flink">Running Python wordcount on Flink</h3>
<p>The Flink runner is currently the only runner to support portable pipeline execution.
To run a basic Python wordcount (in batch mode) with embedded Flink:</p>
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/roadmap/python-sdk/index.html
similarity index 83%
copy from website/generated-content/get-started/index.html
copy to website/generated-content/roadmap/python-sdk/index.html
index 7747fcf..eed5fb4 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/roadmap/python-sdk/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Use Beam</title>
+ <title>Python SDK Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/get-started/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/python-sdk/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/get-started/index.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/python-sdk.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,26 +145,32 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Get started</span></li>
-<li><a href="/get-started/beam-overview/">Beam Overview</a></li>
-<li>
- <span class="section-nav-list-title">Quickstarts</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li>
- <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li>
- <li><a href="/get-started/quickstart-go/">Quickstart - Go</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Example Walkthroughs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
+
<ul class="section-nav-list">
- <li><a href="/get-started/wordcount-example/">WordCount</a></li>
- <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li>
- </ul>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
+ </ul>
</li>
-<li><a href="/get-started/downloads">Downloads</a></li>
-
</ul>
</nav>
@@ -182,6 +191,9 @@
+<ul class="nav">
+ <li><a href="#python-3-support">Python 3 Support</a></li>
+</ul>
</nav>
@@ -201,33 +213,21 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="get-started-with-apache-beam">Get Started with Apache Beam</h1>
-<p>Learn to use Beam to create data processing pipelines that run on supported processing back-ends:</p>
+<h1 id="python-sdk-roadmap">Python SDK Roadmap</h1>
-<h4 id="beam-overview"><a href="/get-started/beam-overview">Beam Overview</a></h4>
+<h2 id="python-3-support">Python 3 Support</h2>
-<p>Learn about the Beam model, the currently available Beam SDKs and Runners, and Beam’s native I/O connectors.</p>
-
-<h4 id="quickstart-for-java-python-or-go">Quickstart for <a href="/get-started/quickstart-java">Java</a>, <a href="/get-started/quickstart-py">Python</a> or <a href="/get-started/quickstart-go">Go</a></h4>
-
-<p>Learn how to set up a Beam project and run a simple example Beam pipeline on your local machine.</p>
-
-<h4 id="example-walkthroughs">Example Walkthroughs</h4>
-
-<p>See detailed walkthroughs of complete Beam pipelines.</p>
+<p>Work is in progress to add Python 3 support to Beam. Current goal is to make Beam codebase compatible both with Python 2.7 and Python 3.4.</p>
<ul>
- <li><a href="/get-started/wordcount-example">WordCount</a>: Simple example pipelines that demonstrate basic Beam programming, including debugging and testing</li>
- <li><a href="/get-started/mobile-gaming-example">Mobile Gaming</a>: A series of more advanced pipelines that demonstrate use cases in the mobile gaming domain</li>
+ <li><a href="https://docs.google.com/document/d/1xDG0MWVlDKDPu_IW9gtMvxi2S9I0GB0VDTkPhjXT0nE">Proposal</a></li>
+ <li><a href="https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=245&view=detail">Kanban Board</a></li>
+ <li><a href="https://docs.google.com/document/d/1s1BJVCY65LB_SYK1SU1u7NbZiFANoq-nEYaEvzRbYlA">Python 3 Conversion Quick Start Guide</a></li>
</ul>
-<h4 id="downloads-and-releases"><a href="/get-started/downloads">Downloads and Releases</a></h4>
-
-<p>Find download links and information on the latest Beam releases, including versioning and release notes.</p>
-
-<h4 id="support"><a href="/get-started/support">Support</a></h4>
+<p>Contributions are welcome! If you are interested to help, you can select an unassigned issue in the Kanban board and assign it to yourself. Comment on the issue if you cannot assign it yourself.
+When submitting a new PR, please tag <a href="https://github.com/robbesneyders">@RobbeSneyders</a>, <a href="https://github.com/aaltay">@aaltay</a>, and <a href="https://github.com/tvalentyn">@tvalentyn</a>.</p>
-<p>Find resources, such as mailing lists and issue tracking, to help you use Beam. Ask questions and discuss topics via <a href="http://stackoverflow.com/questions/tagged/apache-beam">Stack Overflow</a> or on Beam’s <a href="http://apachebeam.slack.com">Slack Channel</a>.</p>
</div>
</div>
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/roadmap/samza-runner/index.html
similarity index 83%
copy from website/generated-content/get-started/index.html
copy to website/generated-content/roadmap/samza-runner/index.html
index 7747fcf..4d81a1c 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/roadmap/samza-runner/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Use Beam</title>
+ <title>Samza Runner Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/get-started/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/samza-runner/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/get-started/index.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/samza-runner.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,26 +145,32 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Get started</span></li>
-<li><a href="/get-started/beam-overview/">Beam Overview</a></li>
-<li>
- <span class="section-nav-list-title">Quickstarts</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li>
- <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li>
- <li><a href="/get-started/quickstart-go/">Quickstart - Go</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Example Walkthroughs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
+
<ul class="section-nav-list">
- <li><a href="/get-started/wordcount-example/">WordCount</a></li>
- <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li>
- </ul>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
+ </ul>
</li>
-<li><a href="/get-started/downloads">Downloads</a></li>
-
</ul>
</nav>
@@ -201,34 +210,15 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="get-started-with-apache-beam">Get Started with Apache Beam</h1>
-<p>Learn to use Beam to create data processing pipelines that run on supported processing back-ends:</p>
-
-<h4 id="beam-overview"><a href="/get-started/beam-overview">Beam Overview</a></h4>
-
-<p>Learn about the Beam model, the currently available Beam SDKs and Runners, and Beam’s native I/O connectors.</p>
+<h1 id="samza-runner-roadmap">Samza Runner Roadmap</h1>
-<h4 id="quickstart-for-java-python-or-go">Quickstart for <a href="/get-started/quickstart-java">Java</a>, <a href="/get-started/quickstart-py">Python</a> or <a href="/get-started/quickstart-go">Go</a></h4>
-
-<p>Learn how to set up a Beam project and run a simple example Beam pipeline on your local machine.</p>
-
-<h4 id="example-walkthroughs">Example Walkthroughs</h4>
-
-<p>See detailed walkthroughs of complete Beam pipelines.</p>
+<p>This roadmap is in progress. In the meantime, here are available resources:</p>
<ul>
- <li><a href="/get-started/wordcount-example">WordCount</a>: Simple example pipelines that demonstrate basic Beam programming, including debugging and testing</li>
- <li><a href="/get-started/mobile-gaming-example">Mobile Gaming</a>: A series of more advanced pipelines that demonstrate use cases in the mobile gaming domain</li>
+ <li><a href="/documentation/runners/samza">Runner documentation</a></li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-samza">runner-samza</a></li>
</ul>
-<h4 id="downloads-and-releases"><a href="/get-started/downloads">Downloads and Releases</a></h4>
-
-<p>Find download links and information on the latest Beam releases, including versioning and release notes.</p>
-
-<h4 id="support"><a href="/get-started/support">Support</a></h4>
-
-<p>Find resources, such as mailing lists and issue tracking, to help you use Beam. Ask questions and discuss topics via <a href="http://stackoverflow.com/questions/tagged/apache-beam">Stack Overflow</a> or on Beam’s <a href="http://apachebeam.slack.com">Slack Channel</a>.</p>
-
</div>
</div>
<!--
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/roadmap/spark-runner/index.html
similarity index 83%
copy from website/generated-content/get-started/index.html
copy to website/generated-content/roadmap/spark-runner/index.html
index 7747fcf..02e4127 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/roadmap/spark-runner/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Use Beam</title>
+ <title>Spark Runner Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/get-started/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/spark-runner/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/get-started/index.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/spark-runner.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,26 +145,32 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Get started</span></li>
-<li><a href="/get-started/beam-overview/">Beam Overview</a></li>
-<li>
- <span class="section-nav-list-title">Quickstarts</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li>
- <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li>
- <li><a href="/get-started/quickstart-go/">Quickstart - Go</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Example Walkthroughs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
+
<ul class="section-nav-list">
- <li><a href="/get-started/wordcount-example/">WordCount</a></li>
- <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li>
- </ul>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
+ </ul>
</li>
-<li><a href="/get-started/downloads">Downloads</a></li>
-
</ul>
</nav>
@@ -201,34 +210,15 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="get-started-with-apache-beam">Get Started with Apache Beam</h1>
-<p>Learn to use Beam to create data processing pipelines that run on supported processing back-ends:</p>
-
-<h4 id="beam-overview"><a href="/get-started/beam-overview">Beam Overview</a></h4>
-
-<p>Learn about the Beam model, the currently available Beam SDKs and Runners, and Beam’s native I/O connectors.</p>
+<h1 id="apache-spark-runner-roadmap">Apache Spark Runner Roadmap</h1>
-<h4 id="quickstart-for-java-python-or-go">Quickstart for <a href="/get-started/quickstart-java">Java</a>, <a href="/get-started/quickstart-py">Python</a> or <a href="/get-started/quickstart-go">Go</a></h4>
-
-<p>Learn how to set up a Beam project and run a simple example Beam pipeline on your local machine.</p>
-
-<h4 id="example-walkthroughs">Example Walkthroughs</h4>
-
-<p>See detailed walkthroughs of complete Beam pipelines.</p>
+<p>This roadmap is in progress. In the meantime, here are available resources:</p>
<ul>
- <li><a href="/get-started/wordcount-example">WordCount</a>: Simple example pipelines that demonstrate basic Beam programming, including debugging and testing</li>
- <li><a href="/get-started/mobile-gaming-example">Mobile Gaming</a>: A series of more advanced pipelines that demonstrate use cases in the mobile gaming domain</li>
+ <li><a href="/documentation/runners/spark">Runner documentation</a></li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-spark">runner-spark</a></li>
</ul>
-<h4 id="downloads-and-releases"><a href="/get-started/downloads">Downloads and Releases</a></h4>
-
-<p>Find download links and information on the latest Beam releases, including versioning and release notes.</p>
-
-<h4 id="support"><a href="/get-started/support">Support</a></h4>
-
-<p>Find resources, such as mailing lists and issue tracking, to help you use Beam. Ask questions and discuss topics via <a href="http://stackoverflow.com/questions/tagged/apache-beam">Stack Overflow</a> or on Beam’s <a href="http://apachebeam.slack.com">Slack Channel</a>.</p>
-
</div>
</div>
<!--
diff --git a/website/generated-content/get-started/index.html b/website/generated-content/roadmap/sql/index.html
similarity index 83%
copy from website/generated-content/get-started/index.html
copy to website/generated-content/roadmap/sql/index.html
index 7747fcf..41bacdc 100644
--- a/website/generated-content/get-started/index.html
+++ b/website/generated-content/roadmap/sql/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Use Beam</title>
+ <title>Beam SQL Roadmap</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/get-started/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/roadmap/sql/" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -97,6 +97,9 @@
<a href="/documentation/runners/capability-matrix/">RUNNERS</a>
</li>
<li>
+ <a href="/roadmap/">Roadmap</a>
+ </li>
+ <li>
<a href="/contribute/">Contribute</a>
</li>
<li>
@@ -117,7 +120,7 @@
</ul>
</li>
<li>
- <a href="https://github.com/apache/beam/edit/master/website/src/get-started/index.md">
+ <a href="https://github.com/apache/beam/edit/master/website/src/roadmap/sql.md">
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -142,26 +145,32 @@
limitations under the License. See accompanying LICENSE file.
-->
-<li><span class="section-nav-list-main-title">Get started</span></li>
-<li><a href="/get-started/beam-overview/">Beam Overview</a></li>
-<li>
- <span class="section-nav-list-title">Quickstarts</span>
+<li><span class="section-nav-list-main-title">Roadmap</span></li>
+<li><a href="/roadmap/">Roadmap Highlights</a></li>
+<li><a href="/roadmap/portability">Portability Framework</a></li>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Languages</span>
<ul class="section-nav-list">
- <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li>
- <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li>
- <li><a href="/get-started/quickstart-go/">Quickstart - Go</a></li>
+ <li><a href="/roadmap/java-sdk">Java SDK</a></li>
+ <li><a href="/roadmap/go-sdk">Go SDK</a></li>
+ <li><a href="/roadmap/python-sdk">Python SDK</a></li>
+ <li><a href="/roadmap/euphoria">Euphoria API</a></li>
+ <li><a href="/roadmap/sql">SQL</a></li>
</ul>
</li>
-<li>
- <span class="section-nav-list-title">Example Walkthroughs</span>
+<li class="section-nav-item">
+ <span class="section-nav-list-title">Runners</span>
+
<ul class="section-nav-list">
- <li><a href="/get-started/wordcount-example/">WordCount</a></li>
- <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li>
- </ul>
+ <li><a href="/roadmap/apex-runner/">Apex Runner</a></li>
+ <li><a href="/roadmap/dataflow-runner/">Google Cloud Dataflow Runner</a></li>
+ <li><a href="/roadmap/flink-runner/">Flink Runner</a></li>
+ <li><a href="/roadmap/gearpump-runner/">Gearpump Runner</a></li>
+ <li><a href="/roadmap/spark-runner/">Spark Runner</a></li>
+ <li><a href="/roadmap/samza-runner/">Samza Runner</a></li>
+ </ul>
</li>
-<li><a href="/get-started/downloads">Downloads</a></li>
-
</ul>
</nav>
@@ -201,34 +210,15 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="get-started-with-apache-beam">Get Started with Apache Beam</h1>
-<p>Learn to use Beam to create data processing pipelines that run on supported processing back-ends:</p>
-
-<h4 id="beam-overview"><a href="/get-started/beam-overview">Beam Overview</a></h4>
-
-<p>Learn about the Beam model, the currently available Beam SDKs and Runners, and Beam’s native I/O connectors.</p>
+<h1 id="sql">SQL</h1>
-<h4 id="quickstart-for-java-python-or-go">Quickstart for <a href="/get-started/quickstart-java">Java</a>, <a href="/get-started/quickstart-py">Python</a> or <a href="/get-started/quickstart-go">Go</a></h4>
-
-<p>Learn how to set up a Beam project and run a simple example Beam pipeline on your local machine.</p>
-
-<h4 id="example-walkthroughs">Example Walkthroughs</h4>
-
-<p>See detailed walkthroughs of complete Beam pipelines.</p>
+<p>This roadmap is in progress. In the meantime, here are available resources:</p>
<ul>
- <li><a href="/get-started/wordcount-example">WordCount</a>: Simple example pipelines that demonstrate basic Beam programming, including debugging and testing</li>
- <li><a href="/get-started/mobile-gaming-example">Mobile Gaming</a>: A series of more advanced pipelines that demonstrate use cases in the mobile gaming domain</li>
+ <li><a href="/documentation/dsls/sql/overview">Beam SQL documentation</a></li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20dsl-sql">dsl-sql</a></li>
</ul>
-<h4 id="downloads-and-releases"><a href="/get-started/downloads">Downloads and Releases</a></h4>
-
-<p>Find download links and information on the latest Beam releases, including versioning and release notes.</p>
-
-<h4 id="support"><a href="/get-started/support">Support</a></h4>
-
-<p>Find resources, such as mailing lists and issue tracking, to help you use Beam. Ask questions and discuss topics via <a href="http://stackoverflow.com/questions/tagged/apache-beam">Stack Overflow</a> or on Beam’s <a href="http://apachebeam.slack.com">Slack Channel</a>.</p>
-
</div>
</div>
<!--