You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by da...@apache.org on 2017/04/18 23:12:42 UTC
[1/3] beam-site git commit: Update overview page.
Repository: beam-site
Updated Branches:
refs/heads/asf-site ddbe5b27a -> 1b73ee9b3
Update overview page.
Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/4ef79d10
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/4ef79d10
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/4ef79d10
Branch: refs/heads/asf-site
Commit: 4ef79d10ce6cf63d49e759f0f567a2c4e49160a9
Parents: ddbe5b2
Author: Hadar Hod <ha...@google.com>
Authored: Tue Apr 18 12:01:45 2017 -0700
Committer: Davor Bonaci <da...@google.com>
Committed: Tue Apr 18 16:11:59 2017 -0700
----------------------------------------------------------------------
src/get-started/beam-overview.md | 64 ++++++++++-------------------
src/images/logos/runners/apex.png | Bin 0 -> 3717 bytes
src/images/logos/runners/dataflow.png | Bin 0 -> 8277 bytes
src/images/logos/runners/flink.png | Bin 0 -> 4584 bytes
src/images/logos/runners/spark.png | Bin 0 -> 2701 bytes
src/images/logos/sdks/java.png | Bin 0 -> 3726 bytes
src/images/logos/sdks/python.png | Bin 0 -> 3735 bytes
7 files changed, 21 insertions(+), 43 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/beam-site/blob/4ef79d10/src/get-started/beam-overview.md
----------------------------------------------------------------------
diff --git a/src/get-started/beam-overview.md b/src/get-started/beam-overview.md
index 152a08d..0ef5152 100644
--- a/src/get-started/beam-overview.md
+++ b/src/get-started/beam-overview.md
@@ -9,7 +9,7 @@ redirect_from:
# Apache Beam Overview
-Apache Beam is an open source, unified programming model that you can use to create a data processing **pipeline**. You start by building a program that defines the pipeline using one of the open source Beam SDKs. The pipeline is then executed by one of Beam's supported **distributed processing back-ends**, which include [Apache Apex](http://apex.apache.org), [Apache Flink](http://flink.apache.org), [Apache Spark](http://spark.apache.org), and [Google Cloud Dataflow](https://cloud.google.com/dataflow).
+Apache Beam is an open source, unified model for defining both batch and streaming data-parallel processing pipelines. Using one of the open source Beam SDKs, you build a program that defines the pipeline. The pipeline is then executed by one of Beam's supported **distributed processing back-ends**, which include [Apache Apex](http://apex.apache.org), [Apache Flink](http://flink.apache.org), [Apache Spark](http://spark.apache.org), and [Google Cloud Dataflow](https://cloud.google.com/dataflow).
Beam is particularly useful for [Embarrassingly Parallel](http://en.wikipedia.org/wiki/Embarassingly_parallel) data processing tasks, in which the problem can be decomposed into many smaller bundles of data that can be processed independently and in parallel. You can also use Beam for Extract, Transform, and Load (ETL) tasks and pure data integration. These tasks are useful for moving data between different storage media and data sources, transforming data into a more desirable format, or loading data onto a new system.
@@ -19,24 +19,10 @@ The Beam SDKs provide a unified programming model that can represent and transfo
Beam currently supports the following language-specific SDKs:
-<table class="table table-condensed">
-<tr>
- <th>Language</th>
- <th>SDK Status</th>
-</tr>
-<tr>
- <td>Java</td>
- <td>Active Development</td>
-</tr>
-<tr>
- <td>Python</td>
- <td>Active Development</td>
-</tr>
-<tr>
- <td>Other</td>
- <td>TBD</td>
-</tr>
-</table>
+* Java <img src="{{ site.baseurl }}/images/logos/sdks/java.png"
+ alt="Java SDK">
+* Python <img src="{{ site.baseurl }}/images/logos/sdks/python.png"
+ alt="Python SDK ">
## Apache Beam Pipeline Runners
@@ -44,35 +30,27 @@ The Beam Pipeline Runners translate the data processing pipeline you define with
Beam currently supports Runners that work with the following distributed processing back-ends:
-<table class="table table-condensed">
-<tr>
- <th>Runner</th>
- <th>Status</th>
-</tr>
-<tr>
- <td>Apache Apex</td>
- <td>Active Development</td>
-</tr>
-<tr>
- <td>Apache Flink</td>
- <td>Active Development</td>
-</tr>
-<tr>
- <td>Apache Spark</td>
- <td>Active Development</td>
-</tr>
-<tr>
- <td>Google Cloud Dataflow</td>
- <td>Active Development</td>
-</tr>
-</table>
+* Apache Apex <img src="{{ site.baseurl }}/images/logos/runners/apex.png"
+ alt="Apache Apex">
+* Apache Flink <img src="{{ site.baseurl }}/images/logos/runners/flink.png"
+ alt="Apache Flink">
+* Apache Spark <img src="{{ site.baseurl }}/images/logos/runners/spark.png"
+ alt="Apache Spark">
+* Google Cloud Dataflow <img src="{{ site.baseurl }}/images/logos/runners/dataflow.png"
+ alt="Google Cloud Dataflow">
**Note:** You can always execute your pipeline locally for testing and debugging purposes.
-## Getting Started with Apache Beam
+## Get Started
-Get started using Beam for your data processing tasks.
+Get started using Beam for your data processing tasks.
1. Follow the Quickstart for the [Java SDK]({{ site.baseurl }}/get-started/quickstart-java) or the [Python SDK]({{ site.baseurl }}/get-started/quickstart-py).
2. See the [WordCount Examples Walkthrough]({{ site.baseurl }}/get-started/wordcount-example) for examples that introduce various features of the SDKs.
+
+3. Dive into the [Documentation]({{ site.baseurl }}/documentation/) section for in-depth concepts and reference materials for the Beam model, SDKs, and runners.
+
+## Contribute
+
+Beam is an [Apache Software Foundation](http://www.apache.org) project, available under the Apache v2 license. Beam is an open source community and contributions are greatly appreciated! If you'd like to contribute, please see the [Contribute]({{ site.baseurl }}/contribute/) section.
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/beam-site/blob/4ef79d10/src/images/logos/runners/apex.png
----------------------------------------------------------------------
diff --git a/src/images/logos/runners/apex.png b/src/images/logos/runners/apex.png
new file mode 100644
index 0000000..9cc0367
Binary files /dev/null and b/src/images/logos/runners/apex.png differ
http://git-wip-us.apache.org/repos/asf/beam-site/blob/4ef79d10/src/images/logos/runners/dataflow.png
----------------------------------------------------------------------
diff --git a/src/images/logos/runners/dataflow.png b/src/images/logos/runners/dataflow.png
new file mode 100644
index 0000000..4fda1b9
Binary files /dev/null and b/src/images/logos/runners/dataflow.png differ
http://git-wip-us.apache.org/repos/asf/beam-site/blob/4ef79d10/src/images/logos/runners/flink.png
----------------------------------------------------------------------
diff --git a/src/images/logos/runners/flink.png b/src/images/logos/runners/flink.png
new file mode 100644
index 0000000..e847bfa
Binary files /dev/null and b/src/images/logos/runners/flink.png differ
http://git-wip-us.apache.org/repos/asf/beam-site/blob/4ef79d10/src/images/logos/runners/spark.png
----------------------------------------------------------------------
diff --git a/src/images/logos/runners/spark.png b/src/images/logos/runners/spark.png
new file mode 100644
index 0000000..113c316
Binary files /dev/null and b/src/images/logos/runners/spark.png differ
http://git-wip-us.apache.org/repos/asf/beam-site/blob/4ef79d10/src/images/logos/sdks/java.png
----------------------------------------------------------------------
diff --git a/src/images/logos/sdks/java.png b/src/images/logos/sdks/java.png
new file mode 100644
index 0000000..31324bd
Binary files /dev/null and b/src/images/logos/sdks/java.png differ
http://git-wip-us.apache.org/repos/asf/beam-site/blob/4ef79d10/src/images/logos/sdks/python.png
----------------------------------------------------------------------
diff --git a/src/images/logos/sdks/python.png b/src/images/logos/sdks/python.png
new file mode 100644
index 0000000..65d2c36
Binary files /dev/null and b/src/images/logos/sdks/python.png differ
[2/3] beam-site git commit: Regenerate website
Posted by da...@apache.org.
Regenerate website
Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/dba78bbc
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/dba78bbc
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/dba78bbc
Branch: refs/heads/asf-site
Commit: dba78bbcf138f1ac635115edc028c93487a27e14
Parents: 4ef79d1
Author: Davor Bonaci <da...@google.com>
Authored: Tue Apr 18 16:12:29 2017 -0700
Committer: Davor Bonaci <da...@google.com>
Committed: Tue Apr 18 16:12:29 2017 -0700
----------------------------------------------------------------------
content/get-started/beam-overview/index.html | 61 +++++++---------------
content/images/logos/runners/apex.png | Bin 0 -> 3717 bytes
content/images/logos/runners/dataflow.png | Bin 0 -> 8277 bytes
content/images/logos/runners/flink.png | Bin 0 -> 4584 bytes
content/images/logos/runners/spark.png | Bin 0 -> 2701 bytes
content/images/logos/sdks/java.png | Bin 0 -> 3726 bytes
content/images/logos/sdks/python.png | Bin 0 -> 3735 bytes
7 files changed, 19 insertions(+), 42 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/beam-site/blob/dba78bbc/content/get-started/beam-overview/index.html
----------------------------------------------------------------------
diff --git a/content/get-started/beam-overview/index.html b/content/get-started/beam-overview/index.html
index caac276..c284b15 100644
--- a/content/get-started/beam-overview/index.html
+++ b/content/get-started/beam-overview/index.html
@@ -153,7 +153,7 @@
<div class="row">
<h1 id="apache-beam-overview">Apache Beam Overview</h1>
-<p>Apache Beam is an open source, unified programming model that you can use to create a data processing <strong>pipeline</strong>. You start by building a program that defines the pipeline using one of the open source Beam SDKs. The pipeline is then executed by one of Beam\u2019s supported <strong>distributed processing back-ends</strong>, which include <a href="http://apex.apache.org">Apache Apex</a>, <a href="http://flink.apache.org">Apache Flink</a>, <a href="http://spark.apache.org">Apache Spark</a>, and <a href="https://cloud.google.com/dataflow">Google Cloud Dataflow</a>.</p>
+<p>Apache Beam is an open source, unified model for defining both batch and streaming data-parallel processing pipelines. Using one of the open source Beam SDKs, you build a program that defines the pipeline. The pipeline is then executed by one of Beam\u2019s supported <strong>distributed processing back-ends</strong>, which include <a href="http://apex.apache.org">Apache Apex</a>, <a href="http://flink.apache.org">Apache Flink</a>, <a href="http://spark.apache.org">Apache Spark</a>, and <a href="https://cloud.google.com/dataflow">Google Cloud Dataflow</a>.</p>
<p>Beam is particularly useful for <a href="http://en.wikipedia.org/wiki/Embarassingly_parallel">Embarrassingly Parallel</a> data processing tasks, in which the problem can be decomposed into many smaller bundles of data that can be processed independently and in parallel. You can also use Beam for Extract, Transform, and Load (ETL) tasks and pure data integration. These tasks are useful for moving data between different storage media and data sources, transforming data into a more desirable format, or loading data onto a new system.</p>
@@ -163,24 +163,10 @@
<p>Beam currently supports the following language-specific SDKs:</p>
-<table class="table table-condensed">
-<tr>
- <th>Language</th>
- <th>SDK Status</th>
-</tr>
-<tr>
- <td>Java</td>
- <td>Active Development</td>
-</tr>
-<tr>
- <td>Python</td>
- <td>Active Development</td>
-</tr>
-<tr>
- <td>Other</td>
- <td>TBD</td>
-</tr>
-</table>
+<ul>
+ <li>Java <img src="/images/logos/sdks/java.png" alt="Java SDK" /></li>
+ <li>Python <img src="/images/logos/sdks/python.png" alt="Python SDK " /></li>
+</ul>
<h2 id="apache-beam-pipeline-runners">Apache Beam Pipeline Runners</h2>
@@ -188,32 +174,16 @@
<p>Beam currently supports Runners that work with the following distributed processing back-ends:</p>
-<table class="table table-condensed">
-<tr>
- <th>Runner</th>
- <th>Status</th>
-</tr>
-<tr>
- <td>Apache Apex</td>
- <td>Active Development</td>
-</tr>
-<tr>
- <td>Apache Flink</td>
- <td>Active Development</td>
-</tr>
-<tr>
- <td>Apache Spark</td>
- <td>Active Development</td>
-</tr>
-<tr>
- <td>Google Cloud Dataflow</td>
- <td>Active Development</td>
-</tr>
-</table>
+<ul>
+ <li>Apache Apex <img src="/images/logos/runners/apex.png" alt="Apache Apex" /></li>
+ <li>Apache Flink <img src="/images/logos/runners/flink.png" alt="Apache Flink" /></li>
+ <li>Apache Spark <img src="/images/logos/runners/spark.png" alt="Apache Spark" /></li>
+ <li>Google Cloud Dataflow <img src="/images/logos/runners/dataflow.png" alt="Google Cloud Dataflow" /></li>
+</ul>
<p><strong>Note:</strong> You can always execute your pipeline locally for testing and debugging purposes.</p>
-<h2 id="getting-started-with-apache-beam">Getting Started with Apache Beam</h2>
+<h2 id="get-started">Get Started</h2>
<p>Get started using Beam for your data processing tasks.</p>
@@ -224,8 +194,15 @@
<li>
<p>See the <a href="/get-started/wordcount-example">WordCount Examples Walkthrough</a> for examples that introduce various features of the SDKs.</p>
</li>
+ <li>
+ <p>Dive into the <a href="/documentation/">Documentation</a> section for in-depth concepts and reference materials for the Beam model, SDKs, and runners.</p>
+ </li>
</ol>
+<h2 id="contribute">Contribute</h2>
+
+<p>Beam is an <a href="http://www.apache.org">Apache Software Foundation</a> project, available under the Apache v2 license. Beam is an open source community and contributions are greatly appreciated! If you\u2019d like to contribute, please see the <a href="/contribute/">Contribute</a> section.</p>
+
</div>
http://git-wip-us.apache.org/repos/asf/beam-site/blob/dba78bbc/content/images/logos/runners/apex.png
----------------------------------------------------------------------
diff --git a/content/images/logos/runners/apex.png b/content/images/logos/runners/apex.png
new file mode 100644
index 0000000..9cc0367
Binary files /dev/null and b/content/images/logos/runners/apex.png differ
http://git-wip-us.apache.org/repos/asf/beam-site/blob/dba78bbc/content/images/logos/runners/dataflow.png
----------------------------------------------------------------------
diff --git a/content/images/logos/runners/dataflow.png b/content/images/logos/runners/dataflow.png
new file mode 100644
index 0000000..4fda1b9
Binary files /dev/null and b/content/images/logos/runners/dataflow.png differ
http://git-wip-us.apache.org/repos/asf/beam-site/blob/dba78bbc/content/images/logos/runners/flink.png
----------------------------------------------------------------------
diff --git a/content/images/logos/runners/flink.png b/content/images/logos/runners/flink.png
new file mode 100644
index 0000000..e847bfa
Binary files /dev/null and b/content/images/logos/runners/flink.png differ
http://git-wip-us.apache.org/repos/asf/beam-site/blob/dba78bbc/content/images/logos/runners/spark.png
----------------------------------------------------------------------
diff --git a/content/images/logos/runners/spark.png b/content/images/logos/runners/spark.png
new file mode 100644
index 0000000..113c316
Binary files /dev/null and b/content/images/logos/runners/spark.png differ
http://git-wip-us.apache.org/repos/asf/beam-site/blob/dba78bbc/content/images/logos/sdks/java.png
----------------------------------------------------------------------
diff --git a/content/images/logos/sdks/java.png b/content/images/logos/sdks/java.png
new file mode 100644
index 0000000..31324bd
Binary files /dev/null and b/content/images/logos/sdks/java.png differ
http://git-wip-us.apache.org/repos/asf/beam-site/blob/dba78bbc/content/images/logos/sdks/python.png
----------------------------------------------------------------------
diff --git a/content/images/logos/sdks/python.png b/content/images/logos/sdks/python.png
new file mode 100644
index 0000000..65d2c36
Binary files /dev/null and b/content/images/logos/sdks/python.png differ
[3/3] beam-site git commit: This closes #215
Posted by da...@apache.org.
This closes #215
Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/1b73ee9b
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/1b73ee9b
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/1b73ee9b
Branch: refs/heads/asf-site
Commit: 1b73ee9b3123a7410c1483d3e5a4208736c97e51
Parents: ddbe5b2 dba78bb
Author: Davor Bonaci <da...@google.com>
Authored: Tue Apr 18 16:12:29 2017 -0700
Committer: Davor Bonaci <da...@google.com>
Committed: Tue Apr 18 16:12:29 2017 -0700
----------------------------------------------------------------------
content/get-started/beam-overview/index.html | 61 +++++++--------------
content/images/logos/runners/apex.png | Bin 0 -> 3717 bytes
content/images/logos/runners/dataflow.png | Bin 0 -> 8277 bytes
content/images/logos/runners/flink.png | Bin 0 -> 4584 bytes
content/images/logos/runners/spark.png | Bin 0 -> 2701 bytes
content/images/logos/sdks/java.png | Bin 0 -> 3726 bytes
content/images/logos/sdks/python.png | Bin 0 -> 3735 bytes
src/get-started/beam-overview.md | 64 +++++++---------------
src/images/logos/runners/apex.png | Bin 0 -> 3717 bytes
src/images/logos/runners/dataflow.png | Bin 0 -> 8277 bytes
src/images/logos/runners/flink.png | Bin 0 -> 4584 bytes
src/images/logos/runners/spark.png | Bin 0 -> 2701 bytes
src/images/logos/sdks/java.png | Bin 0 -> 3726 bytes
src/images/logos/sdks/python.png | Bin 0 -> 3735 bytes
14 files changed, 40 insertions(+), 85 deletions(-)
----------------------------------------------------------------------