You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by me...@apache.org on 2018/07/16 21:45:45 UTC
[beam-site] branch asf-site updated (b25b152 -> e90fe69)
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git.
from b25b152 Fix typos in mobile gaming example
add 96bcd10 Updates SDF status in capability matrix
add 1d2fa5a This closes #496
new e90fe69 Prepare repository for deployment.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
content/contribute/release-guide/index.html | 1 -
content/documentation/programming-guide/index.html | 8 ++--
.../runners/capability-matrix/index.html | 52 +++++++++++-----------
.../get-started/mobile-gaming-example/index.html | 2 +-
src/_data/capability-matrix.yml | 32 ++++++-------
5 files changed, 47 insertions(+), 48 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
Posted by me...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git
commit e90fe6947fa8cf27051c82ef95b2b1aba40e7459
Author: Mergebot <me...@apache.org>
AuthorDate: Mon Jul 16 21:45:43 2018 +0000
Prepare repository for deployment.
---
content/contribute/release-guide/index.html | 1 -
content/documentation/programming-guide/index.html | 8 ++--
.../runners/capability-matrix/index.html | 52 +++++++++++-----------
.../get-started/mobile-gaming-example/index.html | 2 +-
4 files changed, 31 insertions(+), 32 deletions(-)
diff --git a/content/contribute/release-guide/index.html b/content/contribute/release-guide/index.html
index 2ea2749..198d55a 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -682,7 +682,6 @@ git commit -m "Moving to ${NEXT_VERSION_IN_BASE_BRANCH}-SNAPSHOT on master branc
<p>Update Java runner specific configurations in release branch:</p>
<ul>
<li><a href="https://github.com/apache/beam/blob/master/runners/google-cloud-dataflow-java/build.gradle">beam/runners/google-cloud-dataflow-java/build.gradle</a>: change value of ‘dataflow.container_version’ to ‘beam-release_version_number’(e.g, ‘beam-master-20180601’ to ‘beam-2.5.0’)</li>
- <li><a href="https://github.com/apache/beam/blob/master/runners/google-cloud-dataflow-java/pom.xml">beam/runners/google-cloud-dataflow-java/pom.xml</a>: change value of ‘version’ field (e.g, ‘2.5.0-SNAPSHOT’ to ‘2.5.0’)</li>
</ul>
<h3 id="start-a-snapshot-build">Start a snapshot build</h3>
diff --git a/content/documentation/programming-guide/index.html b/content/documentation/programming-guide/index.html
index ac21bf4..466338e 100644
--- a/content/documentation/programming-guide/index.html
+++ b/content/documentation/programming-guide/index.html
@@ -392,14 +392,14 @@ read or write data to various external storage systems.</p>
<p>A typical Beam driver program works as follows:</p>
<ul>
- <li>Create a <code class="highlighter-rouge">Pipeline</code> object and set the pipeline execution options, including
+ <li><strong>Create</strong> a <code class="highlighter-rouge">Pipeline</code> object and set the pipeline execution options, including
the Pipeline Runner.</li>
<li>Create an initial <code class="highlighter-rouge">PCollection</code> for pipeline data, either using the IOs
to read data from an external storage system, or using a <code class="highlighter-rouge">Create</code> transform to
build a <code class="highlighter-rouge">PCollection</code> from in-memory data.</li>
- <li>Apply <strong>PTransforms</strong> to each <code class="highlighter-rouge">PCollection</code>. Transforms can change, filter,
+ <li><strong>Apply</strong> <code class="highlighter-rouge">PTransforms</code> to each <code class="highlighter-rouge">PCollection</code>. Transforms can change, filter,
group, analyze, or otherwise process the elements in a <code class="highlighter-rouge">PCollection</code>. A
-transform creates a new output <code class="highlighter-rouge">PCollection</code> <em>without consuming the input
+transform creates a new output <code class="highlighter-rouge">PCollection</code> <em>without modifying the input
collection</em>. A typical pipeline applies subsequent transforms to the each new
output <code class="highlighter-rouge">PCollection</code> in turn until processing is complete. However, note that
a pipeline does not have to be a single straight line of transforms applied
@@ -1554,7 +1554,7 @@ of integers.</p>
behavior is to return a <code class="highlighter-rouge">PCollection</code> containing one item. That item’s value
comes from the accumulator in the combine function that you specified when
applying <code class="highlighter-rouge">Combine</code>. For example, the Beam provided sum combine function returns
-a zero value (the sum of an empty input), while the max combine function returns
+a zero value (the sum of an empty input), while the min combine function returns
a maximal or infinite value.</p>
<p>To have <code class="highlighter-rouge">Combine</code> instead return an empty <code class="highlighter-rouge">PCollection</code> if the input is empty,
diff --git a/content/documentation/runners/capability-matrix/index.html b/content/documentation/runners/capability-matrix/index.html
index 7509698..b6e32f5 100644
--- a/content/documentation/runners/capability-matrix/index.html
+++ b/content/documentation/runners/capability-matrix/index.html
@@ -1570,7 +1570,7 @@ limitations under the License.
</tr>
<tr class="cap-summary">
- <th class="cap-summary color-capability format-capability" style="color:#ec3">Splittable DoFn</th>
+ <th class="cap-summary color-capability format-capability" style="color:#ec3">Splittable DoFn (SDF)</th>
@@ -1592,7 +1592,7 @@ limitations under the License.
- <td width="25%" class="cap-summary" style="background-color:#fe5;border-color:#ca1"><!--
+ <td width="25%" class="cap-summary" style="background-color:#ec3;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -1605,12 +1605,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>~</b></center>
+<center><b>✓</b></center>
</td>
- <td width="25%" class="cap-summary" style="background-color:#ddd;border-color:#ca1"><!--
+ <td width="25%" class="cap-summary" style="background-color:#ec3;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -1623,12 +1623,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>✕</b></center>
+<center><b>✓</b></center>
</td>
- <td width="25%" class="cap-summary" style="background-color:#ddd;border-color:#ca1"><!--
+ <td width="25%" class="cap-summary" style="background-color:#fe5;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -1641,12 +1641,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>✕</b></center>
+<center><b>~</b></center>
</td>
- <td width="25%" class="cap-summary" style="background-color:#ddd;border-color:#ca1"><!--
+ <td width="25%" class="cap-summary" style="background-color:#fe5;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -1659,12 +1659,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>✕</b></center>
+<center><b>~</b></center>
</td>
- <td width="25%" class="cap-summary" style="background-color:#ddd;border-color:#ca1"><!--
+ <td width="25%" class="cap-summary" style="background-color:#fe5;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -1677,7 +1677,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>✕</b></center>
+<center><b>~</b></center>
</td>
@@ -1736,7 +1736,7 @@ limitations under the License.
- <td width="25%" class="cap-summary" style="background-color:#ddd;border-color:#ca1"><!--
+ <td width="25%" class="cap-summary" style="background-color:#fe5;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -1749,7 +1749,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>✕</b></center>
+<center><b>~</b></center>
</td>
</tr>
@@ -6905,7 +6905,7 @@ limitations under the License.
</tr>
<tr class="cap">
- <th class="cap color-capability format-capability" style="color:#ec3">Splittable DoFn</th>
+ <th class="cap color-capability format-capability" style="color:#ec3">Splittable DoFn (SDF)</th>
@@ -6927,7 +6927,7 @@ limitations under the License.
- <td width="25%" class="cap" style="background-color:#fe5;border-color:#ca1"><!--
+ <td width="25%" class="cap" style="background-color:#ec3;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -6940,12 +6940,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>Partially: supported in streaming mode</b></center><br />Supports checkpointing (sequentially processing an element over several, potentially infinitely many calls). Does not yet support autotuning features of the Source API.
+<center><b>Yes: </b></center><br />Does not yet support autotuning features of the Source API.
</td>
- <td width="25%" class="cap" style="background-color:#ddd;border-color:#ca1"><!--
+ <td width="25%" class="cap" style="background-color:#ec3;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -6958,12 +6958,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>No: implementation in streaming mode coming soon</b></center><br />
+<center><b>Yes: </b></center><br />
</td>
- <td width="25%" class="cap" style="background-color:#ddd;border-color:#ca1"><!--
+ <td width="25%" class="cap" style="background-color:#fe5;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -6976,12 +6976,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>No: not implemented</b></center><br />
+<center><b>Partially: supports bounded-per-element SDFs</b></center><br />
</td>
- <td width="25%" class="cap" style="background-color:#ddd;border-color:#ca1"><!--
+ <td width="25%" class="cap" style="background-color:#fe5;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -6994,12 +6994,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>No: implementation in streaming mode coming soon</b></center><br />
+<center><b>Partially: supports bounded-per-element SDFs</b></center><br />implementation in streaming mode coming soon
</td>
- <td width="25%" class="cap" style="background-color:#ddd;border-color:#ca1"><!--
+ <td width="25%" class="cap" style="background-color:#fe5;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -7012,7 +7012,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>No: not implemented</b></center><br />
+<center><b>Partially: supports bounded-per-element SDFs</b></center><br />
</td>
@@ -7071,7 +7071,7 @@ limitations under the License.
- <td width="25%" class="cap" style="background-color:#ddd;border-color:#ca1"><!--
+ <td width="25%" class="cap" style="background-color:#fe5;border-color:#ca1"><!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -7084,7 +7084,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>No: not implemented</b></center><br />
+<center><b>Partially: supports bounded-per-element SDFs</b></center><br />
</td>
</tr>
diff --git a/content/get-started/mobile-gaming-example/index.html b/content/get-started/mobile-gaming-example/index.html
index 192b8a0..177cfe9 100644
--- a/content/get-started/mobile-gaming-example/index.html
+++ b/content/get-started/mobile-gaming-example/index.html
@@ -967,7 +967,7 @@ late results.</em></p>
<p>Let’s suppose scoring in our game depends on the speed at which a user can “click” on their phone. <code class="highlighter-rouge">GameStats</code>’s abuse detection analyzes each user’s score data to detect if a user has an abnormally high “click rate” and thus an abnormally high score. This might indicate that the game is being played by a bot that operates significantly faster than a human could play.</p>
-<p>To determine whether or not a score is “abnormally” high, <code class="highlighter-rouge">GameStats</code> calculates the average of every score in that fixed-time window, and then checks each score individual score against the average score multiplied by an arbitrary weight factor (in our case, 2.5). Thus, any score more than 2.5 times the average is deemed to be the product of spam. The <code class="highlighter-rouge">GameStats</code> pipeline tracks a list of “spam” users and filte [...]
+<p>To determine whether or not a score is “abnormally” high, <code class="highlighter-rouge">GameStats</code> calculates the average of every score in that fixed-time window, and then checks each individual score against the average score multiplied by an arbitrary weight factor (in our case, 2.5). Thus, any score more than 2.5 times the average is deemed to be the product of spam. The <code class="highlighter-rouge">GameStats</code> pipeline tracks a list of “spam” users and filters tho [...]
<p>Since the average depends on the pipeline data, we need to calculate it, and then use that calculated data in a subsequent <code class="highlighter-rouge">ParDo</code> transform that filters scores that exceed the weighted value. To do this, we can pass the calculated average to as a <a href="/documentation/programming-guide/#side-inputs">side input</a> to the filtering <code class="highlighter-rouge">ParDo</code>.</p>