You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ke...@apache.org on 2017/02/15 18:09:34 UTC
[1/3] beam-site git commit: Fix some typos and small formatting
issues.
Repository: beam-site
Updated Branches:
refs/heads/asf-site f3c189568 -> f48e97f67
Fix some typos and small formatting issues.
Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/8518baa7
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/8518baa7
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/8518baa7
Branch: refs/heads/asf-site
Commit: 8518baa70e1ec0dc609dbd36889e246752bc995e
Parents: f3c1895
Author: Isma�l Mej�a <ie...@gmail.com>
Authored: Wed Feb 15 17:45:25 2017 +0100
Committer: Isma�l Mej�a <ie...@gmail.com>
Committed: Wed Feb 15 17:45:25 2017 +0100
----------------------------------------------------------------------
src/_posts/2017-02-13-stateful-processing.md | 14 +++++++++-----
1 file changed, 9 insertions(+), 5 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/beam-site/blob/8518baa7/src/_posts/2017-02-13-stateful-processing.md
----------------------------------------------------------------------
diff --git a/src/_posts/2017-02-13-stateful-processing.md b/src/_posts/2017-02-13-stateful-processing.md
index b00361a..b3e0c63 100644
--- a/src/_posts/2017-02-13-stateful-processing.md
+++ b/src/_posts/2017-02-13-stateful-processing.md
@@ -196,7 +196,7 @@ want to write a transform that maps input to output like this:
<img class="center-block"
src="{{ site.baseurl }}/images/blog/stateful-processing/assign-indices.png"
alt="Assigning arbitrary but unique indices to each element"
- width="100">
+ width="180">
The order of the elements A, B, C, D, E is arbitrary, hence their assigned
indices are arbitrary, but downstream transforms just need to be OK with this.
@@ -238,9 +238,13 @@ key+window pairs, like this:
keys and windows are independent dimensions)
You can provide the opportunity for parallelism by making sure that table has
-enough columns, either via many keys in few windows - for example, a globally
-windowed stateful computation keyed by user ID - or via many windows over few
-keys - for example, a fixed windowed stateful computation over a global key.
+enough columns, either via:
+
+- Many keys in few windows for example, a globally windowed stateful computation
+ keyed by user ID.
+- Many windows over few keys for example, a fixed windowed stateful computation
+ over a global key.
+
Caveat: all Beam runners today parallelize only over the key.
Most often your mental model of state can be focused on only a single column of
@@ -444,7 +448,7 @@ outputs from the `ParDo` that will be processed downstream. If the
output, then you cannot use a `Filter` transform to reduce data volume downstream.
Stateful processing lets you address both the latency problem of side inputs
-and the cost problem of excessive uninterseting output. Here is the code, using
+and the cost problem of excessive uninteresting output. Here is the code, using
only features I have already introduced:
```java
[2/3] beam-site git commit: Touch up some punctuation in state blog
post
Posted by ke...@apache.org.
Touch up some punctuation in state blog post
Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/f928b50e
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/f928b50e
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/f928b50e
Branch: refs/heads/asf-site
Commit: f928b50e1594cba453f07aa608ab28afb6329aff
Parents: 8518baa
Author: Kenneth Knowles <kl...@google.com>
Authored: Wed Feb 15 10:08:31 2017 -0800
Committer: Kenneth Knowles <kl...@google.com>
Committed: Wed Feb 15 10:08:31 2017 -0800
----------------------------------------------------------------------
src/_posts/2017-02-13-stateful-processing.md | 7 ++++---
1 file changed, 4 insertions(+), 3 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/beam-site/blob/f928b50e/src/_posts/2017-02-13-stateful-processing.md
----------------------------------------------------------------------
diff --git a/src/_posts/2017-02-13-stateful-processing.md b/src/_posts/2017-02-13-stateful-processing.md
index b3e0c63..fbbe76b 100644
--- a/src/_posts/2017-02-13-stateful-processing.md
+++ b/src/_posts/2017-02-13-stateful-processing.md
@@ -238,11 +238,12 @@ key+window pairs, like this:
keys and windows are independent dimensions)
You can provide the opportunity for parallelism by making sure that table has
-enough columns, either via:
+enough columns. You might have many keys and many windows, or you might have
+many of just one or the other:
-- Many keys in few windows for example, a globally windowed stateful computation
+- Many keys in few windows, for example a globally windowed stateful computation
keyed by user ID.
-- Many windows over few keys for example, a fixed windowed stateful computation
+- Many windows over few keys, for example a fixed windowed stateful computation
over a global key.
Caveat: all Beam runners today parallelize only over the key.
[3/3] beam-site git commit: This closes #156: Fix some typos and
small formatting issuesin the last stateful processing blog post
Posted by ke...@apache.org.
This closes #156: Fix some typos and small formatting issuesin the last stateful processing blog post
Touch up some punctuation in state blog post
Fix some typos and small formatting issues.
Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/f48e97f6
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/f48e97f6
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/f48e97f6
Branch: refs/heads/asf-site
Commit: f48e97f6753f3cb00573a3e8a0f2768e67d6366c
Parents: f3c1895 f928b50
Author: Kenneth Knowles <kl...@google.com>
Authored: Wed Feb 15 10:08:58 2017 -0800
Committer: Kenneth Knowles <kl...@google.com>
Committed: Wed Feb 15 10:08:58 2017 -0800
----------------------------------------------------------------------
src/_posts/2017-02-13-stateful-processing.md | 15 ++++++++++-----
1 file changed, 10 insertions(+), 5 deletions(-)
----------------------------------------------------------------------