You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/04/26 04:15:36 UTC
[beam] branch asf-site updated: Publishing website 2022/04/26 04:15:28 at commit 07f30d2
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 05cc41f822f Publishing website 2022/04/26 04:15:28 at commit 07f30d2
05cc41f822f is described below
commit 05cc41f822f2bddf2fea854662f71db6dd81fd96
Author: jenkins <bu...@apache.org>
AuthorDate: Tue Apr 26 04:15:29 2022 +0000
Publishing website 2022/04/26 04:15:28 at commit 07f30d2
---
website/generated-content/documentation/index.xml | 14 ++++++++++++++
.../documentation/programming-guide/index.html | 10 ++++++++--
website/generated-content/sitemap.xml | 2 +-
3 files changed, 23 insertions(+), 3 deletions(-)
diff --git a/website/generated-content/documentation/index.xml b/website/generated-content/documentation/index.xml
index 0645ef3c073..336a66df3f5 100644
--- a/website/generated-content/documentation/index.xml
+++ b/website/generated-content/documentation/index.xml
@@ -5350,6 +5350,20 @@ tree, [2]
...
</code></pre><p>Thus, <code>GroupByKey</code> represents a transform from a multimap (multiple keys to
individual values) to a uni-map (unique keys to collections of values).</p>
+<p><span class="language-java">Using <code>GroupByKey</code> is straightforward:</span></p>
+<div class='language-java snippet'>
+<div class="notebook-skip code-snippet">
+<a class="copy" type="button" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Copy to clipboard">
+<img src="/images/copy-icon.svg"/>
+</a>
+<div class="highlight"><pre class="chroma"><code class="language-java" data-lang="java"><span class="c1">// The input PCollection.
+</span><span class="c1"></span> <span class="n">PCollection</span><span class="o">&lt;</span><span class="n">KV</span><span class="o">&lt;</span><span class="n">String</span><span class="o">,</span> <span class="n">String</span><span class="o">&gt;&gt;</span> <span class="n">mapped</span> <span class="o">=</span> <span class="o">...;</span>
+<span class="c1">// Apply GroupByKey to the PCollection mapped.
+</span><span class="c1">// Save the result as the PCollection reduced.
+</span><span class="c1"></span><span class="n">PCollection</span><span class="o">&lt;</span><span class="n">KV</span><span class="o">&lt;</span><span class="n">String</span><span class="o">,</span> <span class="n">Iterable</span><span class="o">&lt;</span><span class="n">String</span><span class="o">&gt;&gt;&gt;</span> <span class="n">reduced</span> <span class="o">=</span>
+<span class="n">mapped</span><span class="o">.</span><span class="na">apply</span><span class="o">(</span><span class="n">GroupByKey</span><span class="o">.&lt;</span><span class="n">String</span><span class="o">,</span> <span class="n">String</span><span class="o">&gt;</span><span class="n">create</span><span class="o">());</span></code></pre></div>
+</div>
+</div>
<h5 id="groupbykey-and-unbounded-pcollections">4.2.2.1 GroupByKey and unbounded PCollections</h5>
<p>If you are using unbounded <code>PCollection</code>s, you must use either <a href="#setting-your-pcollections-windowing-function">non-global
windowing</a> or an
diff --git a/website/generated-content/documentation/programming-guide/index.html b/website/generated-content/documentation/programming-guide/index.html
index 60df4f8d07e..adba75e8710 100644
--- a/website/generated-content/documentation/programming-guide/index.html
+++ b/website/generated-content/documentation/programming-guide/index.html
@@ -627,7 +627,13 @@ jump, [3]
tree, [2]
...
</code></pre><p>Thus, <code>GroupByKey</code> represents a transform from a multimap (multiple keys to
-individual values) to a uni-map (unique keys to collections of values).</p><h5 id=groupbykey-and-unbounded-pcollections>4.2.2.1 GroupByKey and unbounded PCollections</h5><p>If you are using unbounded <code>PCollection</code>s, you must use either <a href=#setting-your-pcollections-windowing-function>non-global
+individual values) to a uni-map (unique keys to collections of values).</p><p><span class=language-java>Using <code>GroupByKey</code> is straightforward:</span></p><div class="language-java snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><div class=highlight><pre class=chroma><code class=language-java data-lang=java><span class=c1>// The input PCollection.
+</span><span class=c1></span> <span class=n>PCollection</span><span class=o><</span><span class=n>KV</span><span class=o><</span><span class=n>String</span><span class=o>,</span> <span class=n>String</span><span class=o>>></span> <span class=n>mapped</span> <span class=o>=</span> <span class=o>...;</span>
+
+<span class=c1>// Apply GroupByKey to the PCollection mapped.
+</span><span class=c1>// Save the result as the PCollection reduced.
+</span><span class=c1></span><span class=n>PCollection</span><span class=o><</span><span class=n>KV</span><span class=o><</span><span class=n>String</span><span class=o>,</span> <span class=n>Iterable</span><span class=o><</span><span class=n>String</span><span class=o>>>></span> <span class=n>reduced</span> <span class=o>=</span>
+ <span class=n>mapped</span><span class=o>.</span><span class=na>apply</span><span class=o>(</span><span class=n>GroupByKey</span><span class=o>.<</span><span class=n>String</span><span class=o>,</span> <span class=n>String</span><span class=o>></span><span class=n>create</span><span class=o>());</span></code></pre></div></div></div><h5 id=groupbykey-and-unbounded-pcollections>4.2.2.1 GroupByKey and unbounded PCollections</h5><p>If you are using unbounded <code>PCollection</code>s, [...]
windowing</a> or an
<a href=#triggers>aggregation trigger</a> in order to perform a <code>GroupByKey</code> or
<a href=#cogroupbykey>CoGroupByKey</a>. This is because a bounded <code>GroupByKey</code> or
@@ -4334,7 +4340,7 @@ functions as shortcuts for single, unnamed inputs/outputs or define a map for na
<span class=nx>outT</span> <span class=o>:=</span> <span class=nx>beam</span><span class=p>.</span><span class=nf>UnnamedOutput</span><span class=p>(</span><span class=nx>typex</span><span class=p>.</span><span class=nf>New</span><span class=p>(</span><span class=nx>reflectx</span><span class=p>.</span><span class=nx>String</span><span class=p>))</span>
<span class=nx>res</span> <span class=o>:=</span> <span class=nx>beam</span><span class=p>.</span><span class=nf>CrossLanguage</span><span class=p>(</span><span class=nx>s</span><span class=p>,</span> <span class=nx>urn</span><span class=p>,</span> <span class=nx>payload</span><span class=p>,</span> <span class=nx>expansionAddr</span><span class=p>,</span> <span class=nx>beam</span><span class=p>.</span><span class=nf>UnnamedInput</span><span class=p>(</span><span class=nx>inputPCol</spa [...]
</code></pre></div></li><li><p>After the job has been submitted to the Beam runner, shutdown the expansion service by
-terminating the expansion service process.</p></li></ol><h3 id=x-lang-transform-runner-support>13.3. Runner Support</h3><p>Currently, portable runners such as Flink, Spark, and the direct runner can be used with multi-language pipelines.</p><p>Dataflow supports multi-language pipelines through the Dataflow Runner v2 backend architecture.</p><h3 id=x-lang-transform-tips-troubleshooting>13.4 Tips and Troubleshooting</h3><p>For additional tips and troubleshooting information, see <a href=ht [...]
+terminating the expansion service process.</p></li></ol><h3 id=x-lang-transform-runner-support>13.3. Runner Support</h3><p>Currently, portable runners such as Flink, Spark, and the direct runner can be used with multi-language pipelines.</p><p>Dataflow supports multi-language pipelines through the Dataflow Runner v2 backend architecture.</p><h3 id=x-lang-transform-tips-troubleshooting>13.4 Tips and Troubleshooting</h3><p>For additional tips and troubleshooting information, see <a href=ht [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml
index aeee7522c84..1e4d82e4330 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/categories/blog/</loc><lastmod>2022-04-21T13:37:21-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-04-21T13:37:21-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2022-04-21T13:37:21-07:00</lastmod></url><url><loc>/blog/apache-hop-with-dataflow/</loc><lastmod>2022-04-21T13:37:21-07:00</lastmod></url><url [...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/categories/blog/</loc><lastmod>2022-04-21T13:37:21-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-04-21T13:37:21-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2022-04-21T13:37:21-07:00</lastmod></url><url><loc>/blog/apache-hop-with-dataflow/</loc><lastmod>2022-04-21T13:37:21-07:00</lastmod></url><url [...]
\ No newline at end of file