You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/06/09 04:17:55 UTC
[beam] branch asf-site updated: Publishing website 2022/06/09 04:17:48 at commit 4ffeae4
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new ee6b37ef1e3 Publishing website 2022/06/09 04:17:48 at commit 4ffeae4
ee6b37ef1e3 is described below
commit ee6b37ef1e31e88fab060e606026be3b3b0d35a3
Author: jenkins <bu...@apache.org>
AuthorDate: Thu Jun 9 04:17:48 2022 +0000
Publishing website 2022/06/09 04:17:48 at commit 4ffeae4
---
website/generated-content/contribute/index.html | 4 +--
.../dataframes/differences-from-pandas/index.html | 6 ++--
website/generated-content/documentation/index.xml | 40 +++++++++++-----------
.../io/built-in/google-bigquery/index.html | 4 +--
.../documentation/io/built-in/index.html | 2 +-
.../documentation/io/built-in/snowflake/index.html | 4 +--
.../documentation/patterns/overview/index.html | 2 +-
.../documentation/programming-guide/index.html | 14 ++++----
.../sdks/go-cross-compilation/index.html | 2 +-
.../sdks/java/testing/nexmark/index.html | 2 +-
.../aggregation/approximatequantiles/index.html | 2 +-
.../aggregation/approximateunique/index.html | 2 +-
.../aggregation/combinewithcontext/index.html | 2 +-
.../transforms/python/elementwise/pardo/index.html | 4 +--
.../transforms/python/elementwise/reify/index.html | 2 +-
.../python/elementwise/withkeys/index.html | 2 +-
.../transforms/python/other/create/index.html | 2 +-
.../transforms/python/other/flatten/index.html | 4 +--
.../transforms/python/other/passert/index.html | 2 +-
.../transforms/python/other/reshuffle/index.html | 2 +-
.../transforms/python/other/view/index.html | 2 +-
.../transforms/python/other/windowinto/index.html | 4 +--
website/generated-content/get-started/index.xml | 20 +++++------
.../get-started/mobile-gaming-example/index.html | 4 +--
.../get-started/quickstart-java/index.html | 6 ++--
.../get-started/wordcount-example/index.html | 8 ++---
.../roadmap/connectors-java-sdk/index.html | 4 +--
.../generated-content/roadmap/euphoria/index.html | 4 +--
website/generated-content/roadmap/index.xml | 4 +--
website/generated-content/sitemap.xml | 2 +-
30 files changed, 81 insertions(+), 81 deletions(-)
diff --git a/website/generated-content/contribute/index.html b/website/generated-content/contribute/index.html
index 677ac5b3157..d906c84fa6c 100644
--- a/website/generated-content/contribute/index.html
+++ b/website/generated-content/contribute/index.html
@@ -20,10 +20,10 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");}
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Contribute</span></li><li><a href=/contribute/get-started-contributing>Code contribution guide</a></li><li><a href=/contribute/get-help/>Get help</a></ [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Contribute</span></li><li><a href=/contribute/get-started-contributing>Code contribution guide</a></li><li><a href=/contribute/get-help/>Get help</a></ [...]
<span><a href=/contribute/attributes/#knows-upholds-and-reinforces-the-beam-communitys-practices>Learn more.</a></span></div></div><div class=traits-item><div class=traits-item-icon><svg xmlns="http://www.w3.org/2000/svg" width="112" height="113" fill="none" viewBox="0 0 112 113"><path fill="#ffe5d9" d="M56 112.909c30.928.0 56-25.072 56-56s-25.072-56-56-56-56 25.072-56 56 25.072 56 56 56z"/><path fill="#ff570b" fill-rule="evenodd" d="M66.616 56.598c-5.523.0-10 4.477-10 10v3.097c0 5.523 4 [...]
<span><a href=/contribute/attributes#knows-upholds-and-reinforces-the-apache-software-foundation-code-of-conduct>Learn more.</a></span></div></div><div class=traits-item><div class=traits-item-icon><svg width="112" height="113" viewBox="0 0 112 113" fill="none" xmlns="http://www.w3.org/2000/svg"><path d="M56 112.445C86.9279 112.445 112 87.3732 112 56.4453 112 25.5174 86.9279.445312 56 .445312 25.0721.445312.0 25.5174.0 56.4453.0 87.3732 25.0721 112.445 56 112.445z" fill="#ffe5d9"/><path [...]
-<span><a href=/contribute/attributes#knows-upholds-and-reinforces-the-responsibilities-of-an-apache-software-foundation-committer>Learn more.</a></span></div></div></div><h2 id=become-a-project-management-committee-pmc-member>Become a Project Management Committee (PMC) Member</h2><p>The PMC is the official managing body of the project as per the Apache Software Foundation governance model: “The Apache Way”. PMC members vote to set Apache Beam’s community and technical direction and are d [...]
+<span><a href=/contribute/attributes#knows-upholds-and-reinforces-the-responsibilities-of-an-apache-software-foundation-committer>Learn more.</a></span></div></div></div><h2 id=become-a-project-management-committee-pmc-member>Become a Project Management Committee (PMC) Member</h2><p>The PMC is the official managing body of the project as per the Apache Software Foundation governance model: “The Apache Way”. PMC members vote to set Apache Beam’s community and technical direction and are d [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/dsls/dataframes/differences-from-pandas/index.html b/website/generated-content/documentation/dsls/dataframes/differences-from-pandas/index.html
index 63dc2b6f65f..9fc9a369305 100644
--- a/website/generated-content/documentation/dsls/dataframes/differences-from-pandas/index.html
+++ b/website/generated-content/documentation/dsls/dataframes/differences-from-pandas/index.html
@@ -30,17 +30,17 @@ with dataframe.allow_non_parallel_operations():
</code></pre><p>Note that this collects the entire input dataset on a single node, so there’s a risk of running out of memory. You should only use this workaround if you’re sure that the input is small enough to process on a single worker.</p><h3 id=operations-that-produce-non-deferred-columns>Operations that produce non-deferred columns</h3><p>Examples:
<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.dataframe.frames.html#apache_beam.dataframe.frames.DeferredDataFrame.pivot><code>DeferredDataFrame.pivot</code></a>,
<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.dataframe.frames.html#apache_beam.dataframe.frames.DeferredDataFrame.transpose><code>DeferredDataFrame.transpose</code></a>,
-<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.dataframe.frames.html#apache_beam.dataframe.frames.DeferredSeries.factorize><code>DeferredSeries.factorize</code></a></p><p>Beam DataFrame operations are deferred, but the schemas of the resulting DataFrames are not, meaning that result columns must be computable without access to the data. Some DataFrame operations can’t support this usage, so they can’t be implemented. These operations raise a <a href=https://beam.apach [...]
+<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.dataframe.frames.html#apache_beam.dataframe.frames.DeferredSeries.factorize><code>DeferredSeries.factorize</code></a></p><p>Beam DataFrame operations are deferred, but the schemas of the resulting DataFrames are not, meaning that result columns must be computable without access to the data. Some DataFrame operations can’t support this usage, so they can’t be implemented. These operations raise a <a href=https://beam.apach [...]
<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.dataframe.frames.html#apache_beam.dataframe.frames.DeferredSeries.to_list><code>DeferredSeries.to_list</code></a>,
<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.dataframe.frames.html#apache_beam.dataframe.frames.DeferredSeries.array><code>DeferredSeries.array</code></a>,
<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.dataframe.frames.html#apache_beam.dataframe.frames.DeferredDataFrame.plot><code>DeferredDataFrame.plot</code></a></p><p>It’s infeasible to implement DataFrame operations that produce non-deferred values or plots because Beam is a deferred API. If these operations are invoked, they will raise a <a href=https://beam.apache.org/releases/pydoc/2.39.0/apache_beam.dataframe.frame_base.html#apache_beam.dataframe.frame_base.WontI [...]
with Interactive Beam. To track progress on this issue, follow
-<a href=https://issues.apache.org/jira/browse/BEAM-14211>BEAM-14211</a>. If you think we
+<a href=https://github.com/apache/beam/issues/21638>BEAM-14211</a>. If you think we
should prioritize this work you can also <a href=https://beam.apache.org/community/contact-us/>contact
us</a> to let us know.</p><p><strong>Workaround</strong></p><p>If you’re using <a href=https://beam.apache.org/releases/pydoc/2.39.0/apache_beam.runners.interactive.interactive_beam.html>Interactive Beam</a>, you can use <code>collect</code> to bring a dataset into local memory and then perform these operations.</p><h3 id=order-sensitive-operations>Order-sensitive operations</h3><p>Examples:
<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.dataframe.frames.html#apache_beam.dataframe.frames.DeferredDataFrame.head><code>DeferredDataFrame.head</code></a>,
<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.dataframe.frames.html#apache_beam.dataframe.frames.DeferredSeries.diff><code>DeferredSeries.diff</code></a>,
-<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.dataframe.frames.html#apache_beam.dataframe.frames.DeferredDataFrame.interpolate><code>DeferredDataFrame.interpolate</code></a></p><p>Beam PCollections are inherently unordered, so pandas operations that are sensitive to the ordering of rows are not supported. These operations raise a <a href=https://beam.apache.org/releases/pydoc/2.39.0/apache_beam.dataframe.frame_base.html#apache_beam.dataframe.frame_base.WontImplementE [...]
+<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.dataframe.frames.html#apache_beam.dataframe.frames.DeferredDataFrame.interpolate><code>DeferredDataFrame.interpolate</code></a></p><p>Beam PCollections are inherently unordered, so pandas operations that are sensitive to the ordering of rows are not supported. These operations raise a <a href=https://beam.apache.org/releases/pydoc/2.39.0/apache_beam.dataframe.frame_base.html#apache_beam.dataframe.frame_base.WontImplementE [...]
Run in Colab</a></td></table><p><br><br><br><br></p><p>To get started with Beam in a notebook, see <a href=https://beam.apache.org/get-started/try-apache-beam/>Try Apache Beam</a>.</p></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col__logo><img src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div class=footer__cols__col__logo><img src=/images/ [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
diff --git a/website/generated-content/documentation/index.xml b/website/generated-content/documentation/index.xml
index b8d7b4ffda6..98c07d34596 100644
--- a/website/generated-content/documentation/index.xml
+++ b/website/generated-content/documentation/index.xml
@@ -2621,8 +2621,8 @@ SnowflakeIO is not going to delete created CSV files from path under the “stag
</ul>
<p><strong>Important noticse</strong>:</p>
<ol>
-<li>Streaming accepts only <strong>key pair authentication</strong>. For details, see: <a href="https://issues.apache.org/jira/browse/BEAM-13817">BEAM-13817</a>.</li>
-<li>The role parameter configured in <code>SnowflakeIO.DataSourceConfiguration</code> object is ignored for streaming writing. For details, see: <a href="https://issues.apache.org/jira/browse/BEAM-13819">BEAM-13819</a></li>
+<li>Streaming accepts only <strong>key pair authentication</strong>. For details, see: <a href="https://github.com/apache/beam/issues/21287">BEAM-13817</a>.</li>
+<li>The role parameter configured in <code>SnowflakeIO.DataSourceConfiguration</code> object is ignored for streaming writing. For details, see: <a href="https://github.com/apache/beam/issues/21365">BEAM-13819</a></li>
</ol>
<h4 id="flush-time-duration--number-of-rows">Flush time: duration &amp; number of rows</h4>
<p>Duration: streaming write will write periodically files on stage according to time duration specified in flush time limit (for example. every 1 minute).</p>
@@ -3173,10 +3173,10 @@ You can read about Snowflake data types at <a href="https://docs.snowflake.co
<p>SnowflakeIO currently has the following limitations.</p>
<ol>
<li>
-<p>Streaming writing supports only pair key authentication. For details, see: <a href="https://issues.apache.org/jira/browse/BEAM-13817">BEAM-13817</a>.</p>
+<p>Streaming writing supports only pair key authentication. For details, see: <a href="https://github.com/apache/beam/issues/21287">BEAM-13817</a>.</p>
</li>
<li>
-<p>The role parameter configured in <code>SnowflakeIO.DataSourceConfiguration</code> object is ignored for streaming writing. For details, see: <a href="https://issues.apache.org/jira/browse/BEAM-13819">BEAM-13819</a></p>
+<p>The role parameter configured in <code>SnowflakeIO.DataSourceConfiguration</code> object is ignored for streaming writing. For details, see: <a href="https://github.com/apache/beam/issues/21365">BEAM-13819</a></p>
</li>
</ol></description></item><item><title>Documentation: ApproximateQuantiles</title><link>/documentation/transforms/java/aggregation/approximatequantiles/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>/documentation/transforms/java/aggregation/approximatequantiles/</guid><description>
<!--
@@ -3227,7 +3227,7 @@ limitations under the License.
-->
<h1 id="approximatequantiles">ApproximateQuantiles</h1>
<h2 id="examples">Examples</h2>
-<p>See <a href="https://issues.apache.org/jira/browse/BEAM-7390">BEAM-7390</a> for updates.</p>
+<p>See <a href="https://github.com/apache/beam/issues/19547">BEAM-7390</a> for updates.</p>
<h2 id="related-transforms">Related transforms</h2></description></item><item><title>Documentation: ApproximateUnique</title><link>/documentation/transforms/java/aggregation/approximateunique/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>/documentation/transforms/java/aggregation/approximateunique/</guid><description>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
@@ -3276,7 +3276,7 @@ limitations under the License.
-->
<h1 id="approximateunique">ApproximateUnique</h1>
<h2 id="examples">Examples</h2>
-<p>See <a href="https://issues.apache.org/jira/browse/BEAM-7390">BEAM-7390</a> for updates.</p>
+<p>See <a href="https://github.com/apache/beam/issues/19547">BEAM-7390</a> for updates.</p>
<h2 id="related-transforms">Related transforms</h2></description></item><item><title>Documentation: Basics of the Beam model</title><link>/documentation/basics/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>/documentation/basics/</guid><description>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
@@ -6472,7 +6472,7 @@ determined by the input data, or depend on a different branch of your pipeline.&
<span class="nx">beam</span><span class="p">.</span><span class="nf">RegisterFunction</span><span class="p">(</span><span class="nx">filterWordsBelow</span><span class="p">)</span>
<span class="p">}</span>
<span class="c1">// The Go SDK doesn&#39;t support custom ViewFns.
-</span><span class="c1">// See https://issues.apache.org/jira/browse/BEAM-3305 for details
+</span><span class="c1">// See https://github.com/apache/beam/issues/18602 for details
</span><span class="c1"></span><span class="o">//</span> <span class="nx">on</span> <span class="nx">how</span> <span class="nx">to</span> <span class="nx">contribute</span> <span class="nx">them</span><span class="p">!</span></code></pre></div>
</div>
</div>
@@ -6812,7 +6812,7 @@ you can determine whether this is an early or a late firing, and how many times
<p class="language-py"><strong>PaneInfo:</strong>
When triggers are used, Beam provides a <code>DoFn.PaneInfoParam</code> object that contains information about the current firing. Using <code>DoFn.PaneInfoParam</code>
you can determine whether this is an early or a late firing, and how many times this window has already fired for this key.
-This feature implementation in Python SDK is not fully completed; see more at <a href="https://issues.apache.org/jira/browse/BEAM-3759">BEAM-3759</a>.</p>
+This feature implementation in Python SDK is not fully completed; see more at <a href="https://github.com/apache/beam/issues/18721">BEAM-3759</a>.</p>
<p class="language-go"><strong>PaneInfo:</strong>
When triggers are used, Beam provides <code>beam.PaneInfo</code> object that contains information about the current firing. Using <code>beam.PaneInfo</code>
you can determine whether this is an early or a late firing, and how many times this window has already fired for this key.</p>
@@ -6886,7 +6886,7 @@ In addition to aforementioned parameters, user defined Timer and State parameter
Timers and States are explained in more detail in the
<a href="/blog/2017/08/28/timely-processing.html">Timely (and Stateful) Processing with Apache Beam</a> blog post.</p>
<p class="language-go"><strong>Timer and State:</strong>
-This feature isn&rsquo;t implemented in the Go SDK; see more at <a href="https://issues.apache.org/jira/browse/BEAM-10660">BEAM-10660</a>. Once implemented, user defined Timer and State parameters can be used in a stateful DoFn.</p>
+This feature isn&rsquo;t implemented in the Go SDK; see more at <a href="https://github.com/apache/beam/issues/20510">BEAM-10660</a>. Once implemented, user defined Timer and State parameters can be used in a stateful DoFn.</p>
<div class='language-py snippet'>
<div class="notebook-skip code-snippet">
<a class="copy" type="button" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Copy to clipboard">
@@ -6943,7 +6943,7 @@ This feature isn&rsquo;t implemented in the Go SDK; see more at <a href="
<img src="/images/copy-icon.svg"/>
</a>
<div class="highlight"><pre class="chroma"><code class="language-go" data-lang="go"><span class="c1">// State and Timers are yet implemented in the Go SDK.
-</span><span class="c1">// See https://issues.apache.org/jira/browse/BEAM-10660 for info
+</span><span class="c1">// See https://github.com/apache/beam/issues/20510 for info
</span><span class="c1"></span><span class="o">//</span> <span class="nx">on</span> <span class="nx">contributing</span> <span class="nx">State</span> <span class="nx">and</span> <span class="nx">Timers</span><span class="p">.</span></code></pre></div>
</div>
</div>
@@ -7311,7 +7311,7 @@ location. Each file has the prefix &ldquo;numbers&rdquo;, a numeric tag,
<img src="/images/copy-icon.svg"/>
</a>
<div class="highlight"><pre class="chroma"><code class="language-go" data-lang="go"><span class="c1">// The Go SDK textio doesn&#39;t support sharding on writes yet.
-</span><span class="c1">// See https://issues.apache.org/jira/browse/BEAM-12664 for ways
+</span><span class="c1">// See https://github.com/apache/beam/issues/21031 for ways
</span><span class="c1"></span><span class="o">//</span> <span class="nx">to</span> <span class="nx">contribute</span> <span class="nx">a</span> <span class="nx">solution</span><span class="p">.</span></code></pre></div>
</div>
</div>
@@ -10176,7 +10176,7 @@ to other nodes in the graph. A <code>DoFn</code> can declare multiple stat
to other nodes in the graph. A <code>DoFn</code> can declare multiple state variables.</p>
<span class="language-go">
<blockquote>
-<p><strong>Note:</strong> The Beam SDK for Go does not yet support a State and Timer API. See <a href="https://issues.apache.org/jira/browse/BEAM-10660">BEAM-10660</a> to contribute.</p>
+<p><strong>Note:</strong> The Beam SDK for Go does not yet support a State and Timer API. See <a href="https://github.com/apache/beam/issues/20510">BEAM-10660</a> to contribute.</p>
</blockquote>
</span>
<h3 id="types-of-state">11.1. Types of state</h3>
@@ -13223,15 +13223,15 @@ HL7v2IO
</tr>
<tr>
<td>Apache DistributedLog</td><td>Java</td>
-<td><a href="https://issues.apache.org/jira/browse/BEAM-607">BEAM-607</a></td>
+<td><a href="https://github.com/apache/beam/issues/18026">BEAM-607</a></td>
</tr>
<tr>
<td>Apache Sqoop</td><td>Java</td>
-<td><a href="https://issues.apache.org/jira/browse/BEAM-67">BEAM-67</a></td>
+<td><a href="https://github.com/apache/beam/issues/17958">BEAM-67</a></td>
</tr>
<tr>
<td>Couchbase</td><td>Java</td>
-<td><a href="https://issues.apache.org/jira/browse/BEAM-1893">BEAM-1893</a></td>
+<td><a href="https://github.com/apache/beam/issues/18381">BEAM-1893</a></td>
</tr>
<tr>
<td>Memcached</td><td>Java</td>
@@ -13239,7 +13239,7 @@ HL7v2IO
</tr>
<tr>
<td>RestIO</td><td>Java</td>
-<td><a href="https://issues.apache.org/jira/browse/BEAM-1946">BEAM-1946</a></td>
+<td><a href="https://github.com/apache/beam/issues/18356">BEAM-1946</a></td>
</tr>
<tr>
<td>NATS IO</td><td></td>
@@ -14367,7 +14367,7 @@ limitations under the License.
-->
<h1 id="combinewithcontext">CombineWithContext</h1>
<h2 id="examples">Examples</h2>
-<p>See <a href="https://issues.apache.org/jira/browse/BEAM-7390">BEAM-7390</a> for updates.</p>
+<p>See <a href="https://github.com/apache/beam/issues/19547">BEAM-7390</a> for updates.</p>
<h2 id="related-transforms">Related transforms</h2></description></item><item><title>Documentation: Container environments</title><link>/documentation/runtime/environments/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>/documentation/runtime/environments/</guid><description>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
@@ -14894,7 +14894,7 @@ useful for testing, as well as creating an initial input to process
in parallel. For example, a single element to execute a one-time
<code>ParDo</code> or a list of filenames to be read.</p>
<h2 id="examples">Examples</h2>
-<p>See <a href="https://issues.apache.org/jira/browse/BEAM-7391">BEAM-7391</a> for updates.</p>
+<p>See <a href="https://github.com/apache/beam/issues/19498">BEAM-7391</a> for updates.</p>
<h2 id="related-transforms">Related transforms</h2></description></item><item><title>Documentation: Create Your Pipeline</title><link>/documentation/pipelines/create-your-pipeline/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>/documentation/pipelines/create-your-pipeline/</guid><description>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
@@ -16836,7 +16836,7 @@ Pydoc
that store the same data type.</p>
<p>See more information in the <a href="/documentation/programming-guide/#flatten">Beam Programming Guide</a>.</p>
<h2 id="examples">Examples</h2>
-<p>See <a href="https://issues.apache.org/jira/browse/BEAM-7391">BEAM-7391</a> for updates.</p>
+<p>See <a href="https://github.com/apache/beam/issues/19498">BEAM-7391</a> for updates.</p>
<h2 id="related-transforms">Related transforms</h2>
<ul>
<li><a href="/documentation/transforms/python/elementwise/flatmap">FlatMap</a> applies a simple 1-to-many mapping
@@ -17310,7 +17310,7 @@ BigQuery. SDK versions before 2.25.0 support the BigQuery Storage API as an
and use the pre-GA BigQuery Storage API surface. Callers should migrate
pipelines which use the BigQuery Storage API to use SDK version 2.25.0 or later.</p>
<p>The Beam SDK for Python does not support the BigQuery Storage API. See
-<a href="https://issues.apache.org/jira/browse/BEAM-10917">BEAM-10917</a>).</p>
+<a href="https://github.com/apache/beam/issues/20687">BEAM-10917</a>).</p>
<h4 id="updating-your-code">Updating your code</h4>
<p>Use the following methods when you read from a table:</p>
<ul>
diff --git a/website/generated-content/documentation/io/built-in/google-bigquery/index.html b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
index 744c954f2c2..1d2301bb733 100644
--- a/website/generated-content/documentation/io/built-in/google-bigquery/index.html
+++ b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
@@ -273,7 +273,7 @@ BigQuery. SDK versions before 2.25.0 support the BigQuery Storage API as an
<a href=https://beam.apache.org/releases/javadoc/current/index.html?org/apache/beam/sdk/annotations/Experimental.html>experimental feature</a>
and use the pre-GA BigQuery Storage API surface. Callers should migrate
pipelines which use the BigQuery Storage API to use SDK version 2.25.0 or later.</p><p>The Beam SDK for Python does not support the BigQuery Storage API. See
-<a href=https://issues.apache.org/jira/browse/BEAM-10917>BEAM-10917</a>).</p><h4 id=updating-your-code>Updating your code</h4><p>Use the following methods when you read from a table:</p><ul><li>Required: Specify <a href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.TypedRead.html#withMethod-org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead.Method->withMethod(Method.DIRECT_READ)</a> to use the BigQuery Storage API for the read opera [...]
+<a href=https://github.com/apache/beam/issues/20687>BEAM-10917</a>).</p><h4 id=updating-your-code>Updating your code</h4><p>Use the following methods when you read from a table:</p><ul><li>Required: Specify <a href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.TypedRead.html#withMethod-org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.TypedRead.Method->withMethod(Method.DIRECT_READ)</a> to use the BigQuery Storage API for the read operation. [...]
example</a>.
When the example’s read method option is set to <code>DIRECT_READ</code>, the pipeline uses
the BigQuery Storage API and column projection to read public samples of weather
@@ -869,7 +869,7 @@ reads from a BigQuery table that has the ‘month’ and ‘tornado&
of the table schema, computes the number of tornadoes in each month, and
outputs the results to a BigQuery table.</p></li><li><p><a href=https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/cookbook/filters.py>BigQuery filters</a>
reads weather station data from a BigQuery table, manipulates BigQuery rows in
-memory, and writes the results to a BigQuery table.</p></li></ul><div class=feedback><p class=update>Last updated on 2022/04/23</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><di [...]
+memory, and writes the results to a BigQuery table.</p></li></ul><div class=feedback><p class=update>Last updated on 2022/06/08</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><di [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/io/built-in/index.html b/website/generated-content/documentation/io/built-in/index.html
index 80ba873e421..4b98b0fe76f 100644
--- a/website/generated-content/documentation/io/built-in/index.html
+++ b/website/generated-content/documentation/io/built-in/index.html
@@ -39,7 +39,7 @@ function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfi
<a href=/documentation/io/built-in/snowflake>(guide)</a></td><td>Experimental Transforms for reading from and writing to <a href=https://www.snowflake.com/>Snowflake</a>.</td><td style=word-break:break-all><div><a target=_blank href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/snowflake/SnowflakeIO.html>org.apache.beam.sdk.io.snowflake.SnowflakeIO</a></div></td></tr><tr class=language-py><td>SnowflakeIO
<a href=/documentation/io/built-in/snowflake>(guide)</a></td><td>Experimental Transforms for reading from and writing to <a href=https://www.snowflake.com/>Snowflake</a>.</td><td style=word-break:break-all><div><a target=_blank href=https://beam.apache.org/releases/pydoc/current/apache_beam.io.snowflake.html>apache_beam.io.snowflake</a></div></td></tr><tr class=language-java><td>SpannerIO</td><td>Experimental Transforms for reading from and writing to <a href=https://cloud.google.com/spa [...]
<span class=language-py>pydoc</span>
-<span class=language-go>Godoc</span></th></tr><tr class=language-py><td>FlinkStreamingImpulseSource</td><td>A PTransform that provides an unbounded, streaming source of empty byte arrays. This can only be used with the Flink runner.</td><td style=word-break:break-all><div><a target=_blank href=https://beam.apache.org/releases/pydoc/current/apache_beam.io.flink.flink_streaming_impulse_source.html>apache_beam.io.flink.flink_streaming_impulse_source</a></div></td></tr><tr class=language-jav [...]
+<span class=language-go>Godoc</span></th></tr><tr class=language-py><td>FlinkStreamingImpulseSource</td><td>A PTransform that provides an unbounded, streaming source of empty byte arrays. This can only be used with the Flink runner.</td><td style=word-break:break-all><div><a target=_blank href=https://beam.apache.org/releases/pydoc/current/apache_beam.io.flink.flink_streaming_impulse_source.html>apache_beam.io.flink.flink_streaming_impulse_source</a></div></td></tr><tr class=language-jav [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/io/built-in/snowflake/index.html b/website/generated-content/documentation/io/built-in/snowflake/index.html
index 9e83ec9299d..1d10ff63da4 100644
--- a/website/generated-content/documentation/io/built-in/snowflake/index.html
+++ b/website/generated-content/documentation/io/built-in/snowflake/index.html
@@ -159,7 +159,7 @@ STORAGE_ALLOWED_LOCATIONS = ('s3://bucket/')</code></pre></div></div>The
Example:<div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>CREATE OR REPLACE PIPE "test_database"."public"."test_gcs_pipe"
AS COPY INTO stream_table from @streamstage;</code></pre></div></div></p></li><li><p>Then:<div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>.withSnowPipe("test_gcs_pipe")</code></pre></div></div></p></li></ul></li></ul><p><strong>Note</strong>: this is important to provide <strong>schema</strong> and <strong>da [...]
behind the scenes for writing from unbounded sources. StagingBucketName will be used to save CSV files which will end up in Snowflake.
-SnowflakeIO is not going to delete created CSV files from path under the “stagingBucketName” either during or after finishing streaming.</p><p><strong>Optional</strong> for streaming:</p><ul><li><p><code>.withFlushTimeLimit()</code></p><ul><li>Default value: 30 seconds</li><li>Accepts Duration objects with the specified time after each the streaming write will be repeated</li><li>Example: <code>.withFlushTimeLimit(Duration.millis(180000))</code></li></ul></li><li><p><code>.withFlushRowLi [...]
+SnowflakeIO is not going to delete created CSV files from path under the “stagingBucketName” either during or after finishing streaming.</p><p><strong>Optional</strong> for streaming:</p><ul><li><p><code>.withFlushTimeLimit()</code></p><ul><li>Default value: 30 seconds</li><li>Accepts Duration objects with the specified time after each the streaming write will be repeated</li><li>Example: <code>.withFlushTimeLimit(Duration.millis(180000))</code></li></ul></li><li><p><code>.withFlushRowLi [...]
return (SnowflakeIO.UserDataMapper<Long>) recordLine -> new String[] {recordLine.toString()};
}</code></pre></div></div></p><h3 id=additional-write-options>Additional write options</h3><h4 id=transformation-query>Transformation query</h4><p>The <code>.withQueryTransformation()</code> option for the <code>write()</code> operation accepts a SQL query as a String value, which will be performed while transfering data staged in CSV files directly to the target Snowflake table. For information about the transformation SQL syntax, see the <a href=https://docs.snowflake.net/manuals/sql-r [...]
data.apply(
@@ -313,7 +313,7 @@ Example:<div class=snippet><div class="notebook-skip code-snippet without_switch
{"type":"string","length":null},
{"type":"text","length":null},
{"type":"varbinary","size":null},
-{"type":"varchar","length":100}]</code></pre></div></div>You can read about Snowflake data types at <a href=https://docs.snowflake.com/en/sql-reference/data-types.html>Snowflake data types</a>.</p></li><li><p><code>expansion_service</code> Specifies URL of expansion service.</p></li></ul><h2 id=limitations>Limitations</h2><p>SnowflakeIO currently has the following limitations.</p><ol><li><p>Streaming writing supports only pair key authentication. For details, see: [...]
+{"type":"varchar","length":100}]</code></pre></div></div>You can read about Snowflake data types at <a href=https://docs.snowflake.com/en/sql-reference/data-types.html>Snowflake data types</a>.</p></li><li><p><code>expansion_service</code> Specifies URL of expansion service.</p></li></ul><h2 id=limitations>Limitations</h2><p>SnowflakeIO currently has the following limitations.</p><ol><li><p>Streaming writing supports only pair key authentication. For details, see: [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/patterns/overview/index.html b/website/generated-content/documentation/patterns/overview/index.html
index 455ee4d7c23..1f77b91709a 100644
--- a/website/generated-content/documentation/patterns/overview/index.html
+++ b/website/generated-content/documentation/patterns/overview/index.html
@@ -20,7 +20,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");}
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/programming-guide/index.html b/website/generated-content/documentation/programming-guide/index.html
index 607e5405d14..3ca4a6e463b 100644
--- a/website/generated-content/documentation/programming-guide/index.html
+++ b/website/generated-content/documentation/programming-guide/index.html
@@ -1415,7 +1415,7 @@ determined by the input data, or depend on a different branch of your pipeline.<
<span class=c1>// The Go SDK doesn't support custom ViewFns.
-</span><span class=c1>// See https://issues.apache.org/jira/browse/BEAM-3305 for details
+</span><span class=c1>// See https://github.com/apache/beam/issues/18602 for details
</span><span class=c1></span><span class=o>//</span> <span class=nx>on</span> <span class=nx>how</span> <span class=nx>to</span> <span class=nx>contribute</span> <span class=nx>them</span><span class=p>!</span></code></pre></div></div></div><h4 id=side-inputs-windowing>4.4.2. Side inputs and windowing</h4><p>A windowed <code>PCollection</code> may be infinite and thus cannot be compressed into a
single value (or single collection class). When you create a <code>PCollectionView</code>
of a windowed <code>PCollection</code>, the <code>PCollectionView</code> represents a single entity
@@ -1647,7 +1647,7 @@ When triggers are used, Beam provides a <code>PaneInfo</code> object that contai
you can determine whether this is an early or a late firing, and how many times this window has already fired for this key.</p><p class=language-py><strong>PaneInfo:</strong>
When triggers are used, Beam provides a <code>DoFn.PaneInfoParam</code> object that contains information about the current firing. Using <code>DoFn.PaneInfoParam</code>
you can determine whether this is an early or a late firing, and how many times this window has already fired for this key.
-This feature implementation in Python SDK is not fully completed; see more at <a href=https://issues.apache.org/jira/browse/BEAM-3759>BEAM-3759</a>.</p><p class=language-go><strong>PaneInfo:</strong>
+This feature implementation in Python SDK is not fully completed; see more at <a href=https://github.com/apache/beam/issues/18721>BEAM-3759</a>.</p><p class=language-go><strong>PaneInfo:</strong>
When triggers are used, Beam provides <code>beam.PaneInfo</code> object that contains information about the current firing. Using <code>beam.PaneInfo</code>
you can determine whether this is an early or a late firing, and how many times this window has already fired for this key.</p><div class="language-java snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><div class=highlight><pre class=chroma><code class=language-java data-lang=java><span class=o>.</span><span class=na>of</span><span class=o>(</span><span c [...]
<span class=kd>public</span> <span class=kt>void</span> <span class=nf>processElement</span><span class=o>(</span><span class=nd>@Element</span> <span class=n>String</span> <span class=n>word</span><span class=o>,</span> <span class=n>PaneInfo</span> <span class=n>paneInfo</span><span class=o>)</span> <span class=o>{</span>
@@ -1687,7 +1687,7 @@ Timers are explained in more detail in the
In addition to aforementioned parameters, user defined Timer and State parameters can be used in a stateful DoFn.
Timers and States are explained in more detail in the
<a href=/blog/2017/08/28/timely-processing.html>Timely (and Stateful) Processing with Apache Beam</a> blog post.</p><p class=language-go><strong>Timer and State:</strong>
-This feature isn’t implemented in the Go SDK; see more at <a href=https://issues.apache.org/jira/browse/BEAM-10660>BEAM-10660</a>. Once implemented, user defined Timer and State parameters can be used in a stateful DoFn.</p><div class="language-py snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><div class=highlight><pre class=chroma><code class=lan [...]
+This feature isn’t implemented in the Go SDK; see more at <a href=https://github.com/apache/beam/issues/20510>BEAM-10660</a>. Once implemented, user defined Timer and State parameters can be used in a stateful DoFn.</p><div class="language-py snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><div class=highlight><pre class=chroma><code class=language [...]
<span class=s2>"""An example stateful DoFn with state and timer"""</span>
<span class=n>BUFFER_STATE_1</span> <span class=o>=</span> <span class=n>BagStateSpec</span><span class=p>(</span><span class=s1>'buffer1'</span><span class=p>,</span> <span class=n>beam</span><span class=o>.</span><span class=n>BytesCoder</span><span class=p>())</span>
@@ -1740,7 +1740,7 @@ This feature isn’t implemented in the Go SDK; see more at <a href=https://
<span class=k>def</span> <span class=nf>_is_clear_buffer_1_required</span><span class=p>(</span><span class=n>buffer_1_data</span><span class=p>):</span>
<span class=c1># Some business logic</span>
<span class=k>return</span> <span class=bp>True</span></code></pre></div></div></div><div class="language-go snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><div class=highlight><pre class=chroma><code class=language-go data-lang=go><span class=c1>// State and Timers are yet implemented in the Go SDK.
-</span><span class=c1>// See https://issues.apache.org/jira/browse/BEAM-10660 for info
+</span><span class=c1>// See https://github.com/apache/beam/issues/20510 for info
</span><span class=c1></span><span class=o>//</span> <span class=nx>on</span> <span class=nx>contributing</span> <span class=nx>State</span> <span class=nx>and</span> <span class=nx>Timers</span><span class=p>.</span></code></pre></div></div></div><h3 id=composite-transforms>4.6. Composite transforms</h3><p>Transforms can have a nested structure, where a complex transform performs
multiple simpler transforms (such as more than one <code>ParDo</code>, <code>Combine</code>,
<code>GroupByKey</code>, or even other composite transforms). These transforms are called
@@ -1903,7 +1903,7 @@ location. Each file has the prefix “numbers”, a numeric tag, and the
<span class=n>TextIO</span><span class=o>.</span><span class=na>write</span><span class=o>().</span><span class=na>to</span><span class=o>(</span><span class=s>"protocol://my_bucket/path/to/numbers"</span><span class=o>)</span>
<span class=o>.</span><span class=na>withSuffix</span><span class=o>(</span><span class=s>".csv"</span><span class=o>));</span></code></pre></div></div></div><div class="language-py snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><div class=highlight><pre class=chroma><code class=language-py data-lang=py><span class=n>filtered_wor [...]
<span class=s1>'/path/to/numbers'</span><span class=p>,</span> <span class=n>file_name_suffix</span><span class=o>=</span><span class=s1>'.csv'</span><span class=p>)</span></code></pre></div></div></div><div class="language-go snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><div class=highlight><pre class=chroma><code class=language-g [...]
-</span><span class=c1>// See https://issues.apache.org/jira/browse/BEAM-12664 for ways
+</span><span class=c1>// See https://github.com/apache/beam/issues/21031 for ways
</span><span class=c1></span><span class=o>//</span> <span class=nx>to</span> <span class=nx>contribute</span> <span class=nx>a</span> <span class=nx>solution</span><span class=p>.</span></code></pre></div></div></div><h3 id=provided-io-transforms>5.4. Beam-provided I/O transforms</h3><p>See the <a href=/documentation/io/built-in/>Beam-provided I/O Transforms</a>
page for a list of the currently available I/O transforms.</p><h2 id=schemas>6. Schemas</h2><p>Often, the types of the records being processed have an obvious structure. Common Beam sources produce
JSON, Avro, Protocol Buffer, or database row objects; all of these types have well defined structures,
@@ -3132,7 +3132,7 @@ processing, and are recommended to test for correctness.</p><p class=language-ja
state must be named using the <code>StateId</code> annotation; this name is unique to a ParDo in the graph and has no relation
to other nodes in the graph. A <code>DoFn</code> can declare multiple state variables.</p><p class=language-py>In Python, DoFn declares states to be accessed by creating <code>StateSpec</code> class member variables representing each state. Each
<code>StateSpec</code> is initialized with a name, this name is unique to a ParDo in the graph and has no relation
-to other nodes in the graph. A <code>DoFn</code> can declare multiple state variables.</p><span class=language-go><blockquote><p><strong>Note:</strong> The Beam SDK for Go does not yet support a State and Timer API. See <a href=https://issues.apache.org/jira/browse/BEAM-10660>BEAM-10660</a> to contribute.</p></blockquote></span><h3 id=types-of-state>11.1. Types of state</h3><p>Beam provides several types of state:</p><h4 id=valuestate>ValueState</h4><p>A ValueState is a scalar state valu [...]
+to other nodes in the graph. A <code>DoFn</code> can declare multiple state variables.</p><span class=language-go><blockquote><p><strong>Note:</strong> The Beam SDK for Go does not yet support a State and Timer API. See <a href=https://github.com/apache/beam/issues/20510>BEAM-10660</a> to contribute.</p></blockquote></span><h3 id=types-of-state>11.1. Types of state</h3><p>Beam provides several types of state:</p><h4 id=valuestate>ValueState</h4><p>A ValueState is a scalar state value. Fo [...]
read and modified inside the DoFn’s <code>@ProcessElement</code> or <code>@OnTimer</code> methods. If the type of the ValueState has a coder
registered, then Beam will automatically infer the coder for the state value. Otherwise, a coder can be explicitly
specified when creating the ValueState. For example, the following ParDo creates a single state variable that
@@ -4405,7 +4405,7 @@ functions as shortcuts for single, unnamed inputs/outputs or define a map for na
<span class=nx>outT</span> <span class=o>:=</span> <span class=nx>beam</span><span class=p>.</span><span class=nf>UnnamedOutput</span><span class=p>(</span><span class=nx>typex</span><span class=p>.</span><span class=nf>New</span><span class=p>(</span><span class=nx>reflectx</span><span class=p>.</span><span class=nx>String</span><span class=p>))</span>
<span class=nx>res</span> <span class=o>:=</span> <span class=nx>beam</span><span class=p>.</span><span class=nf>CrossLanguage</span><span class=p>(</span><span class=nx>s</span><span class=p>,</span> <span class=nx>urn</span><span class=p>,</span> <span class=nx>payload</span><span class=p>,</span> <span class=nx>expansionAddr</span><span class=p>,</span> <span class=nx>beam</span><span class=p>.</span><span class=nf>UnnamedInput</span><span class=p>(</span><span class=nx>inputPCol</spa [...]
</code></pre></div></li><li><p>After the job has been submitted to the Beam runner, shutdown the expansion service by
-terminating the expansion service process.</p></li></ol><h3 id=x-lang-transform-runner-support>13.3. Runner Support</h3><p>Currently, portable runners such as Flink, Spark, and the direct runner can be used with multi-language pipelines.</p><p>Dataflow supports multi-language pipelines through the Dataflow Runner v2 backend architecture.</p><h3 id=x-lang-transform-tips-troubleshooting>13.4 Tips and Troubleshooting</h3><p>For additional tips and troubleshooting information, see <a href=ht [...]
+terminating the expansion service process.</p></li></ol><h3 id=x-lang-transform-runner-support>13.3. Runner Support</h3><p>Currently, portable runners such as Flink, Spark, and the direct runner can be used with multi-language pipelines.</p><p>Dataflow supports multi-language pipelines through the Dataflow Runner v2 backend architecture.</p><h3 id=x-lang-transform-tips-troubleshooting>13.4 Tips and Troubleshooting</h3><p>For additional tips and troubleshooting information, see <a href=ht [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/sdks/go-cross-compilation/index.html b/website/generated-content/documentation/sdks/go-cross-compilation/index.html
index e243fe98be3..f2aa349f398 100644
--- a/website/generated-content/documentation/sdks/go-cross-compilation/index.html
+++ b/website/generated-content/documentation/sdks/go-cross-compilation/index.html
@@ -39,7 +39,7 @@ $ GOOS=linux GOARCH=amd64 go build path/to/my/pipeline -o output/worker
$ ./output/launcher --worker_binary=output/worker --runner=flink --endpoint=... <...other flags...>
</code></pre><h1 id=sdk-containers>SDK Containers</h1><p>Apache Beam releases <a href=documentation/runtime/environments/>SDK specific containers</a> for runners to use to launch workers.
These containers provision and initialize the worker binary as appropriate for the SDK.</p><p>At present, Go SDK worker containers are only built for the <code>linux-amd64</code> platform.
-See <a href=https://issues.apache.org/jira/browse/BEAM-11704>BEAM-11704</a> for the current state of ARM64 container support.</p><p>Because Go is statically compiled, there are no runtime dependencies on a specific Go version for a container.
+See <a href=https://github.com/apache/beam/issues/20807>BEAM-11704</a> for the current state of ARM64 container support.</p><p>Because Go is statically compiled, there are no runtime dependencies on a specific Go version for a container.
The Go release used to compile your binary will be what your workers execute.
Be sure to update to a recent <a href=https://go.dev/doc/devel/release>Go release</a> for best performance.</p></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col__logo><img src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg class=footer__logo alt="Apache logo"></div></div>< [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
diff --git a/website/generated-content/documentation/sdks/java/testing/nexmark/index.html b/website/generated-content/documentation/sdks/java/testing/nexmark/index.html
index a92ed9b1fbb..389927455ba 100644
--- a/website/generated-content/documentation/sdks/java/testing/nexmark/index.html
+++ b/website/generated-content/documentation/sdks/java/testing/nexmark/index.html
@@ -101,7 +101,7 @@ or may be published to Pub/Sub or Kafka.</p><p>The query results may be:</p><ul>
</code></pre><p>Set topic name which will be used for benchmark results:</p><pre><code>--kafkaResultsTopic=<topic name>
</code></pre><p>Write or/and read events into/from Kafka topic:</p><pre><code>--sourceType=KAFKA
</code></pre><p>Set topic name which will be used for benchmark events:</p><pre><code>--kafkaTopic=<topic name>
-</code></pre><h2 id=current-status>Current status</h2><p>These tables contain statuses of the queries runs in the different runners. Google Cloud Dataflow status is yet to come.</p><h3 id=batch--synthetic--local>Batch / Synthetic / Local</h3><table class="table table-bordered"><tr><th>Query</th><th>Direct</th><th>Spark</th><th>Flink</th></tr><tr><td>0</td><td>ok</td><td>ok</td><td>ok</td></tr><tr><td>1</td><td>ok</td><td>ok</td><td>ok</td></tr><tr><td>2</td><td>ok</td><td>ok</td><td>ok</ [...]
+</code></pre><h2 id=current-status>Current status</h2><p>These tables contain statuses of the queries runs in the different runners. Google Cloud Dataflow status is yet to come.</p><h3 id=batch--synthetic--local>Batch / Synthetic / Local</h3><table class="table table-bordered"><tr><th>Query</th><th>Direct</th><th>Spark</th><th>Flink</th></tr><tr><td>0</td><td>ok</td><td>ok</td><td>ok</td></tr><tr><td>1</td><td>ok</td><td>ok</td><td>ok</td></tr><tr><td>2</td><td>ok</td><td>ok</td><td>ok</ [...]
Here we do it for maximum clarity.</p><p>The direct runner does not have separate batch and streaming modes, but the
Nexmark launch does.</p><p>These parameters leave on many of the DirectRunner’s extra safety checks so the
SMOKE suite can make sure there is nothing broken in the Nexmark suite.</p><p>Batch Mode:</p><pre><code>./gradlew :sdks:java:testing:nexmark:run \
diff --git a/website/generated-content/documentation/transforms/python/aggregation/approximatequantiles/index.html b/website/generated-content/documentation/transforms/python/aggregation/approximatequantiles/index.html
index c7999d82f3e..c2182af0bbd 100644
--- a/website/generated-content/documentation/transforms/python/aggregation/approximatequantiles/index.html
+++ b/website/generated-content/documentation/transforms/python/aggregation/approximatequantiles/index.html
@@ -20,7 +20,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");}
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/transforms/python/aggregation/approximateunique/index.html b/website/generated-content/documentation/transforms/python/aggregation/approximateunique/index.html
index 72772203f7a..c4715fc11e1 100644
--- a/website/generated-content/documentation/transforms/python/aggregation/approximateunique/index.html
+++ b/website/generated-content/documentation/transforms/python/aggregation/approximateunique/index.html
@@ -20,7 +20,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");}
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/transforms/python/aggregation/combinewithcontext/index.html b/website/generated-content/documentation/transforms/python/aggregation/combinewithcontext/index.html
index a732d66af5a..f305110b419 100644
--- a/website/generated-content/documentation/transforms/python/aggregation/combinewithcontext/index.html
+++ b/website/generated-content/documentation/transforms/python/aggregation/combinewithcontext/index.html
@@ -20,7 +20,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");}
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/transforms/python/elementwise/pardo/index.html b/website/generated-content/documentation/transforms/python/elementwise/pardo/index.html
index 0810da146c2..a6a773df45c 100644
--- a/website/generated-content/documentation/transforms/python/elementwise/pardo/index.html
+++ b/website/generated-content/documentation/transforms/python/elementwise/pardo/index.html
@@ -174,11 +174,11 @@ start_bundle
* process: 🍅
* process: 🥔
* finish_bundle: 🌱🌳🌍
-teardown</code></pre></div></div><blockquote><p><em>Known issues:</em></p><ul><li><a href=https://issues.apache.org/jira/browse/BEAM-7340>[BEAM-7340]</a>
+teardown</code></pre></div></div><blockquote><p><em>Known issues:</em></p><ul><li><a href=https://github.com/apache/beam/issues/19394>[BEAM-7340]</a>
<code>DoFn.teardown()</code> metrics are lost.</li></ul></blockquote><h2 id=related-transforms>Related transforms</h2><ul><li><a href=/documentation/transforms/python/elementwise/map>Map</a> behaves the same, but produces exactly one output for each input.</li><li><a href=/documentation/transforms/python/elementwise/flatmap>FlatMap</a> behaves the same as <code>Map</code>,
but for each input it may produce zero or more outputs.</li><li><a href=/documentation/transforms/python/elementwise/filter>Filter</a> is useful if the function is just
deciding whether to output an element or not.</li></ul><table align=left style=margin-right:1em><td><a class=button target=_blank href=https://beam.apache.org/releases/pydoc/current/apache_beam.transforms.core.html#apache_beam.transforms.core.Pardo><img src=https://beam.apache.org/images/logos/sdks/python.png width=32px height=32px alt=Pydoc>
-Pydoc</a></td></table><p><br><br><br></p><div class=feedback><p class=update>Last updated on 2022/03/04</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><di [...]
+Pydoc</a></td></table><p><br><br><br></p><div class=feedback><p class=update>Last updated on 2022/06/08</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><di [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/transforms/python/elementwise/reify/index.html b/website/generated-content/documentation/transforms/python/elementwise/reify/index.html
index e77c4d4f3a2..62fe154f216 100644
--- a/website/generated-content/documentation/transforms/python/elementwise/reify/index.html
+++ b/website/generated-content/documentation/transforms/python/elementwise/reify/index.html
@@ -20,7 +20,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");}
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/transforms/python/elementwise/withkeys/index.html b/website/generated-content/documentation/transforms/python/elementwise/withkeys/index.html
index 47fbdefc499..21f575cb7da 100644
--- a/website/generated-content/documentation/transforms/python/elementwise/withkeys/index.html
+++ b/website/generated-content/documentation/transforms/python/elementwise/withkeys/index.html
@@ -20,7 +20,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");}
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/transforms/python/other/create/index.html b/website/generated-content/documentation/transforms/python/other/create/index.html
index 28e23499786..70a57cf0ebb 100644
--- a/website/generated-content/documentation/transforms/python/other/create/index.html
+++ b/website/generated-content/documentation/transforms/python/other/create/index.html
@@ -24,7 +24,7 @@ function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfi
Pydoc</a></table><br><br><p>Creates a collection containing a specified set of elements. This is
useful for testing, as well as creating an initial input to process
in parallel. For example, a single element to execute a one-time
-<code>ParDo</code> or a list of filenames to be read.</p><h2 id=examples>Examples</h2><p>See <a href=https://issues.apache.org/jira/browse/BEAM-7391>BEAM-7391</a> for updates.</p><h2 id=related-transforms>Related transforms</h2><div class=feedback><p class=update>Last updated on 2020/08/14</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button>< [...]
+<code>ParDo</code> or a list of filenames to be read.</p><h2 id=examples>Examples</h2><p>See <a href=https://github.com/apache/beam/issues/19498>BEAM-7391</a> for updates.</p><h2 id=related-transforms>Related transforms</h2><div class=feedback><p class=update>Last updated on 2022/06/08</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a hr [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/transforms/python/other/flatten/index.html b/website/generated-content/documentation/transforms/python/other/flatten/index.html
index 66336298550..36d850a9660 100644
--- a/website/generated-content/documentation/transforms/python/other/flatten/index.html
+++ b/website/generated-content/documentation/transforms/python/other/flatten/index.html
@@ -23,9 +23,9 @@ function blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
Pydoc</a></table><br><br><p>Merges multiple <code>PCollection</code> objects into a single logical
<code>PCollection</code>. A transform for <code>PCollection</code> objects
-that store the same data type.</p><p>See more information in the <a href=/documentation/programming-guide/#flatten>Beam Programming Guide</a>.</p><h2 id=examples>Examples</h2><p>See <a href=https://issues.apache.org/jira/browse/BEAM-7391>BEAM-7391</a> for updates.</p><h2 id=related-transforms>Related transforms</h2><ul><li><a href=/documentation/transforms/python/elementwise/flatmap>FlatMap</a> applies a simple 1-to-many mapping
+that store the same data type.</p><p>See more information in the <a href=/documentation/programming-guide/#flatten>Beam Programming Guide</a>.</p><h2 id=examples>Examples</h2><p>See <a href=https://github.com/apache/beam/issues/19498>BEAM-7391</a> for updates.</p><h2 id=related-transforms>Related transforms</h2><ul><li><a href=/documentation/transforms/python/elementwise/flatmap>FlatMap</a> applies a simple 1-to-many mapping
function over each element in the collection. This transform might produce zero
-or more outputs.</li></ul><div class=feedback><p class=update>Last updated on 2020/08/14</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><div class="footer [...]
+or more outputs.</li></ul><div class=feedback><p class=update>Last updated on 2022/06/08</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><div class="footer [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/transforms/python/other/passert/index.html b/website/generated-content/documentation/transforms/python/other/passert/index.html
index 795f2b7f6f7..3f26c94ce7c 100644
--- a/website/generated-content/documentation/transforms/python/other/passert/index.html
+++ b/website/generated-content/documentation/transforms/python/other/passert/index.html
@@ -20,7 +20,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");}
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/transforms/python/other/reshuffle/index.html b/website/generated-content/documentation/transforms/python/other/reshuffle/index.html
index 274b4a03718..cd65acbcaea 100644
--- a/website/generated-content/documentation/transforms/python/other/reshuffle/index.html
+++ b/website/generated-content/documentation/transforms/python/other/reshuffle/index.html
@@ -25,7 +25,7 @@ Pydoc</a></table><br><br><p>Adds a temporary random key to each element in a col
these keys, and removes the temporary key. This redistributes the
elements between workers and returns a collection equivalent to its
input collection. This is most useful for adjusting parallelism or
-preventing coupled failures.</p><h2 id=examples>Examples</h2><p>See <a href=https://issues.apache.org/jira/browse/BEAM-7391>BEAM-7391</a> for updates.</p><h2 id=related-transforms>Related transforms</h2><p>N/A</p><div class=feedback><p class=update>Last updated on 2020/08/14</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto: [...]
+preventing coupled failures.</p><h2 id=examples>Examples</h2><p>See <a href=https://github.com/apache/beam/issues/19498>BEAM-7391</a> for updates.</p><h2 id=related-transforms>Related transforms</h2><p>N/A</p><div class=feedback><p class=update>Last updated on 2022/06/08</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@ [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/transforms/python/other/view/index.html b/website/generated-content/documentation/transforms/python/other/view/index.html
index c01f62bfb1a..15a00651f3f 100644
--- a/website/generated-content/documentation/transforms/python/other/view/index.html
+++ b/website/generated-content/documentation/transforms/python/other/view/index.html
@@ -20,7 +20,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");}
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/transforms/python/other/windowinto/index.html b/website/generated-content/documentation/transforms/python/other/windowinto/index.html
index 128e30f942f..c1b69fa0296 100644
--- a/website/generated-content/documentation/transforms/python/other/windowinto/index.html
+++ b/website/generated-content/documentation/transforms/python/other/windowinto/index.html
@@ -22,10 +22,10 @@ function endSearch(){var search=document.querySelector(".searchBar");search.clas
function blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
Pydoc</a></table><br><br><p>Logically divides up or groups the elements of a collection into finite
-windows according to a function.</p><h2 id=examples>Examples</h2><p>See <a href=https://issues.apache.org/jira/browse/BEAM-7391>BEAM-7391</a> for updates.</p><h2 id=related-transforms>Related transforms</h2><ul><li><a href=/documentation/transforms/python/aggregation/groupbykey>GroupByKey</a>
+windows according to a function.</p><h2 id=examples>Examples</h2><p>See <a href=https://github.com/apache/beam/issues/19498>BEAM-7391</a> for updates.</p><h2 id=related-transforms>Related transforms</h2><ul><li><a href=/documentation/transforms/python/aggregation/groupbykey>GroupByKey</a>
produces a collection where each element consists of a key and all values associated
with that key.</li><li><a href=/documentation/transforms/python/elementwise/withtimestamps>Timestamp</a>
-applies a function to determine a timestamp to each element in the output collection.</li></ul><div class=feedback><p class=update>Last updated on 2020/08/14</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><d [...]
+applies a function to determine a timestamp to each element in the output collection.</li></ul><div class=feedback><p class=update>Last updated on 2022/06/08</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><d [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/get-started/index.xml b/website/generated-content/get-started/index.xml
index c6f439ecd48..94ddf6fac3f 100644
--- a/website/generated-content/get-started/index.xml
+++ b/website/generated-content/get-started/index.xml
@@ -70,7 +70,7 @@ limitations under the License.
</blockquote></p>
<blockquote>
<p><strong>Note</strong>: MobileGaming is not yet available for the Go SDK. There is an open issue for this
-(<a href="https://issues.apache.org/jira/browse/BEAM-4293">BEAM-4293</a>).</p>
+(<a href="https://github.com/apache/beam/issues/18806">BEAM-4293</a>).</p>
</blockquote>
<p>Every time a user plays an instance of our hypothetical mobile game, they generate a data event. Each data event consists of the following information:</p>
<ul>
@@ -1576,7 +1576,7 @@ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCou
<a class="copy" type="button" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Copy to clipboard">
<img src="/images/copy-icon.svg"/>
</a>
-<pre><code class="language-flink" data-lang="flink">TODO: document Flink on Gradle: https://issues.apache.org/jira/browse/BEAM-14057</code></pre>
+<pre><code class="language-flink" data-lang="flink">TODO: document Flink on Gradle: https://github.com/apache/beam/issues/21498</code></pre>
</div>
</div>
<div class='runner-flinkCluster snippet'>
@@ -1584,7 +1584,7 @@ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCou
<a class="copy" type="button" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Copy to clipboard">
<img src="/images/copy-icon.svg"/>
</a>
-<pre><code class="language-flinkCluster" data-lang="flinkCluster">TODO: document FlinkCluster on Gradle: https://issues.apache.org/jira/browse/BEAM-14060</code></pre>
+<pre><code class="language-flinkCluster" data-lang="flinkCluster">TODO: document FlinkCluster on Gradle: https://github.com/apache/beam/issues/21499</code></pre>
</div>
</div>
<div class='runner-spark snippet'>
@@ -1592,7 +1592,7 @@ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCou
<a class="copy" type="button" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Copy to clipboard">
<img src="/images/copy-icon.svg"/>
</a>
-<pre><code class="language-spark" data-lang="spark">TODO: document Spark on Gradle: https://issues.apache.org/jira/browse/BEAM-14063</code></pre>
+<pre><code class="language-spark" data-lang="spark">TODO: document Spark on Gradle: https://github.com/apache/beam/issues/21502</code></pre>
</div>
</div>
<div class='runner-dataflow snippet'>
@@ -1610,7 +1610,7 @@ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCou
<a class="copy" type="button" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Copy to clipboard">
<img src="/images/copy-icon.svg"/>
</a>
-<pre><code class="language-samza" data-lang="samza">TODO: document Samza on Gradle: https://issues.apache.org/jira/browse/BEAM-14061</code></pre>
+<pre><code class="language-samza" data-lang="samza">TODO: document Samza on Gradle: https://github.com/apache/beam/issues/21500</code></pre>
</div>
</div>
<div class='runner-nemo snippet'>
@@ -1618,7 +1618,7 @@ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCou
<a class="copy" type="button" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Copy to clipboard">
<img src="/images/copy-icon.svg"/>
</a>
-<pre><code class="language-nemo" data-lang="nemo">TODO: document Nemo on Gradle: https://issues.apache.org/jira/browse/BEAM-14058</code></pre>
+<pre><code class="language-nemo" data-lang="nemo">TODO: document Nemo on Gradle: https://github.com/apache/beam/issues/21503</code></pre>
</div>
</div>
<div class='runner-jet snippet'>
@@ -1626,7 +1626,7 @@ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCou
<a class="copy" type="button" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Copy to clipboard">
<img src="/images/copy-icon.svg"/>
</a>
-<pre><code class="language-jet" data-lang="jet">TODO: document Jet on Gradle: https://issues.apache.org/jira/browse/BEAM-14062</code></pre>
+<pre><code class="language-jet" data-lang="jet">TODO: document Jet on Gradle: https://github.com/apache/beam/issues/21501</code></pre>
</div>
</div>
</p>
@@ -3589,12 +3589,12 @@ or DEBUG significantly increases the amount of logs output.</p>
<h4 id="apache-spark-runner">Apache Spark Runner</h4>
<blockquote>
<p><strong>Note:</strong> This section is yet to be added. There is an open issue for this
-(<a href="https://issues.apache.org/jira/browse/BEAM-792">BEAM-792</a>).</p>
+(<a href="https://github.com/apache/beam/issues/18076">BEAM-792</a>).</p>
</blockquote>
<h4 id="apache-flink-runner">Apache Flink Runner</h4>
<blockquote>
<p><strong>Note:</strong> This section is yet to be added. There is an open issue for this
-(<a href="https://issues.apache.org/jira/browse/BEAM-791">BEAM-791</a>).</p>
+(<a href="https://github.com/apache/beam/issues/18075">BEAM-791</a>).</p>
</blockquote>
<h4 id="apache-nemo-runner">Apache Nemo Runner</h4>
<p>When executing your pipeline with the <code>NemoRunner</code>, most log messages are printed
@@ -4220,7 +4220,7 @@ python -m apache_beam.examples.streaming_wordcount \
<p><strong>To run this example in Go:</strong></p>
<blockquote>
<p><strong>Note:</strong> StreamingWordCount is not yet available for the Go SDK. There is an open issue for this
-(<a href="https://issues.apache.org/jira/browse/BEAM-4292">BEAM-4292</a>).</p>
+(<a href="https://github.com/apache/beam/issues/18879">BEAM-4292</a>).</p>
</blockquote>
<h3 id="reading-an-unbounded-dataset">Reading an unbounded dataset</h3>
<p>This example uses an unbounded dataset as input. The code reads Pub/Sub
diff --git a/website/generated-content/get-started/mobile-gaming-example/index.html b/website/generated-content/get-started/mobile-gaming-example/index.html
index eeed5486d6a..cf855d0b295 100644
--- a/website/generated-content/get-started/mobile-gaming-example/index.html
+++ b/website/generated-content/get-started/mobile-gaming-example/index.html
@@ -21,7 +21,7 @@ function addPlaceholder(){$('input:text').attr('placeholder',"What are you looki
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Get started</span></li><li><a href=/get-started/beam-overview/>Beam Overview</a></li><li><a href=/get-started/tour-of-beam/>Tour of Beam</a></li><li><s [...]
-(<a href=https://issues.apache.org/jira/browse/BEAM-4293>BEAM-4293</a>).</p></blockquote><p>Every time a user plays an instance of our hypothetical mobile game, they generate a data event. Each data event consists of the following information:</p><ul><li>The unique ID of the user playing the game.</li><li>The team ID for the team to which the user belongs.</li><li>A score value for that particular instance of play.</li><li>A timestamp that records when the particular instance of play hap [...]
+(<a href=https://github.com/apache/beam/issues/18806>BEAM-4293</a>).</p></blockquote><p>Every time a user plays an instance of our hypothetical mobile game, they generate a data event. Each data event consists of the following information:</p><ul><li>The unique ID of the user playing the game.</li><li>The team ID for the team to which the user belongs.</li><li>A score value for that particular instance of play.</li><li>A timestamp that records when the particular instance of play happene [...]
occurred. The Y-axis represents processing time: the time at which a game event
was processed. Ideally, events should be processed as they occur, depicted by
the dotted line in the diagram. However, in reality that is not the case and it
@@ -583,7 +583,7 @@ between instances are.</em></p><p>We can use the session-windowed data to determ
<span class=n>args</span><span class=o>.</span><span class=n>dataset</span><span class=p>,</span> <span class=p>{</span>
<span class=s1>'mean_duration'</span><span class=p>:</span> <span class=s1>'FLOAT'</span><span class=p>,</span>
<span class=p>},</span>
- <span class=n>options</span><span class=o>.</span><span class=n>view_as</span><span class=p>(</span><span class=n>GoogleCloudOptions</span><span class=p>)</span><span class=o>.</span><span class=n>project</span><span class=p>))</span></code></pre></div></div></div><p>We can use the resulting information to find, for example, what times of day our users are playing the longest, or which stretches of the day are more likely to see shorter play sessions.</p><h2 id=next-steps>Next Steps< [...]
+ <span class=n>options</span><span class=o>.</span><span class=n>view_as</span><span class=p>(</span><span class=n>GoogleCloudOptions</span><span class=p>)</span><span class=o>.</span><span class=n>project</span><span class=p>))</span></code></pre></div></div></div><p>We can use the resulting information to find, for example, what times of day our users are playing the longest, or which stretches of the day are more likely to see shorter play sessions.</p><h2 id=next-steps>Next Steps< [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/get-started/quickstart-java/index.html b/website/generated-content/get-started/quickstart-java/index.html
index a9971a6ff55..9fe1b50b927 100644
--- a/website/generated-content/get-started/quickstart-java/index.html
+++ b/website/generated-content/get-started/quickstart-java/index.html
@@ -117,9 +117,9 @@ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCou
--runner=NemoRunner --inputFile=`pwd`/sample.txt --output=counts</code></pre></div></div><div class="runner-jet snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code class=language-jet data-lang=jet>mvn package -P jet-runner
java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount `
--runner=JetRunner --jetLocalMode=3 --inputFile=$pwd/sample.txt --output=counts</code></pre></div></div></p><h3 id=run-wordcount-using-gradle>Run WordCount using Gradle</h3><p>For Unix shells:</p><p><div class="runner-direct snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code class=language-direct data-lang=direct>gradle clean execute -DmainCl [...]
- --args="--inputFile=sample.txt --output=counts"</code></pre></div></div><div class="runner-flink snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code class=language-flink data-lang=flink>TODO: document Flink on Gradle: https://issues.apache.org/jira/browse/BEAM-14057</code></pre></div></div><div class="runner-flinkCluster snippet"><div [...]
+ --args="--inputFile=sample.txt --output=counts"</code></pre></div></div><div class="runner-flink snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code class=language-flink data-lang=flink>TODO: document Flink on Gradle: https://github.com/apache/beam/issues/21498</code></pre></div></div><div class="runner-flinkCluster snippet"><div class [...]
--args="--project=<your-gcp-project> --inputFile=gs://apache-beam-samples/shakespeare/* \
- --output=gs://<your-gcs-bucket>/counts" -Pdataflow-runner</code></pre></div></div><div class="runner-samza snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code class=language-samza data-lang=samza>TODO: document Samza on Gradle: https://issues.apache.org/jira/browse/BEAM-14061</code></pre></div></div><div class="runner-nemo snippet">< [...]
+ --output=gs://<your-gcs-bucket>/counts" -Pdataflow-runner</code></pre></div></div><div class="runner-samza snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code class=language-samza data-lang=samza>TODO: document Samza on Gradle: https://github.com/apache/beam/issues/21500</code></pre></div></div><div class="runner-nemo snippet"><div c [...]
multiple output files prefixed by <code>count</code>. The number of output files is decided
by the runner, giving it the flexibility to do efficient, distributed execution.</p><ol><li>View the output files in a Unix shell:<div class="runner-direct snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code class=language-direct data-lang=direct>ls counts*
</code></pre></div></div><div class="runner-flink snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code class=language-flink data-lang=flink>ls counts*
@@ -156,7 +156,7 @@ and look through the
<a href=/get-started/wordcount-example>WordCount Example Walkthrough</a>.</li><li>Take a self-paced tour through our
<a href=/documentation/resources/learning-resources>Learning Resources</a>.</li><li>Dive in to some of our favorite
<a href=/documentation/resources/videos-and-podcasts>Videos and Podcasts</a>.</li><li>Join the Beam <a href=/community/contact-us>users@</a> mailing list.</li></ul><p>Please don’t hesitate to <a href=/community/contact-us>reach out</a> if you encounter any
-issues!</p><div class=feedback><p class=update>Last updated on 2022/03/15</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><div class="footer__cols__col foo [...]
+issues!</p><div class=feedback><p class=update>Last updated on 2022/06/08</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><div class="footer__cols__col foo [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/get-started/wordcount-example/index.html b/website/generated-content/get-started/wordcount-example/index.html
index 288258eaca9..cc4231fdf0f 100644
--- a/website/generated-content/get-started/wordcount-example/index.html
+++ b/website/generated-content/get-started/wordcount-example/index.html
@@ -407,8 +407,8 @@ For example, by specifying <code>--defaultWorkerLogLevel=DEBUG</code> when execu
pipeline with the Cloud Dataflow service, Cloud Logging will contain all “DEBUG”
or higher level logs. Note that changing the default worker log level to TRACE
or DEBUG significantly increases the amount of logs output.</p><h4 id=apache-spark-runner>Apache Spark Runner</h4><blockquote><p><strong>Note:</strong> This section is yet to be added. There is an open issue for this
-(<a href=https://issues.apache.org/jira/browse/BEAM-792>BEAM-792</a>).</p></blockquote><h4 id=apache-flink-runner>Apache Flink Runner</h4><blockquote><p><strong>Note:</strong> This section is yet to be added. There is an open issue for this
-(<a href=https://issues.apache.org/jira/browse/BEAM-791>BEAM-791</a>).</p></blockquote><h4 id=apache-nemo-runner>Apache Nemo Runner</h4><p>When executing your pipeline with the <code>NemoRunner</code>, most log messages are printed
+(<a href=https://github.com/apache/beam/issues/18076>BEAM-792</a>).</p></blockquote><h4 id=apache-flink-runner>Apache Flink Runner</h4><blockquote><p><strong>Note:</strong> This section is yet to be added. There is an open issue for this
+(<a href=https://github.com/apache/beam/issues/18075>BEAM-791</a>).</p></blockquote><h4 id=apache-nemo-runner>Apache Nemo Runner</h4><p>When executing your pipeline with the <code>NemoRunner</code>, most log messages are printed
directly to your local console. You should add <code>Slf4j</code> to your class path to make
full use of the logs. In order to observe the logs on each of the driver and the
executor sides, you should observe the folders created by Apache REEF. For example,
@@ -588,7 +588,7 @@ python -m apache_beam.examples.streaming_wordcount \
--output_topic "projects/YOUR_PUBSUB_PROJECT_NAME/topics/YOUR_OUTPUT_TOPIC" \
--streaming</code></pre></div></div><div class="runner-samza snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code class=language-samza data-lang=samza>This runner is not yet available for the Python SDK.</code></pre></div></div><div class="runner-nemo snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=toolti [...]
<strong><a href=https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/streaming_wordcount.py>streaming_wordcount.py</a>.</strong></p><p><strong>To run this example in Go:</strong></p><blockquote><p><strong>Note:</strong> StreamingWordCount is not yet available for the Go SDK. There is an open issue for this
-(<a href=https://issues.apache.org/jira/browse/BEAM-4292>BEAM-4292</a>).</p></blockquote><h3 id=reading-an-unbounded-dataset>Reading an unbounded dataset</h3><p>This example uses an unbounded dataset as input. The code reads Pub/Sub
+(<a href=https://github.com/apache/beam/issues/18879>BEAM-4292</a>).</p></blockquote><h3 id=reading-an-unbounded-dataset>Reading an unbounded dataset</h3><p>This example uses an unbounded dataset as input. The code reads Pub/Sub
messages from a Pub/Sub subscription or topic using
<a href=https://beam.apache.org/releases/pydoc/2.39.0/apache_beam.io.gcp.pubsub.html#apache_beam.io.gcp.pubsub.ReadFromPubSub><code>beam.io.ReadFromPubSub</code></a>.</p><div class="language-java snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><div class=highlight><pre class=chroma><code class=language-java data-lang=java> <span class=o>//</span> <span [...]
<span class=k>if</span> <span class=n>known_args</span><span class=o>.</span><span class=n>input_subscription</span><span class=p>:</span>
@@ -604,7 +604,7 @@ Google Pub/Sub. The code formats the results and writes them to a Pub/Sub topic
using <a href=https://beam.apache.org/releases/pydoc/2.39.0/apache_beam.io.gcp.pubsub.html#apache_beam.io.gcp.pubsub.WriteToPubSub><code>beam.io.WriteToPubSub</code></a>.</p><div class="language-java snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><div class=highlight><pre class=chroma><code class=language-java data-lang=java> <span class=o>//</span> <s [...]
<span class=n>_</span> <span class=o>=</span> <span class=p>(</span><span class=n>output</span>
<span class=o>|</span> <span class=s1>'EncodeString'</span> <span class=o>>></span> <span class=n>Map</span><span class=p>(</span><span class=k>lambda</span> <span class=n>s</span><span class=p>:</span> <span class=n>s</span><span class=o>.</span><span class=n>encode</span><span class=p>(</span><span class=s1>'utf-8'</span><span class=p>))</span>
- <span class=o>|</span> <span class=n>beam</span><span class=o>.</span><span class=n>io</span><span class=o>.</span><span class=n>WriteToPubSub</span><span class=p>(</span><span class=n>known_args</span><span class=o>.</span><span class=n>output_topic</span><span class=p>))</span></code></pre></div></div></div><div class="language-go snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img [...]
+ <span class=o>|</span> <span class=n>beam</span><span class=o>.</span><span class=n>io</span><span class=o>.</span><span class=n>WriteToPubSub</span><span class=p>(</span><span class=n>known_args</span><span class=o>.</span><span class=n>output_topic</span><span class=p>))</span></code></pre></div></div></div><div class="language-go snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/roadmap/connectors-java-sdk/index.html b/website/generated-content/roadmap/connectors-java-sdk/index.html
index bace27574f5..b14ee8b6f22 100644
--- a/website/generated-content/roadmap/connectors-java-sdk/index.html
+++ b/website/generated-content/roadmap/connectors-java-sdk/index.html
@@ -21,12 +21,12 @@ function addPlaceholder(){$('input:text').attr('placeholder',"What are you looki
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Roadmap</span></li><li><a href=/roadmap/>Roadmap Highlights</a></li><li><a href=/roadmap/portability>Portability Framework</a></li><li class=section-na [...]
-<a href=https://issues.apache.org/jira/browse/BEAM-1893>BEAM-1893</a> for more details on the
+<a href=https://github.com/apache/beam/issues/18381>BEAM-1893</a> for more details on the
planned Beam connector for Couchbase.</p><h1 id=influxdb>InfluxDB</h1><p>InfluxDB is a database for fast and highly available storage and retrieval
of time series data. See <a href=https://issues.apache.org/jira/browse/BEAM-2546>BEAM-2546</a> for
more details on the planned Beam connector for InfluxDB.</p><h1 id=memcached>Memcached</h1><p>Memcached is a distributed memory caching system. See
<a href=https://issues.apache.org/jira/browse/BEAM-1678>BEAM-1678</a> for more details on the
-planned Beam connector for Memcached.</p><div class=feedback><p class=update>Last updated on 2020/05/15</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><di [...]
+planned Beam connector for Memcached.</p><div class=feedback><p class=update>Last updated on 2022/06/08</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><di [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/roadmap/euphoria/index.html b/website/generated-content/roadmap/euphoria/index.html
index 5abd03208f9..ce33265b37f 100644
--- a/website/generated-content/roadmap/euphoria/index.html
+++ b/website/generated-content/roadmap/euphoria/index.html
@@ -20,9 +20,9 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");}
function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Roadmap</span></li><li><a href=/roadmap/>Roadmap Highlights</a></li><li><a href=/roadmap/portability>Portability Framework</a></li><li class=section-na [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Roadmap</span></li><li><a href=/roadmap/>Roadmap Highlights</a></li><li><a href=/roadmap/portability>Portability Framework</a></li><li class=section-na [...]
the large keys into multiple splits, using key distribution approximated by count min sketch data structure.</p><h2 id=pipeline-sampling>Pipeline sampling</h2><p>In order to pick the right translation for the operator without user interference, we can leverage knowledge from
-previous pipeline runs. We want to provide a convenient and portable way to gather this knowledge.</p><h2 id=fluent-api>Fluent API</h2><p>Implementation of an easy to use Fluent API on top of Euphoria DSL.</p><h2 id=side-outputs>Side Outputs</h2><p>An convenient API for multiple outputs.</p><h2 id=table-stream-joins>Table-stream joins</h2><p>Introduce API for converting streams to tables (KStream <-> KTable approach) and various types of (windowed and unwindowed) joins on them.</p><di [...]
+previous pipeline runs. We want to provide a convenient and portable way to gather this knowledge.</p><h2 id=fluent-api>Fluent API</h2><p>Implementation of an easy to use Fluent API on top of Euphoria DSL.</p><h2 id=side-outputs>Side Outputs</h2><p>An convenient API for multiple outputs.</p><h2 id=table-stream-joins>Table-stream joins</h2><p>Introduce API for converting streams to tables (KStream <-> KTable approach) and various types of (windowed and unwindowed) joins on them.</p><di [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/roadmap/index.xml b/website/generated-content/roadmap/index.xml
index 76f7e70c03b..fac6b80fa8f 100644
--- a/website/generated-content/roadmap/index.xml
+++ b/website/generated-content/roadmap/index.xml
@@ -58,7 +58,7 @@ limitations under the License.
<p>Roadmap for connectors developed using Java SDK.</p>
<h1 id="couchbase">Couchbase</h1>
<p>Couchbase is a NoSQL document-oriented database. See
-<a href="https://issues.apache.org/jira/browse/BEAM-1893">BEAM-1893</a> for more details on the
+<a href="https://github.com/apache/beam/issues/18381">BEAM-1893</a> for more details on the
planned Beam connector for Couchbase.</p>
<h1 id="influxdb">InfluxDB</h1>
<p>InfluxDB is a database for fast and highly available storage and retrieval
@@ -102,7 +102,7 @@ limitations under the License.
<h1 id="euphoria-api">Euphoria API</h1>
<p>Easy to use Java 8 DSL for the Beam Java SDK. Provides a high-level abstraction of Beam transformations, which is both easy to read and write. Can be used as a complement to existing Beam pipelines (convertible back and forth). You can have a glimpse of the API at <a href="/documentation/sdks/java/euphoria/#wordcount-example">WordCount example</a>.</p>
<ul>
-<li>JIRA: <a href="https://issues.apache.org/jira/browse/BEAM-4366?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20dsl-euphoria">dsl-euphoria</a> / <a href="https://issues.apache.org/jira/browse/BEAM-3900">BEAM-3900</a></li>
+<li>JIRA: <a href="https://github.com/apache/beam/issues?q=is%3Aopen+is%3Aissue+label%3Adsl-euphoria">dsl-euphoria</a> / <a href="https://issues.apache.org/jira/browse/BEAM-3900">BEAM-3900</a></li>
<li>Contact: <a href="mailto:dmvk@apache.org">David Moravek</a></li>
</ul>
<h2 id="salted-join-implementation">&ldquo;Salted&rdquo; join implementation</h2>
diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml
index d3a4cc392ec..b3b25177153 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.39.0/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/blog/b [...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.39.0/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/blog/b [...]
\ No newline at end of file