You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/05/15 16:17:09 UTC
[beam] branch asf-site updated: Publishing website 2023/05/15 16:17:03 at commit 05a1507
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 35c9699eb2a Publishing website 2023/05/15 16:17:03 at commit 05a1507
35c9699eb2a is described below
commit 35c9699eb2ac22c19b484d05955ab62d9694361e
Author: jenkins <bu...@apache.org>
AuthorDate: Mon May 15 16:17:03 2023 +0000
Publishing website 2023/05/15 16:17:03 at commit 05a1507
---
website/generated-content/blog/beam-2.47.0/index.html | 7 +++----
website/generated-content/blog/index.xml | 5 +----
website/generated-content/categories/blog/index.xml | 5 +----
website/generated-content/categories/release/index.xml | 5 +----
website/generated-content/documentation/index.xml | 4 ++--
website/generated-content/documentation/io/connectors/index.html | 2 +-
.../documentation/io/developing-io-java/index.html | 4 ++--
website/generated-content/documentation/io/io-standards/index.html | 2 +-
.../generated-content/documentation/ml/orchestration/index.html | 2 +-
website/generated-content/feed.xml | 5 +----
website/generated-content/sitemap.xml | 2 +-
11 files changed, 15 insertions(+), 28 deletions(-)
diff --git a/website/generated-content/blog/beam-2.47.0/index.html b/website/generated-content/blog/beam-2.47.0/index.html
index e6c10c91f8a..fa1ff0347f8 100644
--- a/website/generated-content/blog/beam-2.47.0/index.html
+++ b/website/generated-content/blog/beam-2.47.0/index.html
@@ -23,12 +23,11 @@ function blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div class="body__contained center no__padding content-up"><article class=post itemscope itemtype=http://schema.org/BlogPosting><div class=post-content><div class=post-info><p>blog & release
</p><p>2023/05/10</p></div><header class=post-header><h2 itemprop="name headline">Apache Beam 2.47.0</h1><div class=post-info><span>Jack R. McCluskey [<a href=https://twitter.com/jrmccluskey>@jrmccluskey</a>]</span></div></header><div class="arrow-list header-top-margin" itemprop=articleBody><p>We are happy to present the new 2.47.0 release of Beam.
This release includes both improvements and new functionality.
-See the <a href=/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D>download page</a> for this release.</p><p>For more information on changes in 2.47.0, check out the <a href=https://github.com/apache/beam/milestone/10>detailed release notes</a>.</p><h2 id=highlights>Highlights</h2><ul><li>Apache Beam adds Python 3.11 support (<a href=https://github.com/apache/beam/issues/23848>#23848</a>).</li></ul><h2 id=ios>I/Os</h2><ul><li>Support for X source added (Java/Python) (<a href=https://github.co [...]
+See the <a href=/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D>download page</a> for this release.</p><p>For more information on changes in 2.47.0, check out the <a href=https://github.com/apache/beam/milestone/10>detailed release notes</a>.</p><h2 id=highlights>Highlights</h2><ul><li>Apache Beam adds Python 3.11 support (<a href=https://github.com/apache/beam/issues/23848>#23848</a>).</li></ul><h2 id=ios>I/Os</h2><ul><li>BigQuery Storage Write API is now available in Python SDK via cross [...]
(Note that when doing multiple operations, it may be more efficient to explicitly chain the operations
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid excessive conversions.)</li><li>The Go SDK adds new transforms periodic.Impulse and periodic.Sequence that extends support
-for slowly updating side input patterns. (<a href=https://github.com/apache/beam/issues/23106>#23106</a>)</li><li>Python SDK now requires <code>protobuf>=4.21.1,<4.23.0</code> and no longer supports protobuf 3.x. (<a href=https://github.com/apache/beam/pull/24599>#24599</a>)</li><li>Several Google client libraries in Python SDK dependency chain were updated to latest available major versions. (<a href=https://github.com/apache/beam/pull/24599>#24599</a>)</li></ul><h2 id=breaking-chang [...]
-in response to the Google Cloud Debugger service <a href=https://cloud.google.com/debugger/docs/deprecations>turning down</a>.
-(Java) (<a href=https://github.com/apache/beam/issues/25959>#25959</a>).</li></ul><h2 id=bugfixes>Bugfixes</h2><ul><li>BigQuery sink in STORAGE_WRITE_API mode in batch pipelines might result in data consistency issues during the handling of other unrelated transient errors for Beam SDKs 2.35.0 - 2.46.0 (inclusive). For more details see: <a href=https://github.com/apache/beam/issues/26521>https://github.com/apache/beam/issues/26521</a></li></ul><h2 id=list-of-contributors>List of Contribu [...]
+for slowly updating side input patterns. (<a href=https://github.com/apache/beam/issues/23106>#23106</a>)</li><li>Several Google client libraries in Python SDK dependency chain were updated to latest available major versions. (<a href=https://github.com/apache/beam/pull/24599>#24599</a>)</li></ul><h2 id=breaking-changes>Breaking Changes</h2><ul><li>If a main session fails to load, the pipeline will now fail at worker startup. (<a href=https://github.com/apache/beam/issues/25401>#25401</a [...]
+in response to the Google Cloud Debugger service <a href=https://cloud.google.com/debugger/docs/deprecations>turning down</a>. (Java) (<a href=https://github.com/apache/beam/issues/25959>#25959</a>).</li></ul><h2 id=bugfixes>Bugfixes</h2><ul><li>BigQuery sink in STORAGE_WRITE_API mode in batch pipelines might result in data consistency issues during the handling of other unrelated transient errors for Beam SDKs 2.35.0 - 2.46.0 (inclusive). For more details see: <a href=https://github.com [...]
</p><p>2023/03/10</p></div><div class=post><p class=post-title>Apache Beam 2.46.0</p><p class=post-info>Danny McCormick</p></div></a><a class=post-card href=/blog/beam-2.45.0/ data-categories="blog release"><div class="post-info post-category"><p>blog & release
diff --git a/website/generated-content/blog/index.xml b/website/generated-content/blog/index.xml
index 00b0c46539e..ea28672eacf 100644
--- a/website/generated-content/blog/index.xml
+++ b/website/generated-content/blog/index.xml
@@ -20,7 +20,6 @@ See the <a href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
</ul>
<h2 id="ios">I/Os</h2>
<ul>
-<li>Support for X source added (Java/Python) (<a href="https://github.com/apache/beam/issues/X">#X</a>).</li>
<li>BigQuery Storage Write API is now available in Python SDK via cross-language (<a href="https://github.com/apache/beam/issues/21961">#21961</a>).</li>
<li>Added HbaseIO support for writing RowMutations (ordered by rowkey) to Hbase (Java) (<a href="https://github.com/apache/beam/issues/25830">#25830</a>).</li>
<li>Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go) (<a href="https://github.com/apache/beam/issues/25779">#25779</a>).</li>
@@ -34,7 +33,6 @@ See the <a href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid excessive conversions.)</li>
<li>The Go SDK adds new transforms periodic.Impulse and periodic.Sequence that extends support
for slowly updating side input patterns. (<a href="https://github.com/apache/beam/issues/23106">#23106</a>)</li>
-<li>Python SDK now requires <code>protobuf&gt;=4.21.1,&lt;4.23.0</code> and no longer supports protobuf 3.x. (<a href="https://github.com/apache/beam/pull/24599">#24599</a>)</li>
<li>Several Google client libraries in Python SDK dependency chain were updated to latest available major versions. (<a href="https://github.com/apache/beam/pull/24599">#24599</a>)</li>
</ul>
<h2 id="breaking-changes">Breaking Changes</h2>
@@ -46,8 +44,7 @@ for slowly updating side input patterns. (<a href="https://github.com/apache/
<h2 id="deprecations">Deprecations</h2>
<ul>
<li>Cloud Debugger support and its pipeline options are deprecated and will be removed in the next Beam version,
-in response to the Google Cloud Debugger service <a href="https://cloud.google.com/debugger/docs/deprecations">turning down</a>.
-(Java) (<a href="https://github.com/apache/beam/issues/25959">#25959</a>).</li>
+in response to the Google Cloud Debugger service <a href="https://cloud.google.com/debugger/docs/deprecations">turning down</a>. (Java) (<a href="https://github.com/apache/beam/issues/25959">#25959</a>).</li>
</ul>
<h2 id="bugfixes">Bugfixes</h2>
<ul>
diff --git a/website/generated-content/categories/blog/index.xml b/website/generated-content/categories/blog/index.xml
index 3141ad7cbc1..1497554f982 100644
--- a/website/generated-content/categories/blog/index.xml
+++ b/website/generated-content/categories/blog/index.xml
@@ -20,7 +20,6 @@ See the <a href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
</ul>
<h2 id="ios">I/Os</h2>
<ul>
-<li>Support for X source added (Java/Python) (<a href="https://github.com/apache/beam/issues/X">#X</a>).</li>
<li>BigQuery Storage Write API is now available in Python SDK via cross-language (<a href="https://github.com/apache/beam/issues/21961">#21961</a>).</li>
<li>Added HbaseIO support for writing RowMutations (ordered by rowkey) to Hbase (Java) (<a href="https://github.com/apache/beam/issues/25830">#25830</a>).</li>
<li>Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go) (<a href="https://github.com/apache/beam/issues/25779">#25779</a>).</li>
@@ -34,7 +33,6 @@ See the <a href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid excessive conversions.)</li>
<li>The Go SDK adds new transforms periodic.Impulse and periodic.Sequence that extends support
for slowly updating side input patterns. (<a href="https://github.com/apache/beam/issues/23106">#23106</a>)</li>
-<li>Python SDK now requires <code>protobuf&gt;=4.21.1,&lt;4.23.0</code> and no longer supports protobuf 3.x. (<a href="https://github.com/apache/beam/pull/24599">#24599</a>)</li>
<li>Several Google client libraries in Python SDK dependency chain were updated to latest available major versions. (<a href="https://github.com/apache/beam/pull/24599">#24599</a>)</li>
</ul>
<h2 id="breaking-changes">Breaking Changes</h2>
@@ -46,8 +44,7 @@ for slowly updating side input patterns. (<a href="https://github.com/apache/
<h2 id="deprecations">Deprecations</h2>
<ul>
<li>Cloud Debugger support and its pipeline options are deprecated and will be removed in the next Beam version,
-in response to the Google Cloud Debugger service <a href="https://cloud.google.com/debugger/docs/deprecations">turning down</a>.
-(Java) (<a href="https://github.com/apache/beam/issues/25959">#25959</a>).</li>
+in response to the Google Cloud Debugger service <a href="https://cloud.google.com/debugger/docs/deprecations">turning down</a>. (Java) (<a href="https://github.com/apache/beam/issues/25959">#25959</a>).</li>
</ul>
<h2 id="bugfixes">Bugfixes</h2>
<ul>
diff --git a/website/generated-content/categories/release/index.xml b/website/generated-content/categories/release/index.xml
index 5a060d64af7..f8c10f9efbf 100644
--- a/website/generated-content/categories/release/index.xml
+++ b/website/generated-content/categories/release/index.xml
@@ -20,7 +20,6 @@ See the <a href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
</ul>
<h2 id="ios">I/Os</h2>
<ul>
-<li>Support for X source added (Java/Python) (<a href="https://github.com/apache/beam/issues/X">#X</a>).</li>
<li>BigQuery Storage Write API is now available in Python SDK via cross-language (<a href="https://github.com/apache/beam/issues/21961">#21961</a>).</li>
<li>Added HbaseIO support for writing RowMutations (ordered by rowkey) to Hbase (Java) (<a href="https://github.com/apache/beam/issues/25830">#25830</a>).</li>
<li>Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go) (<a href="https://github.com/apache/beam/issues/25779">#25779</a>).</li>
@@ -34,7 +33,6 @@ See the <a href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid excessive conversions.)</li>
<li>The Go SDK adds new transforms periodic.Impulse and periodic.Sequence that extends support
for slowly updating side input patterns. (<a href="https://github.com/apache/beam/issues/23106">#23106</a>)</li>
-<li>Python SDK now requires <code>protobuf&gt;=4.21.1,&lt;4.23.0</code> and no longer supports protobuf 3.x. (<a href="https://github.com/apache/beam/pull/24599">#24599</a>)</li>
<li>Several Google client libraries in Python SDK dependency chain were updated to latest available major versions. (<a href="https://github.com/apache/beam/pull/24599">#24599</a>)</li>
</ul>
<h2 id="breaking-changes">Breaking Changes</h2>
@@ -46,8 +44,7 @@ for slowly updating side input patterns. (<a href="https://github.com/apache/
<h2 id="deprecations">Deprecations</h2>
<ul>
<li>Cloud Debugger support and its pipeline options are deprecated and will be removed in the next Beam version,
-in response to the Google Cloud Debugger service <a href="https://cloud.google.com/debugger/docs/deprecations">turning down</a>.
-(Java) (<a href="https://github.com/apache/beam/issues/25959">#25959</a>).</li>
+in response to the Google Cloud Debugger service <a href="https://cloud.google.com/debugger/docs/deprecations">turning down</a>. (Java) (<a href="https://github.com/apache/beam/issues/25959">#25959</a>).</li>
</ul>
<h2 id="bugfixes">Bugfixes</h2>
<ul>
diff --git a/website/generated-content/documentation/index.xml b/website/generated-content/documentation/index.xml
index 474d5e70824..10dd969163d 100644
--- a/website/generated-content/documentation/index.xml
+++ b/website/generated-content/documentation/index.xml
@@ -918,7 +918,7 @@ verifying some of the properties of your <code>BoundedSource</code> implem
can use <code>SourceTestUtils</code> to increase your implementation&rsquo;s test coverage
using a wide range of inputs with relatively few lines of code. For
examples that use <code>SourceTestUtils</code>, see the
-<a href="https://github.com/apache/beam/blob/master/sdks/java/core/src/test/java/org/apache/beam/sdk/io/AvroSourceTest.java">AvroSourceTest</a> and
+<a href="https://github.com/apache/beam/blob/master/sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/io/AvroSourceTest.java">AvroSourceTest</a> and
<a href="https://github.com/apache/beam/blob/master/sdks/java/core/src/test/java/org/apache/beam/sdk/io/TextIOReadTest.java">TextIOReadTest</a>
source code.</p>
</li>
@@ -1183,7 +1183,7 @@ sinks that interact with files, including:</p>
implementations for examples:</p>
<ul>
<li><a href="https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TextSink.java">TextSink</a> and</li>
-<li><a href="https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/AvroSink.java">AvroSink</a>.</li>
+<li><a href="https://github.com/apache/beam/blob/master/sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/AvroSink.java">AvroSink</a>.</li>
</ul>
<h2 id="ptransform-wrappers">PTransform wrappers</h2>
<p>When you create a source or sink that end-users will use, avoid exposing your
diff --git a/website/generated-content/documentation/io/connectors/index.html b/website/generated-content/documentation/io/connectors/index.html
index b2e42b338a6..93e9b4949be 100644
--- a/website/generated-content/documentation/io/connectors/index.html
+++ b/website/generated-content/documentation/io/connectors/index.html
@@ -23,7 +23,7 @@ function blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Documentation</span></li><li><a href=/documentation>Using the Documentation</a></li><li class=section-nav-item--collapsible><span class=section-nav-lis [...]
<a href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/FileIO.html>native</a></td><td class=present>✔
<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.io.fileio.html>native</a></td><td>Not available</td><td>Not available</td><td class=present>✔</td><td class=present>✔</td></tr><tr><td>AvroIO</td><td class=present>✔</td><td class=present>✔</td><td class=present>✔
-<a href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/AvroIO.html>native</a></td><td class=present>✔
+<a href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/extensions/avro/io/AvroIO.html>native</a></td><td class=present>✔
<a href=https://beam.apache.org/releases/pydoc/current/apache_beam.io.avroio.html>native</a></td><td class=present>✔
<a href=https://pkg.go.dev/github.com/apache/beam/sdks/v2/go/pkg/beam/io/avroio>native</a></td><td class=present>✔
<a href=https://github.com/apache/beam/blob/master/sdks/typescript/src/apache_beam/io/avroio.ts>via X-language</a></td><td class=present>✔</td><td class=present>✔</td></tr><tr><td>TextIO</td><td class=present>✔</td><td class=present>✔</td><td class=present>✔
diff --git a/website/generated-content/documentation/io/developing-io-java/index.html b/website/generated-content/documentation/io/developing-io-java/index.html
index 7dc884c3925..adfca5189b6 100644
--- a/website/generated-content/documentation/io/developing-io-java/index.html
+++ b/website/generated-content/documentation/io/developing-io-java/index.html
@@ -58,7 +58,7 @@ verifying some of the properties of your <code>BoundedSource</code> implementati
can use <code>SourceTestUtils</code> to increase your implementation’s test coverage
using a wide range of inputs with relatively few lines of code. For
examples that use <code>SourceTestUtils</code>, see the
-<a href=https://github.com/apache/beam/blob/master/sdks/java/core/src/test/java/org/apache/beam/sdk/io/AvroSourceTest.java>AvroSourceTest</a> and
+<a href=https://github.com/apache/beam/blob/master/sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/io/AvroSourceTest.java>AvroSourceTest</a> and
<a href=https://github.com/apache/beam/blob/master/sdks/java/core/src/test/java/org/apache/beam/sdk/io/TextIOReadTest.java>TextIOReadTest</a>
source code.</p></li></ol><p>In addition, see the <a href=/contribute/ptransform-style-guide/>PTransform style guide</a>
for Beam’s transform style guidance.</p><h2 id=implementing-the-source-interface>Implementing the Source interface</h2><p>To create a data source for your pipeline, you must provide the format-specific
@@ -194,7 +194,7 @@ and passes your <code>FileBasedSink</code> as a parameter. A user should not nee
call <code>WriteFiles</code> directly.</p></li></ul><p>The <code>FileBasedSink</code> abstract base class implements code that is common to Beam
sinks that interact with files, including:</p><ul><li>Setting file headers and footers</li><li>Sequential record writing</li><li>Setting the output MIME type</li></ul><p><code>FileBasedSink</code> and its subclasses support writing files to any Beam-supported
<code>FileSystem</code> implementations. See the following Beam-provided <code>FileBasedSink</code>
-implementations for examples:</p><ul><li><a href=https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TextSink.java>TextSink</a> and</li><li><a href=https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/AvroSink.java>AvroSink</a>.</li></ul><h2 id=ptransform-wrappers>PTransform wrappers</h2><p>When you create a source or sink that end-users will use, avoid exposing your
+implementations for examples:</p><ul><li><a href=https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TextSink.java>TextSink</a> and</li><li><a href=https://github.com/apache/beam/blob/master/sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/AvroSink.java>AvroSink</a>.</li></ul><h2 id=ptransform-wrappers>PTransform wrappers</h2><p>When you create a source or sink that end-users will use, avoid exposing your
source or sink code. To avoid exposing your sources and sinks to end-users, your
new classes should be protected or private. Then, implement a user-facing
wrapper <code>PTransform</code>. By exposing your source or sink as a transform, your
diff --git a/website/generated-content/documentation/io/io-standards/index.html b/website/generated-content/documentation/io/io-standards/index.html
index d672d2a717b..c12b49c811a 100644
--- a/website/generated-content/documentation/io/io-standards/index.html
+++ b/website/generated-content/documentation/io/io-standards/index.html
@@ -95,7 +95,7 @@ function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfi
BigQueryIO.write()
.withWriteConfig(StreamingInsertsConfig.withDetailedError()
- .withExactlyOnce().etc..)</code></pre></div></div></p></td></tr><tr><td><p>class IO.Write.withFormatFunction</td><td><p><strong>Discouraged - except for dynamic destinations</strong><p>For sources that can receive Beam Row-typed PCollections, the format function should not be necessary, because Beam should be able to format the input data based on its schema.<p>For sinks providing Dynamic Destination functionality, elements may carry data that helps dete [...]
+ .withExactlyOnce().etc..)</code></pre></div></div></p></td></tr><tr><td><p>class IO.Write.withFormatFunction</td><td><p><strong>Discouraged - except for dynamic destinations</strong><p>For sources that can receive Beam Row-typed PCollections, the format function should not be necessary, because Beam should be able to format the input data based on its schema.<p>For sinks providing Dynamic Destination functionality, elements may carry data that helps dete [...]
<a href=https://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/ml/orchestration/index.html b/website/generated-content/documentation/ml/orchestration/index.html
index e2aa0c72dcb..3f4509d6d17 100644
--- a/website/generated-content/documentation/ml/orchestration/index.html
+++ b/website/generated-content/documentation/ml/orchestration/index.html
@@ -139,7 +139,7 @@ implementation:
help="Beam runner: DataflowRunner or DirectRunner.",
default="DirectRunner")
- return parser.parse_args()</code></pre></div></div><p>The implementation of the <code>preprocess_dataset</code> function contains the Apache Beam pipeline code and the Beam pipeline options that select the runner. The executed preprocessing involves downloading the image bytes from their URL, converting them to a Torch Tensor, and resizing to the desired size. The caption undergoes a series of string manipulations to ensure that our model receives uniform image descriptions. Tokenizati [...]
+ return parser.parse_args()</code></pre></div></div><p>The implementation of the <code>preprocess_dataset</code> function contains the Apache Beam pipeline code and the Beam pipeline options that select the runner. The executed preprocessing involves downloading the image bytes from their URL, converting them to a Torch Tensor, and resizing to the desired size. The caption undergoes a series of string manipulations to ensure that our model receives uniform image descriptions. Tokenizati [...]
# workflow rely on global context (e.g., a module imported at module level).
pipeline_options = PipelineOptions(
runner=beam_runner,
diff --git a/website/generated-content/feed.xml b/website/generated-content/feed.xml
index 2e6dc21fc8f..9a327144a14 100644
--- a/website/generated-content/feed.xml
+++ b/website/generated-content/feed.xml
@@ -20,7 +20,6 @@ See the <a href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
</ul>
<h2 id="ios">I/Os</h2>
<ul>
-<li>Support for X source added (Java/Python) (<a href="https://github.com/apache/beam/issues/X">#X</a>).</li>
<li>BigQuery Storage Write API is now available in Python SDK via cross-language (<a href="https://github.com/apache/beam/issues/21961">#21961</a>).</li>
<li>Added HbaseIO support for writing RowMutations (ordered by rowkey) to Hbase (Java) (<a href="https://github.com/apache/beam/issues/25830">#25830</a>).</li>
<li>Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go) (<a href="https://github.com/apache/beam/issues/25779">#25779</a>).</li>
@@ -34,7 +33,6 @@ See the <a href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid excessive conversions.)</li>
<li>The Go SDK adds new transforms periodic.Impulse and periodic.Sequence that extends support
for slowly updating side input patterns. (<a href="https://github.com/apache/beam/issues/23106">#23106</a>)</li>
-<li>Python SDK now requires <code>protobuf&gt;=4.21.1,&lt;4.23.0</code> and no longer supports protobuf 3.x. (<a href="https://github.com/apache/beam/pull/24599">#24599</a>)</li>
<li>Several Google client libraries in Python SDK dependency chain were updated to latest available major versions. (<a href="https://github.com/apache/beam/pull/24599">#24599</a>)</li>
</ul>
<h2 id="breaking-changes">Breaking Changes</h2>
@@ -46,8 +44,7 @@ for slowly updating side input patterns. (<a href="https://github.com/apache/
<h2 id="deprecations">Deprecations</h2>
<ul>
<li>Cloud Debugger support and its pipeline options are deprecated and will be removed in the next Beam version,
-in response to the Google Cloud Debugger service <a href="https://cloud.google.com/debugger/docs/deprecations">turning down</a>.
-(Java) (<a href="https://github.com/apache/beam/issues/25959">#25959</a>).</li>
+in response to the Google Cloud Debugger service <a href="https://cloud.google.com/debugger/docs/deprecations">turning down</a>. (Java) (<a href="https://github.com/apache/beam/issues/25959">#25959</a>).</li>
</ul>
<h2 id="bugfixes">Bugfixes</h2>
<ul>
diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml
index 5e4020dd924..39665bc7809 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.47.0/</loc><lastmod>2023-05-15T08:35:42+02:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2023-05-15T08:35:42+02:00</lastmod></url><url><loc>/blog/</loc><lastmod>2023-05-15T08:35:42+02:00</lastmod></url><url><loc>/categories/</loc><lastmod>2023-05-15T08:35:42+02:00</lastmod></url><url><loc>/catego [...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.47.0/</loc><lastmod>2023-05-15T17:56:33+02:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2023-05-15T17:56:33+02:00</lastmod></url><url><loc>/blog/</loc><lastmod>2023-05-15T17:56:33+02:00</lastmod></url><url><loc>/categories/</loc><lastmod>2023-05-15T17:56:33+02:00</lastmod></url><url><loc>/catego [...]
\ No newline at end of file