You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2023/05/11 10:02:40 UTC
[GitHub] [beam-starter-go] dependabot[bot] opened a new pull request, #14: Bump github.com/apache/beam/sdks/v2 from 2.46.0 to 2.47.0
dependabot[bot] opened a new pull request, #14:
URL: https://github.com/apache/beam-starter-go/pull/14
Bumps [github.com/apache/beam/sdks/v2](https://github.com/apache/beam) from 2.46.0 to 2.47.0.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/apache/beam/releases">github.com/apache/beam/sdks/v2's releases</a>.</em></p>
<blockquote>
<h2>Beam 2.47.0 release</h2>
<p>We are happy to present the new 2.47.0 release of Beam.
This release includes both improvements and new functionality.
See the <a href="https://beam.apache.org/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page</a> for this release.</p>
<p>For more information on changes in 2.47.0, check out the <a href="https://github.com/apache/beam/milestone/10">detailed release notes</a>.</p>
<h2>Highlights</h2>
<ul>
<li>Apache Beam adds Python 3.11 support (<a href="https://redirect.github.com/apache/beam/issues/23848">#23848</a>).</li>
</ul>
<h2>I/Os</h2>
<ul>
<li>Support for X source added (Java/Python) (<a href="https://github.com/apache/beam/issues/X">#X</a>).</li>
<li>BigQuery Storage Write API is now available in Python SDK via cross-language (<a href="https://redirect.github.com/apache/beam/issues/21961">#21961</a>).</li>
<li>Added HbaseIO support for writing RowMutations (ordered by rowkey) to Hbase (Java) (<a href="https://redirect.github.com/apache/beam/issues/25830">#25830</a>).</li>
<li>Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go) (<a href="https://redirect.github.com/apache/beam/issues/25779">#25779</a>).</li>
<li>Add integration test for JmsIO + fix issue with multiple connections (Java) (<a href="https://redirect.github.com/apache/beam/issues/25887">#25887</a>).</li>
</ul>
<h2>New Features / Improvements</h2>
<ul>
<li>The Flink runner now supports Flink 1.16.x (<a href="https://redirect.github.com/apache/beam/issues/25046">#25046</a>).</li>
<li>Schema'd PTransforms can now be directly applied to Beam dataframes just like PCollections.
(Note that when doing multiple operations, it may be more efficient to explicitly chain the operations
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid excessive conversions.)</li>
<li>The Go SDK adds new transforms periodic.Impulse and periodic.Sequence that extends support
for slowly updating side input patterns. (<a href="https://redirect.github.com/apache/beam/issues/23106">#23106</a>)</li>
<li>Python SDK now requires <code>protobuf>=4.21.1,<4.23.0</code> and no longer supports protobuf 3.x. (<a href="https://redirect.github.com/apache/beam/pull/24599">#24599</a>)</li>
<li>Several Google client libraries in Python SDK dependency chain were updated to latest available major versions. (<a href="https://redirect.github.com/apache/beam/pull/24599">#24599</a>)</li>
</ul>
<h2>Breaking Changes</h2>
<ul>
<li>If a main session fails to load, the pipeline will now fail at worker startup. (<a href="https://redirect.github.com/apache/beam/issues/25401">#25401</a>).</li>
<li>Python pipeline options will now ignore unparsed command line flags prefixed with a single dash. (<a href="https://redirect.github.com/apache/beam/issues/25943">#25943</a>).</li>
<li>The SmallestPerKey combiner now requires keyword-only arguments for specifying optional parameters, such as <code>key</code> and <code>reverse</code>. (<a href="https://redirect.github.com/apache/beam/issues/25888">#25888</a>).</li>
</ul>
<h2>Deprecations</h2>
<ul>
<li>Cloud Debugger support and its pipeline options are deprecated and will be removed in the next Beam version,
in response to the Google Cloud Debugger service <a href="https://cloud.google.com/debugger/docs/deprecations">turning down</a>.
(Java) (<a href="https://redirect.github.com/apache/beam/issues/25959">#25959</a>).</li>
</ul>
<h2>Bugfixes</h2>
<ul>
<li>BigQuery sink in STORAGE_WRITE_API mode in batch pipelines might result in data consistency issues during the handling of other unrelated transient errors for Beam SDKs 2.35.0 - 2.46.0 (inclusive). For more details see: <a href="https://redirect.github.com/apache/beam/issues/26521">apache/beam#26521</a></li>
</ul>
<h2>List of Contributors</h2>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md">github.com/apache/beam/sdks/v2's changelog</a>.</em></p>
<blockquote>
<h1>[2.47.0] - 2023-05-10</h1>
<h2>Highlights</h2>
<ul>
<li>Apache Beam adds Python 3.11 support (<a href="https://redirect.github.com/apache/beam/issues/23848">#23848</a>).</li>
</ul>
<h2>I/Os</h2>
<ul>
<li>BigQuery Storage Write API is now available in Python SDK via cross-language (<a href="https://redirect.github.com/apache/beam/issues/21961">#21961</a>).</li>
<li>Added HbaseIO support for writing RowMutations (ordered by rowkey) to Hbase (Java) (<a href="https://redirect.github.com/apache/beam/issues/25830">#25830</a>).</li>
<li>Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go) (<a href="https://redirect.github.com/apache/beam/issues/25779">#25779</a>).</li>
<li>Add integration test for JmsIO + fix issue with multiple connections (Java) (<a href="https://redirect.github.com/apache/beam/issues/25887">#25887</a>).</li>
</ul>
<h2>New Features / Improvements</h2>
<ul>
<li>The Flink runner now supports Flink 1.16.x (<a href="https://redirect.github.com/apache/beam/issues/25046">#25046</a>).</li>
<li>Schema'd PTransforms can now be directly applied to Beam dataframes just like PCollections.
(Note that when doing multiple operations, it may be more efficient to explicitly chain the operations
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid excessive conversions.)</li>
<li>The Go SDK adds new transforms periodic.Impulse and periodic.Sequence that extends support
for slowly updating side input patterns. (<a href="https://redirect.github.com/apache/beam/issues/23106">#23106</a>)</li>
<li>Python SDK now requires <code>protobuf>=4.21.1,<4.23.0</code> and no longer supports protobuf 3.x. (<a href="https://redirect.github.com/apache/beam/pull/24599">#24599</a>)</li>
<li>Several Google client libraries in Python SDK dependency chain were updated to latest available major versions. (<a href="https://redirect.github.com/apache/beam/pull/24599">#24599</a>)</li>
</ul>
<h2>Breaking Changes</h2>
<ul>
<li>If a main session fails to load, the pipeline will now fail at worker startup. (<a href="https://redirect.github.com/apache/beam/issues/25401">#25401</a>).</li>
<li>Python pipeline options will now ignore unparsed command line flags prefixed with a single dash. (<a href="https://redirect.github.com/apache/beam/issues/25943">#25943</a>).</li>
<li>The SmallestPerKey combiner now requires keyword-only arguments for specifying optional parameters, such as <code>key</code> and <code>reverse</code>. (<a href="https://redirect.github.com/apache/beam/issues/25888">#25888</a>).</li>
</ul>
<h2>Deprecations</h2>
<ul>
<li>Cloud Debugger support and its pipeline options are deprecated and will be removed in the next Beam version,
in response to the Google Cloud Debugger service <a href="https://cloud.google.com/debugger/docs/deprecations">turning down</a>.
(Java) (<a href="https://redirect.github.com/apache/beam/issues/25959">#25959</a>).</li>
</ul>
<h2>Bugfixes</h2>
<ul>
<li>BigQuery sink in STORAGE_WRITE_API mode in batch pipelines could result in data consistency issues during the handling of other unrelated transient errors for Beam SDKs 2.35.0 - 2.46.0 (inclusive). For more details see: <a href="https://redirect.github.com/apache/beam/issues/26521">apache/beam#26521</a></li>
</ul>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/apache/beam/commit/5772bf74cbe556277976e4883b27e37b7a7e87f0"><code>5772bf7</code></a> Set version for 2.47.0 RC3</li>
<li><a href="https://github.com/apache/beam/commit/0b1b07398cf139ee0824a75c6ac1c9d3b49616ce"><code>0b1b073</code></a> Increase streaming wordcount IT timeout again (<a href="https://redirect.github.com/apache/beam/issues/26554">#26554</a>) (<a href="https://redirect.github.com/apache/beam/issues/26558">#26558</a>)</li>
<li><a href="https://github.com/apache/beam/commit/d28c5570bd70b648f8f85a04e2f335402a14394b"><code>d28c557</code></a> Add Gradle sub-projects to enable parallel running of Kafka tests (<a href="https://redirect.github.com/apache/beam/issues/26153">#26153</a>) (#...</li>
<li><a href="https://github.com/apache/beam/commit/e80e46a00d0de562672d501afa2e11c4a77e625a"><code>e80e46a</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/26503">#26503</a>: fix dataloss bug in batch Storage API sink. (<a href="https://redirect.github.com/apache/beam/issues/26512">#26512</a>)</li>
<li><a href="https://github.com/apache/beam/commit/a486f513bce2b7e867adbe012fab795f12578e69"><code>a486f51</code></a> Push containers for python 3.10 and 3.11 (<a href="https://redirect.github.com/apache/beam/issues/26551">#26551</a>)</li>
<li><a href="https://github.com/apache/beam/commit/a5bae0dd1d3dbabcde5d26d161266d9f0e688978"><code>a5bae0d</code></a> Bump streaming test timeouts (<a href="https://redirect.github.com/apache/beam/issues/26489">#26489</a>) (<a href="https://redirect.github.com/apache/beam/issues/26499">#26499</a>)</li>
<li><a href="https://github.com/apache/beam/commit/3d9b6121637b48b5300f980f5d6ee7d333e35a09"><code>3d9b612</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/26446">#26446</a> from AnandInguva/protobuf-version (<a href="https://redirect.github.com/apache/beam/issues/26449">#26449</a>)</li>
<li><a href="https://github.com/apache/beam/commit/0f12dfde09e145de3411ef2a1da04cf030eac260"><code>0f12dfd</code></a> Cherry-pick: Add driverJars parameter to JdbcIO. (<a href="https://redirect.github.com/apache/beam/issues/25824">#25824</a>) (<a href="https://redirect.github.com/apache/beam/issues/26474">#26474</a>)</li>
<li><a href="https://github.com/apache/beam/commit/4d1f1f19086d80bb809f76ab8cd7d409bafe122e"><code>4d1f1f1</code></a> Implement naive progress tracking at BoundedSourceAsSDFRestrictionTracker (<a href="https://redirect.github.com/apache/beam/issues/2">#2</a>...</li>
<li><a href="https://github.com/apache/beam/commit/f5ba38f5556c68e08fe51af3cd4b1a504f78d67d"><code>f5ba38f</code></a> [BEAM-26359] Avoid expensive AsList in FileWrites. (<a href="https://redirect.github.com/apache/beam/issues/26360">#26360</a>)</li>
<li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.46.0...v2.47.0">compare view</a></li>
</ul>
</details>
<br />
[](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam-starter-go] damccorm merged pull request #14: Bump github.com/apache/beam/sdks/v2 from 2.46.0 to 2.47.0
Posted by "damccorm (via GitHub)" <gi...@apache.org>.
damccorm merged PR #14:
URL: https://github.com/apache/beam-starter-go/pull/14
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org