You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/07/14 01:14:34 UTC
[GitHub] [beam-starter-python] dependabot[bot] opened a new pull request, #5: Bump apache-beam from 2.39.0 to 2.40.0
dependabot[bot] opened a new pull request, #5:
URL: https://github.com/apache/beam-starter-python/pull/5
Bumps [apache-beam](https://github.com/apache/beam) from 2.39.0 to 2.40.0.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/apache/beam/releases">apache-beam's releases</a>.</em></p>
<blockquote>
<h2>v2.40.0</h2>
<p>We are happy to present the new 2.40.0 release of Beam.
This release includes both improvements and new functionality.
See the <a href="https://beam.apache.org/get-started/downloads/#2400-2022-06-25">download page</a> for this
release.</p>
<p>For more information on changes in 2.40.0 check out the <a href="https://github.com/apache/beam/releases/tag/v2.40.0">detailed release notes</a>.</p>
<h2>Highlights</h2>
<ul>
<li>Added <a href="https://s.apache.org/inference-sklearn-pytorch">RunInference</a> API, a framework agnostic transform for inference. With this release, PyTorch and Scikit-learn are supported by the transform.
See also example at apache_beam/examples/inference/pytorch_image_classification.py</li>
</ul>
<h2>I/Os</h2>
<ul>
<li>Upgraded to Hive 3.1.3 for HCatalogIO. Users can still provide their own version of Hive. (Java) (<a href="https://github-redirect.dependabot.com/apache/beam/issues/19554">Issue-19554</a>).</li>
</ul>
<h2>New Features / Improvements</h2>
<ul>
<li>Go SDK users can now use generic registration functions to optimize their DoFn execution. (<a href="https://issues.apache.org/jira/browse/BEAM-14347">BEAM-14347</a>)</li>
<li>Go SDK users may now write self-checkpointing Splittable DoFns to read from streaming sources. (<a href="https://issues.apache.org/jira/browse/BEAM-11104">BEAM-11104</a>)</li>
<li>Go SDK textio Reads have been moved to Splittable DoFns exclusively. (<a href="https://issues.apache.org/jira/browse/BEAM-14489">BEAM-14489</a>)</li>
<li>Pipeline drain support added for Go SDK has now been tested. (<a href="https://issues.apache.org/jira/browse/BEAM-11106">BEAM-11106</a>)</li>
<li>Go SDK users can now see heap usage, sideinput cache stats, and active process bundle stats in Worker Status. (<a href="https://issues.apache.org/jira/browse/BEAM-13829">BEAM-13829</a>)</li>
<li>The serialization (pickling) library for Python is dill==0.3.1.1 (<a href="https://issues.apache.org/jira/browse/BEAM-11167">BEAM-11167</a>)</li>
</ul>
<h2>Breaking Changes</h2>
<ul>
<li>The Go Sdk now requires a minimum version of 1.18 in order to support generics (<a href="https://issues.apache.org/jira/browse/BEAM-14347">BEAM-14347</a>).</li>
<li>synthetic.SourceConfig field types have changed to int64 from int for better compatibility with Flink's use of Logical types in Schemas (Go) (<a href="https://issues.apache.org/jira/browse/BEAM-14173">BEAM-14173</a>)</li>
<li>Default coder updated to compress sources used with <code>BoundedSourceAsSDFWrapperFn</code> and <code>UnboundedSourceAsSDFWrapper</code>.</li>
</ul>
<h2>Bugfixes</h2>
<ul>
<li>Fixed X (Java/Python) (<a href="https://issues.apache.org/jira/browse/BEAM-X">BEAM-X</a>).</li>
<li>Fixed Java expansion service to allow specific files to stage (<a href="https://issues.apache.org/jira/browse/BEAM-14160">BEAM-14160</a>).</li>
<li>Fixed Elasticsearch connection when using both ssl and username/password (Java) (<a href="https://issues.apache.org/jira/browse/BEAM-14000">BEAM-14000</a>)</li>
</ul>
<h2>Detailed list of PRs</h2>
<ul>
<li>[BEAM-14048] [CdapIO] Add ConfigWrapper for building CDAP PluginConfigs by <a href="https://github.com/Amar3tto"><code>@Amar3tto</code></a> in <a href="https://github-redirect.dependabot.com/apache/beam/pull/17051">apache/beam#17051</a></li>
<li>[BEAM-14196] add test verifying output watermark propagation in bundle by <a href="https://github.com/je-ik"><code>@je-ik</code></a> in <a href="https://github-redirect.dependabot.com/apache/beam/pull/17504">apache/beam#17504</a></li>
<li>Move master readme.md to 2.40.0 by <a href="https://github.com/y1chi"><code>@y1chi</code></a> in <a href="https://github-redirect.dependabot.com/apache/beam/pull/17552">apache/beam#17552</a></li>
<li>[BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink by <a href="https://github.com/lostluck"><code>@lostluck</code></a> in <a href="https://github-redirect.dependabot.com/apache/beam/pull/17554">apache/beam#17554</a></li>
<li>Upgrade python sdk container requirements. by <a href="https://github.com/y1chi"><code>@y1chi</code></a> in <a href="https://github-redirect.dependabot.com/apache/beam/pull/17549">apache/beam#17549</a></li>
<li>[BEAM-11205] Update Libraries BOM dependencies to version 25.2.0 by <a href="https://github.com/benWize"><code>@benWize</code></a> in <a href="https://github-redirect.dependabot.com/apache/beam/pull/17497">apache/beam#17497</a></li>
<li>[BEAM-12603] Add retry on grpc data channel and remove retry from test. by <a href="https://github.com/y1chi"><code>@y1chi</code></a> in <a href="https://github-redirect.dependabot.com/apache/beam/pull/17537">apache/beam#17537</a></li>
<li>[BEAM-14303] Add a way to exclude output timestamp watermark holds by <a href="https://github.com/reuvenlax"><code>@reuvenlax</code></a> in <a href="https://github-redirect.dependabot.com/apache/beam/pull/17359">apache/beam#17359</a></li>
<li>[BEAM-14347] Allow users to optimize DoFn execution with a single generic registration function by <a href="https://github.com/damccorm"><code>@damccorm</code></a> in <a href="https://github-redirect.dependabot.com/apache/beam/pull/17429">apache/beam#17429</a></li>
<li>[BEAM-5878] Add (failing) kwonly-argument test by <a href="https://github.com/TheNeuralBit"><code>@TheNeuralBit</code></a> in <a href="https://github-redirect.dependabot.com/apache/beam/pull/17509">apache/beam#17509</a></li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md">apache-beam's changelog</a>.</em></p>
<blockquote>
<h1>[2.40.0] - 2022-06-25</h1>
<h2>Highlights</h2>
<ul>
<li>Added <a href="https://s.apache.org/inference-sklearn-pytorch">RunInference</a> API, a framework agnostic transform for inference. With this release, PyTorch and Scikit-learn are supported by the transform.
See also example at apache_beam/examples/inference/pytorch_image_classification.py</li>
</ul>
<h2>I/Os</h2>
<ul>
<li>Upgraded to Hive 3.1.3 for HCatalogIO. Users can still provide their own version of Hive. (Java) (<a href="https://github-redirect.dependabot.com/apache/beam/issues/19554">Issue-19554</a>).</li>
</ul>
<h2>New Features / Improvements</h2>
<ul>
<li>Go SDK users can now use generic registration functions to optimize their DoFn execution. (<a href="https://issues.apache.org/jira/browse/BEAM-14347">BEAM-14347</a>)</li>
<li>Go SDK users may now write self-checkpointing Splittable DoFns to read from streaming sources. (<a href="https://issues.apache.org/jira/browse/BEAM-11104">BEAM-11104</a>)</li>
<li>Go SDK textio Reads have been moved to Splittable DoFns exclusively. (<a href="https://issues.apache.org/jira/browse/BEAM-14489">BEAM-14489</a>)</li>
<li>Pipeline drain support added for Go SDK has now been tested. (<a href="https://issues.apache.org/jira/browse/BEAM-11106">BEAM-11106</a>)</li>
<li>Go SDK users can now see heap usage, sideinput cache stats, and active process bundle stats in Worker Status. (<a href="https://issues.apache.org/jira/browse/BEAM-13829">BEAM-13829</a>)</li>
</ul>
<h2>Breaking Changes</h2>
<ul>
<li>The Go Sdk now requires a minimum version of 1.18 in order to support generics (<a href="https://issues.apache.org/jira/browse/BEAM-14347">BEAM-14347</a>).</li>
<li>synthetic.SourceConfig field types have changed to int64 from int for better compatibility with Flink's use of Logical types in Schemas (Go) (<a href="https://issues.apache.org/jira/browse/BEAM-14173">BEAM-14173</a>)</li>
<li>Default coder updated to compress sources used with <code>BoundedSourceAsSDFWrapperFn</code> and <code>UnboundedSourceAsSDFWrapper</code>.</li>
</ul>
<h2>Bugfixes</h2>
<ul>
<li>Fixed Java expansion service to allow specific files to stage (<a href="https://issues.apache.org/jira/browse/BEAM-14160">BEAM-14160</a>).</li>
<li>Fixed Elasticsearch connection when using both ssl and username/password (Java) (<a href="https://issues.apache.org/jira/browse/BEAM-14000">BEAM-14000</a>)</li>
</ul>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/apache/beam/commit/b95cc45cda8608ea1cae47c25c0f6c61a2e2448b"><code>b95cc45</code></a> Set version for 2.40.0 RC2</li>
<li><a href="https://github.com/apache/beam/commit/313f0393b5feaabd01ccda7b90271dbda092b6e4"><code>313f039</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/apache/beam/issues/22007">#22007</a> from [release-2.40.0] Fix FlatMap numpy array bug</li>
<li><a href="https://github.com/apache/beam/commit/92a57ce09848ff7753c55d93d31be2a95fcd0b58"><code>92a57ce</code></a> Fix flatmap bug</li>
<li><a href="https://github.com/apache/beam/commit/52834cddcd018cc6e72c8c38699b1ef31c792274"><code>52834cd</code></a> Add failing test</li>
<li><a href="https://github.com/apache/beam/commit/882b6083b35085e5af5795ebc1d568b8c889b837"><code>882b608</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/apache/beam/issues/21944">#21944</a> from [cherry-pick][release-2.40.0][21941] Fix no ou...</li>
<li><a href="https://github.com/apache/beam/commit/c85af812a924aaa7ecf52c2e1e0626f6565f2e26"><code>c85af81</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/apache/beam/issues/21940">#21940</a> from [21941] Fix no output timestamp case</li>
<li><a href="https://github.com/apache/beam/commit/6afcb5bbc712595e4a024b884ef4cf17165ea878"><code>6afcb5b</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/apache/beam/issues/21938">#21938</a> from [cherry-pick][release-2.40.0] BigQueryIO: Addi...</li>
<li><a href="https://github.com/apache/beam/commit/12d0fe45d95758de5a0b6be7f69c9fb404b673e2"><code>12d0fe4</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/apache/beam/issues/21936">#21936</a> from [cherry-pick][release-2.40.0][Fixes <a href="https://github-redirect.dependabot.com/apache/beam/issues/21927">#21927</a>] Co...</li>
<li><a href="https://github.com/apache/beam/commit/91ae5bebe559ccdf45ad00d911259534c12931e3"><code>91ae5be</code></a> BigQueryIO: Adding the BASIC view setting to getTable request (<a href="https://github-redirect.dependabot.com/apache/beam/issues/21879">#21879</a>)</li>
<li><a href="https://github.com/apache/beam/commit/1cb7eb682cc3ba9dace1685ba46be4b40c45d185"><code>1cb7eb6</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/apache/beam/issues/21928">#21928</a> from [Fixes <a href="https://github-redirect.dependabot.com/apache/beam/issues/21927">#21927</a>] Compress (Un)BoundedSourceAsSdf...</li>
<li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.39.0...v2.40.0">compare view</a></li>
</ul>
</details>
<br />
[](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam-starter-python] dependabot[bot] commented on pull request #5: Bump apache-beam from 2.39.0 to 2.40.0
Posted by GitBox <gi...@apache.org>.
dependabot[bot] commented on PR #5:
URL: https://github.com/apache/beam-starter-python/pull/5#issuecomment-1225672748
Superseded by #7.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam-starter-python] dependabot[bot] closed pull request #5: Bump apache-beam from 2.39.0 to 2.40.0
Posted by GitBox <gi...@apache.org>.
dependabot[bot] closed pull request #5: Bump apache-beam from 2.39.0 to 2.40.0
URL: https://github.com/apache/beam-starter-python/pull/5
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org