You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2023/03/13 02:14:03 UTC
[GitHub] [beam-starter-java] dependabot[bot] opened a new pull request, #54: Bump beam-runners-direct-java from 2.44.0 to 2.46.0
dependabot[bot] opened a new pull request, #54:
URL: https://github.com/apache/beam-starter-java/pull/54
Bumps [beam-runners-direct-java](https://github.com/apache/beam) from 2.44.0 to 2.46.0.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/apache/beam/releases">beam-runners-direct-java's releases</a>.</em></p>
<blockquote>
<h2>Beam 2.45.0 release</h2>
<p>We are happy to present the new 2.45.0 release of Beam.
This release includes both improvements and new functionality.
See the <a href="https://beam.apache.org/get-started/downloads/#2430-2023-01-13">download page</a> for this release.</p>
<p>For more information on changes in 2.45.0, check out the <a href="https://github.com/apache/beam/milestone/8?closed=1">detailed release notes</a>.</p>
<h2>I/Os</h2>
<ul>
<li>MongoDB IO connector added (Go) (<a href="https://redirect.github.com/apache/beam/issues/24575">#24575</a>).</li>
</ul>
<h2>New Features / Improvements</h2>
<ul>
<li>RunInference Wrapper with Sklearn Model Handler support added in Go SDK (<a href="https://redirect.github.com/apache/beam/issues/23382">#24497</a>).</li>
<li>Adding override of allowed TLS algorithms (Java), now maintaining the disabled/legacy algorithms
present in 2.43.0 (up to 1.8.0_342, 11.0.16, 17.0.2 for respective Java versions). This is accompanied
by an explicit re-enabling of TLSv1 and TLSv1.1 for Java 8 and Java 11.</li>
<li>Add UDF metrics support for Samza portable mode.</li>
</ul>
<h2>Breaking Changes</h2>
<ul>
<li>Portable Java pipelines, Go pipelines, Python streaming pipelines, and portable Python batch
pipelines on Dataflow are required to use Runner V2. The <code>disable_runner_v2</code>,
<code>disable_runner_v2_until_2023</code>, <code>disable_prime_runner_v2</code> experiments will raise an error during
pipeline construction. You can no longer specify the Dataflow worker jar override. Note that
non-portable Java jobs and non-portable Python batch jobs are not impacted. (<a href="https://redirect.github.com/apache/beam/issues/24515">#24515</a>).</li>
</ul>
<h2>Bugfixes</h2>
<ul>
<li>Avoids Cassandra syntax error when user-defined query has no where clause in it (Java) (<a href="https://redirect.github.com/apache/beam/issues/24829">#24829</a>).</li>
<li>Fixed JDBC connection failures (Java) during handshake due to deprecated TLSv1(.1) protocol for the JDK. (<a href="https://redirect.github.com/apache/beam/issues/24623">#24623</a>)</li>
<li>Fixed Python BigQuery Batch Load write may truncate valid data when deposition sets to WRITE_TRUNCATE and incoming data is large (Python) (<a href="https://redirect.github.com/apache/beam/issues/24535">#24623</a>).</li>
<li>Fixed Kafka watermark issue with sparse data on many partitions (<a href="https://redirect.github.com/apache/beam/pull/24205">#24205</a>)</li>
</ul>
<h2>List of Contributors</h2>
<p>According to git shortlog, the following people contributed to the 2.45.0 release. Thank you to all contributors!</p>
<p>AdalbertMemSQL</p>
<p>Ahmed Abualsaud</p>
<p>Ahmet Altay</p>
<p>Alexey Romanenko</p>
<p>Anand Inguva</p>
<p>Andrea Nardelli</p>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md">beam-runners-direct-java's changelog</a>.</em></p>
<blockquote>
<h1>[2.46.0] - Unreleased</h1>
<h2>Highlights</h2>
<ul>
<li>Java SDK containers migrated to <a href="https://hub.docker.com/_/eclipse-temurin">Eclipse Temurin</a>
as a base. This change migrates away from the deprecated <a href="https://hub.docker.com/_/openjdk">OpenJDK</a>
container. Eclipse Temurin is currently based upon Ubuntu 22.04 while the OpenJDK
container was based upon Debian 11.</li>
<li>RunInference PTransform will accept model paths as SideInputs in Python SDK. (<a href="https://redirect.github.com/apache/beam/issues/24042">#24042</a>)</li>
<li>RunInference supports ONNX runtime in Python SDK (<a href="https://redirect.github.com/apache/beam/issues/22972">#22972</a>)</li>
<li>Tensorflow Model Handler for RunInference in Python SDK (<a href="https://redirect.github.com/apache/beam/issues/25366">#25366</a>)</li>
<li>Java SDK modules migrated to use <code>:sdks:java:extensions:avro</code> (<a href="https://redirect.github.com/apache/beam/issues/24748">#24748</a>)</li>
</ul>
<h2>I/Os</h2>
<ul>
<li>Added in JmsIO a retry policy for failed publications (Java) (<a href="https://redirect.github.com/apache/beam/issues/24971">#24971</a>).</li>
<li>Support for <code>LZMA</code> compression/decompression of text files added to the Python SDK (<a href="https://redirect.github.com/apache/beam/issues/25316">#25316</a>)</li>
<li>Added ReadFrom/WriteTo Csv/Json as top-level transforms to the Python SDK.</li>
</ul>
<h2>New Features / Improvements</h2>
<ul>
<li>Add UDF metrics support for Samza portable mode.</li>
<li>Option for SparkRunner to avoid the need of SDF output to fit in memory (<a href="https://redirect.github.com/apache/beam/issues/23852">#23852</a>).
This helps e.g. with ParquetIO reads. Turn the feature on by adding experiment <code>use_bounded_concurrent_output_for_sdf</code>.</li>
<li>Add <code>WatchFilePattern</code> transform, which can be used as a side input to the RunInference PTransfrom to watch for model updates using a file pattern. (<a href="https://redirect.github.com/apache/beam/issues/24042">#24042</a>)</li>
<li>Add support for loading TorchScript models with <code>PytorchModelHandler</code>. The TorchScript model path can be
passed to PytorchModelHandler using <code>torch_script_model_path=<path_to_model></code>. (<a href="https://redirect.github.com/apache/beam/pull/25321">#25321</a>)</li>
<li>The Go SDK now requires Go 1.19 to build. (<a href="https://redirect.github.com/apache/beam/pull/25545">#25545</a>)</li>
<li>The Go SDK now has an initial native Go implementation of a portable Beam Runner called Prism. (<a href="https://redirect.github.com/apache/beam/pull/24789">#24789</a>)
<ul>
<li>For more details and current state see <a href="https://github.com/apache/beam/tree/master/sdks/go/pkg/beam/runners/prism">https://github.com/apache/beam/tree/master/sdks/go/pkg/beam/runners/prism</a>.</li>
</ul>
</li>
</ul>
<h2>Breaking Changes</h2>
<ul>
<li>The deprecated SparkRunner for Spark 2 (see <a href="https://github.com/apache/beam/blob/master/#2410---2022-08-23">2.41.0</a>) was removed (<a href="https://redirect.github.com/apache/beam/pull/25263">#25263</a>).</li>
<li>Python's BatchElements performs more aggressive batching in some cases,
capping at 10 second rather than 1 second batches by default and excluding
fixed cost in this computation to better handle cases where the fixed cost
is larger than a single second. To get the old behavior, one can pass
<code>target_batch_duration_secs_including_fixed_cost=1</code> to BatchElements.</li>
</ul>
<h2>Deprecations</h2>
<ul>
<li>Avro related classes are deprecated in module <code>beam-sdks-java-core</code> and will be eventually removed. Please, migrate to a new module <code>beam-sdks-java-extensions-avro</code> instead by importing the classes from <code>org.apache.beam.sdk.extensions.avro</code> package.
For the sake of migration simplicity, the relative package path and the whole class hierarchy of Avro related classes in new module is preserved the same as it was before.
For example, import <code>org.apache.beam.sdk.extensions.avro.coders.AvroCoder</code> class instead of<code>org.apache.beam.sdk.coders.AvroCoder</code>. (<a href="https://redirect.github.com/apache/beam/issues/24749">#24749</a>).</li>
</ul>
<h2>Bugfixes</h2>
<ul>
<li>Fixed X (Java/Python) (<a href="https://github.com/apache/beam/issues/X">#X</a>).</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/apache/beam/commit/0938c0ffce64565b6f186f081e00bd6ad1d128ec"><code>0938c0f</code></a> Set version for 2.46.0 RC1</li>
<li><a href="https://github.com/apache/beam/commit/872d845582caba7ef5b3ea6fa69566696a4d58cb"><code>872d845</code></a> Move beam to 2.46 on release branch for ts (<a href="https://redirect.github.com/apache/beam/issues/25662">#25662</a>)</li>
<li><a href="https://github.com/apache/beam/commit/8414cada7869a8eab715b5678ce648cc0253fa50"><code>8414cad</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/25618">#25618</a>: Cherry Pick: Prioritise Avro providers from "exten...</li>
<li><a href="https://github.com/apache/beam/commit/5f870679918f6daea8c59aa3aced5626181717f2"><code>5f87067</code></a> Prioritise Avro providers from "extensions/core" (<a href="https://redirect.github.com/apache/beam/issues/25611">#25611</a>)</li>
<li><a href="https://github.com/apache/beam/commit/695e40d2ce91edd724e655353ad255bec99bf8b8"><code>695e40d</code></a> Set Dataflow container to release version.</li>
<li><a href="https://github.com/apache/beam/commit/4ce8eeda19699cc64ae8cf310267a478cfe9e4b8"><code>4ce8eed</code></a> Read API Source v2 (<a href="https://redirect.github.com/apache/beam/issues/25392">#25392</a>)</li>
<li><a href="https://github.com/apache/beam/commit/93c1e92f371267d61bd4bedcf88ffc65a12f3602"><code>93c1e92</code></a> Add anchor link for the logo wall (<a href="https://redirect.github.com/apache/beam/issues/25594">#25594</a>)</li>
<li><a href="https://github.com/apache/beam/commit/2e7584cc43a5d7c603b99972f4ef04f302a8e083"><code>2e7584c</code></a> Add Data Sampling capability URN to Java SDK (<a href="https://redirect.github.com/apache/beam/issues/25593">#25593</a>)</li>
<li><a href="https://github.com/apache/beam/commit/50e5d728fc1b435e23a5b4484f43386de21b6b7f"><code>50e5d72</code></a> ML model evaluation website page (<a href="https://redirect.github.com/apache/beam/issues/25589">#25589</a>)</li>
<li><a href="https://github.com/apache/beam/commit/cebe23b37e25bf385ff0135729f4eb253ec29d70"><code>cebe23b</code></a> Bump github.com/aws/aws-sdk-go from 1.33.0 to 1.34.0 in /sdks (<a href="https://redirect.github.com/apache/beam/issues/25469">#25469</a>)</li>
<li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.44.0...v2.46.0">compare view</a></li>
</ul>
</details>
<br />
[](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam-starter-java] dependabot[bot] closed pull request #54: Bump beam-runners-direct-java from 2.44.0 to 2.46.0
Posted by "dependabot[bot] (via GitHub)" <gi...@apache.org>.
dependabot[bot] closed pull request #54: Bump beam-runners-direct-java from 2.44.0 to 2.46.0
URL: https://github.com/apache/beam-starter-java/pull/54
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam-starter-java] dependabot[bot] commented on pull request #54: Bump beam-runners-direct-java from 2.44.0 to 2.46.0
Posted by "dependabot[bot] (via GitHub)" <gi...@apache.org>.
dependabot[bot] commented on PR #54:
URL: https://github.com/apache/beam-starter-java/pull/54#issuecomment-1543192581
Superseded by #68.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org