You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "mateczagany (via GitHub)" <gi...@apache.org> on 2026/04/27 06:10:29 UTC
[PR] [FLINK-39528][python] Update apache-arrow to 19.0.0 [flink]
mateczagany opened a new pull request, #28041:
URL: https://github.com/apache/flink/pull/28041
## What is the purpose of the change
Update apache-arrow to 19.0.0 in flink-python
## Brief change log
- Update `apache-arrow` to 19.0.0
- Remove Netty version pin since the new Arrow version uses Netty 4.2.x
- Update license
## Verifying this change
This is a dependency upgrade, CI should pass
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): no
- The public API, i.e., is any changed class annotated with `@Public(Evolving)`: no
- The serializers: no
- The runtime per-record code paths (performance sensitive): no
- Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
- The S3 file system connector: no
## Documentation
- Does this pull request introduce a new feature? no
- If yes, how is the feature documented? not applicable
---
##### Was generative AI tooling used to co-author this PR?
<!--
If generative AI tooling has been used in the process of authoring this PR, please
change the checkbox below to `[X]` followed by the name of the tool, and uncomment the
"Generated-by" line. See the ASF Generative Tooling Guidance for details:
https://www.apache.org/legal/generative-tooling.html
You are responsible for the quality and correctness of every change in this PR
regardless of the tooling used. Low-effort AI-generated PRs will be closed. See
AGENTS.md for the full guidance.
-->
- [ ] Yes (please specify the tool below)
<!--
Generated-by: [Tool Name and Version]
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-39528][python] Update apache-arrow to 19.0.0 [flink]
Posted by "mateczagany (via GitHub)" <gi...@apache.org>.
mateczagany commented on code in PR #28041:
URL: https://github.com/apache/flink/pull/28041#discussion_r3153663744
##########
flink-python/src/main/resources/META-INF/NOTICE:
##########
@@ -57,18 +58,8 @@ The bundled Apache Beam dependencies bundle the following dependencies under the
- io.grpc:grpc-protobuf:1.59.1
- io.grpc:grpc-stub:1.59.1
- io.grpc:grpc-testing:1.59.1
-- io.netty:netty-buffer:4.1.100.Final
-- io.netty:netty-codec:4.1.100.Final
-- io.netty:netty-codec-http:4.1.100.Final
-- io.netty:netty-codec-http2:4.1.100.Final
-- io.netty:netty-codec-socks:4.1.100.Final
-- io.netty:netty-common:4.1.100.Final
-- io.netty:netty-handler:4.1.100.Final
-- io.netty:netty-handler-proxy:4.1.100.Final
-- io.netty:netty-resolver:4.1.100.Final
-- io.netty:netty-transport:4.1.100.Final
-- io.netty:netty-transport-native-epoll:4.1.100.Final:linux-x86_64
-- io.netty:netty-transport-native-unix-common:4.1.100.Final
+- io.netty:netty-buffer:4.2.6.Final
+- io.netty:netty-common:4.2.6.Final
Review Comment:
I agree that Netty should be upgraded to the latest version, it would also greatly simplify the current license overrides in flink-shaded. I would personally wait for a new flink-shaded version to be released with a new Netty version, then also upgrade `netty-bom` in the Flink main pom.xml, that way flink-python will get the new version too.
I'll create a PR to upgrade Netty in flink-shaded in the next few days
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-39528][python] Update apache-arrow to 19.0.0 [flink]
Posted by "ferenc-csaky (via GitHub)" <gi...@apache.org>.
ferenc-csaky commented on code in PR #28041:
URL: https://github.com/apache/flink/pull/28041#discussion_r3154075914
##########
flink-python/src/main/resources/META-INF/NOTICE:
##########
@@ -57,18 +58,8 @@ The bundled Apache Beam dependencies bundle the following dependencies under the
- io.grpc:grpc-protobuf:1.59.1
- io.grpc:grpc-stub:1.59.1
- io.grpc:grpc-testing:1.59.1
-- io.netty:netty-buffer:4.1.100.Final
-- io.netty:netty-codec:4.1.100.Final
-- io.netty:netty-codec-http:4.1.100.Final
-- io.netty:netty-codec-http2:4.1.100.Final
-- io.netty:netty-codec-socks:4.1.100.Final
-- io.netty:netty-common:4.1.100.Final
-- io.netty:netty-handler:4.1.100.Final
-- io.netty:netty-handler-proxy:4.1.100.Final
-- io.netty:netty-resolver:4.1.100.Final
-- io.netty:netty-transport:4.1.100.Final
-- io.netty:netty-transport-native-epoll:4.1.100.Final:linux-x86_64
-- io.netty:netty-transport-native-unix-common:4.1.100.Final
+- io.netty:netty-buffer:4.2.6.Final
+- io.netty:netty-common:4.2.6.Final
Review Comment:
sounds good, then i'm merging this one, thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-39528][python] Update apache-arrow to 19.0.0 [flink]
Posted by "flinkbot (via GitHub)" <gi...@apache.org>.
flinkbot commented on PR #28041:
URL: https://github.com/apache/flink/pull/28041#issuecomment-4324571123
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "19b35e834cdeba3181e226ad2d7f1145c11d18de",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "19b35e834cdeba3181e226ad2d7f1145c11d18de",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 19b35e834cdeba3181e226ad2d7f1145c11d18de UNKNOWN
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-39528][python] Update apache-arrow to 19.0.0 [flink]
Posted by "ferenc-csaky (via GitHub)" <gi...@apache.org>.
ferenc-csaky merged PR #28041:
URL: https://github.com/apache/flink/pull/28041
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-39528][python] Update apache-arrow to 19.0.0 [flink]
Posted by "snuyanzin (via GitHub)" <gi...@apache.org>.
snuyanzin commented on code in PR #28041:
URL: https://github.com/apache/flink/pull/28041#discussion_r3153075831
##########
flink-python/src/main/resources/META-INF/NOTICE:
##########
@@ -57,18 +58,8 @@ The bundled Apache Beam dependencies bundle the following dependencies under the
- io.grpc:grpc-protobuf:1.59.1
- io.grpc:grpc-stub:1.59.1
- io.grpc:grpc-testing:1.59.1
-- io.netty:netty-buffer:4.1.100.Final
-- io.netty:netty-codec:4.1.100.Final
-- io.netty:netty-codec-http:4.1.100.Final
-- io.netty:netty-codec-http2:4.1.100.Final
-- io.netty:netty-codec-socks:4.1.100.Final
-- io.netty:netty-common:4.1.100.Final
-- io.netty:netty-handler:4.1.100.Final
-- io.netty:netty-handler-proxy:4.1.100.Final
-- io.netty:netty-resolver:4.1.100.Final
-- io.netty:netty-transport:4.1.100.Final
-- io.netty:netty-transport-native-epoll:4.1.100.Final:linux-x86_64
-- io.netty:netty-transport-native-unix-common:4.1.100.Final
+- io.netty:netty-buffer:4.2.6.Final
+- io.netty:netty-common:4.2.6.Final
Review Comment:
can we think towards 4.2.12 https://netty.io/news/2026/03/24/4-2-12-Final.html
since there are multiple CVE fixed between 4.2.6 and 4.2.12 ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-39528][python] Update apache-arrow to 19.0.0 [flink]
Posted by "snuyanzin (via GitHub)" <gi...@apache.org>.
snuyanzin commented on code in PR #28041:
URL: https://github.com/apache/flink/pull/28041#discussion_r3153601566
##########
flink-python/src/main/resources/META-INF/NOTICE:
##########
@@ -57,18 +58,8 @@ The bundled Apache Beam dependencies bundle the following dependencies under the
- io.grpc:grpc-protobuf:1.59.1
- io.grpc:grpc-stub:1.59.1
- io.grpc:grpc-testing:1.59.1
-- io.netty:netty-buffer:4.1.100.Final
-- io.netty:netty-codec:4.1.100.Final
-- io.netty:netty-codec-http:4.1.100.Final
-- io.netty:netty-codec-http2:4.1.100.Final
-- io.netty:netty-codec-socks:4.1.100.Final
-- io.netty:netty-common:4.1.100.Final
-- io.netty:netty-handler:4.1.100.Final
-- io.netty:netty-handler-proxy:4.1.100.Final
-- io.netty:netty-resolver:4.1.100.Final
-- io.netty:netty-transport:4.1.100.Final
-- io.netty:netty-transport-native-epoll:4.1.100.Final:linux-x86_64
-- io.netty:netty-transport-native-unix-common:4.1.100.Final
+- io.netty:netty-buffer:4.2.6.Final
+- io.netty:netty-common:4.2.6.Final
Review Comment:
yes, could be done separately for all
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-39528][python] Update apache-arrow to 19.0.0 [flink]
Posted by "ferenc-csaky (via GitHub)" <gi...@apache.org>.
ferenc-csaky commented on code in PR #28041:
URL: https://github.com/apache/flink/pull/28041#discussion_r3153582134
##########
flink-python/src/main/resources/META-INF/NOTICE:
##########
@@ -57,18 +58,8 @@ The bundled Apache Beam dependencies bundle the following dependencies under the
- io.grpc:grpc-protobuf:1.59.1
- io.grpc:grpc-stub:1.59.1
- io.grpc:grpc-testing:1.59.1
-- io.netty:netty-buffer:4.1.100.Final
-- io.netty:netty-codec:4.1.100.Final
-- io.netty:netty-codec-http:4.1.100.Final
-- io.netty:netty-codec-http2:4.1.100.Final
-- io.netty:netty-codec-socks:4.1.100.Final
-- io.netty:netty-common:4.1.100.Final
-- io.netty:netty-handler:4.1.100.Final
-- io.netty:netty-handler-proxy:4.1.100.Final
-- io.netty:netty-resolver:4.1.100.Final
-- io.netty:netty-transport:4.1.100.Final
-- io.netty:netty-transport-native-epoll:4.1.100.Final:linux-x86_64
-- io.netty:netty-transport-native-unix-common:4.1.100.Final
+- io.netty:netty-buffer:4.2.6.Final
+- io.netty:netty-common:4.2.6.Final
Review Comment:
flink-shaded [ships 4.2.6 as well](https://github.com/apache/flink-shaded/blob/e458d63d916ecd3b64fe0a7a18069653d0568b8f/pom.xml#L65), IMO bumping python only to a newer version would not matter too much. wdyt?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org