You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Fabian Paul (Jira)" <ji...@apache.org> on 2021/07/09 09:03:00 UTC
[jira] [Commented] (FLINK-19168) Upgrade Kafka client version
beyond 2.5.0
[ https://issues.apache.org/jira/browse/FLINK-19168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377950#comment-17377950 ]
Fabian Paul commented on FLINK-19168:
-------------------------------------
We definitely want to upgrade the Kafka Version to a more recent or latest version. Unfortunately, Kafka dropped Scala 2.11 support with 2.5.0 which means the new kafka dependencies enforce to use Scala 2.12 or Scala 2.11.
Now, there two possibilities for how different scala versions can coexist in the Flink project.
# Full implement https://issues.apache.org/jira/browse/FLINK-14105 and remove Scala from Flink core and Flink runtime
# Find a solution to support different classloaders for connectors https://issues.apache.org/jira/browse/FLINK-15786 one option here can be to reuse the plugin classloader but it entails a bigger effort around how the sources/sinks are currently instantiated.
I think option 1 will be implemented first because it also unblocks other different efforts i.e. using a more recent Scala version. For the time being, we have to wait for the proper resolution.
> Upgrade Kafka client version beyond 2.5.0
> -----------------------------------------
>
> Key: FLINK-19168
> URL: https://issues.apache.org/jira/browse/FLINK-19168
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Kafka
> Reporter: darion yaphet
> Priority: Minor
> Labels: auto-deprioritized-major
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)