You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Martijn Visser (Jira)" <ji...@apache.org> on 2023/09/20 12:31:00 UTC
[jira] [Commented] (FLINK-33111) Flink Pulsar Connector to Pulsar Client Version Mismatch
[ https://issues.apache.org/jira/browse/FLINK-33111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17767104#comment-17767104 ]
Martijn Visser commented on FLINK-33111:
----------------------------------------
[~Tison] WDYT?
> Flink Pulsar Connector to Pulsar Client Version Mismatch
> --------------------------------------------------------
>
> Key: FLINK-33111
> URL: https://issues.apache.org/jira/browse/FLINK-33111
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Pulsar
> Affects Versions: 1.17.1
> Reporter: Jason Kania
> Priority: Major
>
> In the documentation for the Flink Pulsar Connector, ([https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/pulsar/]) it indicates that 2.10.0 and above versions of the pulsar client are supported "You can use the connector with the Pulsar 2.10.0 or higher" and the pom file entry references the 4.0.0-1.17 version of the connector which points to the 2.11.0 version of the Pulsar client. However, when using Pulsar Client 2.10.4 or 2.10.5, the following error is generated:
>
> java.lang.NoSuchMethodError: 'org.apache.pulsar.client.api.ClientBuilder org.apache.pulsar.client.api.ClientBuilder.connectionMaxIdleSeconds(int)'
> at org.apache.flink.connector.pulsar.common.config.PulsarClientFactory.createClient(PulsarClientFactory.java:127)
> at org.apache.flink.connector.pulsar.source.reader.PulsarSourceReader.create(PulsarSourceReader.java:266)
> at org.apache.flink.connector.pulsar.source.PulsarSource.createReader(PulsarSource.java:137)
> at org.apache.flink.streaming.api.operators.SourceOperator.initReader(SourceOperator.java:312)
> at org.apache.flink.streaming.runtime.tasks.SourceOperatorStreamTask.init(SourceOperatorStreamTask.java:93)
> at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:699)
> at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:675)
> at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:952)
> at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:921)
> at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:745)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562)
> at java.base/java.lang.Thread.run(Thread.java:829)
>
> The referenced method 'connectionMaxIdleSeconds' is only available in the Pulsar 2.11 client when looking at the source code. I am not sure whether the documentation is wrong and the Flink Pulsar Connector 2.11 is the intended Pulsar version. However, my understanding is that Pulsar 2.11 is targeted toward java 17. This would create the need for mixed Java 11 and Java 17 deployment unless the Pulsar client code is compiled for 2.11.
>
> Documentation cleanup and a reference to the appropriate Java versions is needed. A fix to the 1.17.1 Flink pulsar connector may alternatively be required.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)