You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Zhenhao Li (JIRA)" <ji...@apache.org> on 2018/12/31 14:58:00 UTC
[jira] [Created] (FLINK-11236) possible Confluent dependency leak
Zhenhao Li created FLINK-11236:
----------------------------------
Summary: possible Confluent dependency leak
Key: FLINK-11236
URL: https://issues.apache.org/jira/browse/FLINK-11236
Project: Flink
Issue Type: Bug
Components: Kafka Connector
Affects Versions: 1.7.1
Environment: Scala 2.12.8
Flink 1.7.1
Confluent 4.1.2
Reporter: Zhenhao Li
The problem is new to version 1.7.1.
The following error indicates that Flink 1.7.1 might have included some Confluent dependencies.
```
2018-12-31 15:49:45,779 INFO [] o.a.f.r.e.ExecutionGraph:1363 - Job normalized 24h cow aggregation with 5-minute sliding window job (8b61ee6515a60b8a6021707a9bb5464e) switched from state RUNNING to FAILING.
java.lang.NoSuchMethodError: io.confluent.kafka.schemaregistry.client.SchemaRegistryClient.getId(Ljava/lang/String;Lorg/apache/avro/Schema;)I
at io.confluent.kafka.serializers.AbstractKafkaAvroSerializer.serializeImpl(AbstractKafkaAvroSerializer.java:82)
at io.confluent.kafka.serializers.KafkaAvroSerializer.serialize(KafkaAvroSerializer.java:53)
at io.connecterra.avro.ConfluentAvroKeyedSerializationSchema.serializeValue(ConfluentAvroKeyedSerializationSchema.java:116)
at io.connecterra.avro.ConfluentAvroKeyedSerializationSchema.serializeValue(ConfluentAvroKeyedSerializationSchema.java:20)
at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.invoke(FlinkKafkaProducer.java:620)
at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.invoke(FlinkKafkaProducer.java:95)
at org.apache.flink.streaming.api.functions.sink.TwoPhaseCommitSinkFunction.invoke(TwoPhaseCommitSinkFunction.java:230)
at org.apache.flink.streaming.api.operators.StreamSink.processElement(StreamSink.java:56)
at org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingChainingOutput.pushToOperator(OperatorChain.java:579)
at org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingChainingOutput.collect(OperatorChain.java:554)
at org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingChainingOutput.collect(OperatorChain.java:534)
at org.apache.flink.streaming.api.operators.AbstractStreamOperator$CountingOutput.collect(AbstractStreamOperator.java:718)
at org.apache.flink.streaming.api.operators.AbstractStreamOperator$CountingOutput.collect(AbstractStreamOperator.java:696)
at org.apache.flink.streaming.api.operators.StreamMap.processElement(StreamMap.java:41)
at org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingChainingOutput.pushToOperator(OperatorChain.java:579)
at org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingChainingOutput.collect(OperatorChain.java:554)
at org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingChainingOutput.collect(OperatorChain.java:534)
at org.apache.flink.streaming.api.operators.AbstractStreamOperator$CountingOutput.collect(AbstractStreamOperator.java:718)
at org.apache.flink.streaming.api.operators.AbstractStreamOperator$CountingOutput.collect(AbstractStreamOperator.java:696)
at org.apache.flink.streaming.api.operators.TimestampedCollector.collect(TimestampedCollector.java:51)
at org.apache.flink.streaming.api.scala.KeyedStream$$anon$3.$anonfun$flatMap$1(KeyedStream.scala:596)
at org.apache.flink.streaming.api.scala.KeyedStream$$anon$3.$anonfun$flatMap$1$adapted(KeyedStream.scala:596)
at scala.collection.Iterator.foreach(Iterator.scala:941)
at scala.collection.Iterator.foreach$(Iterator.scala:941)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1429)
at org.apache.flink.streaming.api.scala.KeyedStream$$anon$3.flatMap(KeyedStream.scala:596)
at org.apache.flink.streaming.api.operators.StreamFlatMap.processElement(StreamFlatMap.java:50)
at org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:202)
at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:105)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:704)
at java.lang.Thread.run(Thread.java:748)
```
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)