You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Chandu Kempaiah <ch...@reflektion.com> on 2018/10/11 01:51:30 UTC
Fwd: Getting NoMethod found error while running job on flink 1.6.1
Hello,
I am have a job that reads messages from kafka, processes them and writes
back to kafka, this jobs works fine on flink 1.3.2. I upgraded cluster to
1.6.1 but now see below error. Has any one faced similar issue?
I have updated all the dependencies to use
<flink.version>1.6.1</flink.version>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-kafka-0.10_${scala.version}</artifactId>
<version>${flink.version}</version>
</dependency>
java.lang.NoSuchMethodError:
org.apache.flink.metrics.MetricGroup.addGroup(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/flink/metrics/MetricGroup;
at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.registerOffsetMetrics(AbstractFetcher.java:622)
at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.<init>(AbstractFetcher.java:200)
at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.<init>(Kafka09Fetcher.java:91)
at org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher.<init>(Kafka010Fetcher.java:64)
at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer010.createFetcher(FlinkKafkaConsumer010.java:209)
at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:647)
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87)
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:56)
at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
at java.lang.Thread.run(Thread.java:748)
Thanks
Chandu
Re: Getting NoMethod found error while running job on flink 1.6.1
Posted by Chesnay Schepler <c....@web.de>.
The cause cannot be that flink-metrics-core is not on the classpath as
in that case you'd get a ClassNotFoundError.
This is a version conflict, either caused by your fat jar bundling an
older version of flink-metrics-core but a newer version of the kafka
connector, or you upgrade your application correctly but the cluster is
actually still running an older version.
Please check your dependencies and build setup.
On 11.10.2018 08:05, Chandu Kempaiah wrote:
> Flink is running as standalone cluster in High Availability mode, My
> application jar is a fat jar which has all the necessary dependencies
> included.
>
> I will check once again and verify by adding the flink-metrics-core to
> the classpath.
>
> Thanks
> Chandu
>
> On Wed, Oct 10, 2018 at 8:38 PM vino yang <yanghua1127@gmail.com
> <ma...@gmail.com>> wrote:
>
> Hi Chandu,
>
> What mode does your Flink run in?
> In addition, can you check if the flink-metrics-core is included
> in the classpath of the Flink runtime environment?
>
> Thanks, vino.
>
> Chandu Kempaiah <chandu.kempaiah@reflektion.com
> <ma...@reflektion.com>> 于2018年10月11日周四
> 上午9:51写道：
>
>
> Hello,
>
> I am have a job that reads messages from kafka, processes them
> and writes back to kafka, this jobs works fine on flink 1.3.2.
> I upgraded cluster to 1.6.1 but now see below error. Has any
> one faced similar issue?
>
> I have updated all the dependencies to use
>
> <flink.version>1.6.1</flink.version>
>
> <dependency>
> <groupId>org.apache.flink</groupId>
> <artifactId>flink-connector-kafka-0.10_${scala.version}</artifactId>
> <version>${flink.version}</version>
> </dependency>
>
>
> java.lang.NoSuchMethodError: org.apache.flink.metrics.MetricGroup.addGroup(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/flink/metrics/MetricGroup;
> at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.registerOffsetMetrics(AbstractFetcher.java:622)
> at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.<init>(AbstractFetcher.java:200)
> at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.<init>(Kafka09Fetcher.java:91)
> at org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher.<init>(Kafka010Fetcher.java:64)
> at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer010.createFetcher(FlinkKafkaConsumer010.java:209)
> at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:647)
> at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87)
> at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:56)
> at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)
> at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
> at java.lang.Thread.run(Thread.java:748)
>
> Thanks
>
> Chandu
>
Re: Getting NoMethod found error while running job on flink 1.6.1
Posted by Chandu Kempaiah <ch...@reflektion.com>.
Flink is running as standalone cluster in High Availability mode, My
application jar is a fat jar which has all the necessary dependencies
included.
I will check once again and verify by adding the flink-metrics-core to the
classpath.
Thanks
Chandu
On Wed, Oct 10, 2018 at 8:38 PM vino yang <ya...@gmail.com> wrote:
> Hi Chandu,
>
> What mode does your Flink run in?
> In addition, can you check if the flink-metrics-core is included in the
> classpath of the Flink runtime environment?
>
> Thanks, vino.
>
> Chandu Kempaiah <ch...@reflektion.com> 于2018年10月11日周四 上午9:51写道：
>
>>
>> Hello,
>>
>> I am have a job that reads messages from kafka, processes them and writes
>> back to kafka, this jobs works fine on flink 1.3.2. I upgraded cluster to
>> 1.6.1 but now see below error. Has any one faced similar issue?
>>
>> I have updated all the dependencies to use
>>
>> <flink.version>1.6.1</flink.version>
>>
>> <dependency>
>> <groupId>org.apache.flink</groupId>
>> <artifactId>flink-connector-kafka-0.10_${scala.version}</artifactId>
>> <version>${flink.version}</version>
>> </dependency>
>>
>>
>> java.lang.NoSuchMethodError: org.apache.flink.metrics.MetricGroup.addGroup(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/flink/metrics/MetricGroup;
>> at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.registerOffsetMetrics(AbstractFetcher.java:622)
>> at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.<init>(AbstractFetcher.java:200)
>> at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.<init>(Kafka09Fetcher.java:91)
>> at org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher.<init>(Kafka010Fetcher.java:64)
>> at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer010.createFetcher(FlinkKafkaConsumer010.java:209)
>> at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:647)
>> at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87)
>> at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:56)
>> at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)
>> at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
>> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
>> at java.lang.Thread.run(Thread.java:748)
>>
>>
>>
>> Thanks
>>
>> Chandu
>>
>>
Re: Getting NoMethod found error while running job on flink 1.6.1
Posted by vino yang <ya...@gmail.com>.
Hi Chandu,
What mode does your Flink run in?
In addition, can you check if the flink-metrics-core is included in the
classpath of the Flink runtime environment?
Thanks, vino.
Chandu Kempaiah <ch...@reflektion.com> 于2018年10月11日周四 上午9:51写道：
>
> Hello,
>
> I am have a job that reads messages from kafka, processes them and writes
> back to kafka, this jobs works fine on flink 1.3.2. I upgraded cluster to
> 1.6.1 but now see below error. Has any one faced similar issue?
>
> I have updated all the dependencies to use
>
> <flink.version>1.6.1</flink.version>
>
> <dependency>
> <groupId>org.apache.flink</groupId>
> <artifactId>flink-connector-kafka-0.10_${scala.version}</artifactId>
> <version>${flink.version}</version>
> </dependency>
>
>
> java.lang.NoSuchMethodError: org.apache.flink.metrics.MetricGroup.addGroup(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/flink/metrics/MetricGroup;
> at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.registerOffsetMetrics(AbstractFetcher.java:622)
> at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.<init>(AbstractFetcher.java:200)
> at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.<init>(Kafka09Fetcher.java:91)
> at org.apache.flink.streaming.connectors.kafka.internal.Kafka010Fetcher.<init>(Kafka010Fetcher.java:64)
> at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer010.createFetcher(FlinkKafkaConsumer010.java:209)
> at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:647)
> at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87)
> at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:56)
> at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)
> at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
> at java.lang.Thread.run(Thread.java:748)
>
>
>
> Thanks
>
> Chandu
>
>