You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by shahab <sh...@gmail.com> on 2016/10/06 14:39:48 UTC
Kafka-Storm spout error: java.lang.NoSuchMethodError: org.apache.kafka.clients.consumer.KafkaConsumer.subscribe
Hi.
I am using storm version 1.0.2 and kafka client version 0.10.0.0.
When I run the new kafka-spout example in
https://github.com/apache/storm/tree/master/external/storm-kafka-client/src/test/java/org/apache/storm/kafka/spout/test
I am getting the following exception, which I have no idea where it comes
from.
I would appreciate if anyone has nay experience in this regard,
best,
Shahab
Here is stack trace;
java.lang.NoSuchMethodError:
org.apache.kafka.clients.consumer.KafkaConsumer.subscribe(Ljava/util/List;Lorg/apache/kafka/clients/consumer/ConsumerRebalanceListener;)V
at
org.apache.storm.kafka.spout.KafkaSpout.subscribeKafkaConsumer(KafkaSpout.java:350)
~[storm-kafka-client-1.0.2.jar:1.0.2]
at org.apache.storm.kafka.spout.KafkaSpout.activate(KafkaSpout.java:341)
~[storm-kafka-client-1.0.2.jar:1.0.2]
at
org.apache.storm.daemon.executor$fn__7990$fn__8005$fn__8036.invoke(executor.clj:643)
~[storm-core-1.0.2.jar:1.0.2]
at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:484)
[storm-core-1.0.2.jar:1.0.2]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_74]
29968 [Thread-22-kafka_spout-executor[4 4]] ERROR o.a.s.d.executor -
java.lang.NoSuchMethodError:
org.apache.kafka.clients.consumer.KafkaConsumer.subscribe(Ljava/util/List;Lorg/apache/kafka/clients/consumer/ConsumerRebalanceListener;)V
at
org.apache.storm.kafka.spout.KafkaSpout.subscribeKafkaConsumer(KafkaSpout.java:350)
~[storm-kafka-client-1.0.2.jar:1.0.2]
at org.apache.storm.kafka.spout.KafkaSpout.activate(KafkaSpout.java:341)
~[storm-kafka-client-1.0.2.jar:1.0.2]
at
org.apache.storm.daemon.executor$fn__7990$fn__8005$fn__8036.invoke(executor.clj:643)
~[storm-core-1.0.2.jar:1.0.2]
at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:484)
[storm-core-1.0.2.jar:1.0.2]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_74]
29997 [Thread-22-kafka_spout-executor[4 4]] ERROR o.a.s.util - Halting
process: ("Worker died")
java.lang.RuntimeException: ("Worker died")
at org.apache.storm.util$exit_process_BANG_.doInvoke(util.clj:341)
[storm-core-1.0.2.jar:1.0.2]
at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.7.0.jar:?]
at org.apache.storm.daemon.worker$fn__8659$fn__8660.invoke(worker.clj:761)
[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.daemon.executor$mk_executor_data$fn__7875$fn__7876.invoke(executor.clj:274)
[storm-core-1.0.2.jar:1.0.2]
at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:494)
[storm-core-1.0.2.jar:1.0.2]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_74]
Process finished with exit code 1
Re: Kafka-Storm spout error: java.lang.NoSuchMethodError: org.apache.kafka.clients.consumer.KafkaConsumer.subscribe
Posted by Jungtaek Lim <ka...@gmail.com>.
Sorry to visit lately.
storm-kafka-client 1.0.x is guaranteed to work with Kafka 0.9.x, and 1.1.0
is guaranteed to work with Kafka 0.10.0.
Since Apache Storm 1.1.0 is not release yet, you may need to build custom
version for yourself. 1.x-branch is for 1.1.0.
You can also use storm-kafka for Kafka 0.10.0 instead, and move to
storm-kafka-client once Storm 1.1.0 is released.
Hope it helps.
Thanks,
Jungtaek Lim (HeartSaVioR)
2016년 10월 6일 (목) 오후 11:39, shahab <sh...@gmail.com>님이 작성:
> Hi.
>
> I am using storm version 1.0.2 and kafka client version 0.10.0.0.
> When I run the new kafka-spout example in
> https://github.com/apache/storm/tree/master/external/storm-kafka-client/src/test/java/org/apache/storm/kafka/spout/test
> I am getting the following exception, which I have no idea where it comes
> from.
> I would appreciate if anyone has nay experience in this regard,
>
> best,
> Shahab
> Here is stack trace;
> java.lang.NoSuchMethodError:
>
> org.apache.kafka.clients.consumer.KafkaConsumer.subscribe(Ljava/util/List;Lorg/apache/kafka/clients/consumer/ConsumerRebalanceListener;)V
> at
> org.apache.storm.kafka.spout.KafkaSpout.subscribeKafkaConsumer(KafkaSpout.java:350)
> ~[storm-kafka-client-1.0.2.jar:1.0.2]
> at org.apache.storm.kafka.spout.KafkaSpout.activate(KafkaSpout.java:341)
> ~[storm-kafka-client-1.0.2.jar:1.0.2]
> at
> org.apache.storm.daemon.executor$fn__7990$fn__8005$fn__8036.invoke(executor.clj:643)
> ~[storm-core-1.0.2.jar:1.0.2]
> at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:484)
> [storm-core-1.0.2.jar:1.0.2]
> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_74]
> 29968 [Thread-22-kafka_spout-executor[4 4]] ERROR o.a.s.d.executor -
> java.lang.NoSuchMethodError:
> org.apache.kafka.clients.consumer.KafkaConsumer.subscribe(Ljava/util/List;Lorg/apache/kafka/clients/consumer/ConsumerRebalanceListener;)V
> at
> org.apache.storm.kafka.spout.KafkaSpout.subscribeKafkaConsumer(KafkaSpout.java:350)
> ~[storm-kafka-client-1.0.2.jar:1.0.2]
> at org.apache.storm.kafka.spout.KafkaSpout.activate(KafkaSpout.java:341)
> ~[storm-kafka-client-1.0.2.jar:1.0.2]
> at
> org.apache.storm.daemon.executor$fn__7990$fn__8005$fn__8036.invoke(executor.clj:643)
> ~[storm-core-1.0.2.jar:1.0.2]
> at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:484)
> [storm-core-1.0.2.jar:1.0.2]
> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_74]
> 29997 [Thread-22-kafka_spout-executor[4 4]] ERROR o.a.s.util - Halting
> process: ("Worker died")
> java.lang.RuntimeException: ("Worker died")
> at org.apache.storm.util$exit_process_BANG_.doInvoke(util.clj:341)
> [storm-core-1.0.2.jar:1.0.2]
> at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.7.0.jar:?]
> at org.apache.storm.daemon.worker$fn__8659$fn__8660.invoke(worker.clj:761)
> [storm-core-1.0.2.jar:1.0.2]
> at
> org.apache.storm.daemon.executor$mk_executor_data$fn__7875$fn__7876.invoke(executor.clj:274)
> [storm-core-1.0.2.jar:1.0.2]
> at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:494)
> [storm-core-1.0.2.jar:1.0.2]
> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_74]
>
> Process finished with exit code 1
>
>