You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Anandh Kumar <an...@gmail.com> on 2016/04/16 13:15:16 UTC

Storm 1.0.0 with KafkaSpout throws error

Hi,

I am using storm 1.0.0.

When I deployed simple topology with kafkaSpout getting

java.lang.RuntimeException: java.nio.BufferUnderflowException at
org.apache.storm.kafka.KafkaUtils.fetchMessages(KafkaUtils.java:201) at
org.apache.storm.kafka.PartitionManager.fill(PartitionManager.java:189) at
org.apache.storm.kafka.PartitionManager.next(PartitionManager.java:138) at
org.apache.storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:135) at
org.apache.storm.daemon.executor$fn__8158$fn__8173$fn__8204.invoke(executor.clj:647)
at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) at
clojure.lang.AFn.run(AFn.java:22) at java.lang.Thread.run(Thread.java:745)
Caused by: java.nio.BufferUnderflowException at
java.nio.HeapByteBuffer.get(HeapByteBuffer.java:151) at
java.nio.ByteBuffer.get(ByteBuffer.java:715) at
kafka.api.ApiUtils$.readShortString(ApiUtils.scala:40) at
kafka.api.TopicData$.readFrom(FetchResponse.scala:95) at
kafka.api.FetchResponse$$anonfun$4.apply(FetchResponse.scala:169) at
kafka.api.FetchResponse$$anonfun$4.apply(FetchResponse.scala:168) at
scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:252)
at
scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:252)
at scala.collection.immutable.Range.foreach(Range.scala:166) at
scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:252)
at scala.collection.AbstractTraversable.flatMap(Traversable.scala:104) at
kafka.api.FetchResponse$.readFrom(FetchResponse.scala:168) at
kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:135) at
kafka.javaapi.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:47) at
org.apache.storm.kafka.KafkaUtils.fetchMessages(KafkaUtils.java:191) ... 7
more

Why this is comming any help pls?

BrokerHosts hosts = new ZkHosts(zkConnString);
    SpoutConfig spoutConfig = new SpoutConfig(hosts, topicName, "/" +
topicName, "spoutid");
    spoutConfig.scheme = new SchemeAsMultiScheme(new StringScheme());

Regards,
-Anandh Kumar