You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@storm.apache.org by 이승진 <sw...@navercorp.com> on 2014/06/23 03:44:04 UTC

storm-kafka : EOFException: Received -1 when reading from channel, socket has likely been closed.

I'm trying to use storm-kafka 0.9.0-wip16a-scala292
below is my spout config
            List&lt;HostPort&gt; hosts = new ArrayList&lt;HostPort&gt;();            hosts.add(new HostPort("host1",2181));            hosts.add(new HostPort("host2",2181));            SpoutConfig config = new SpoutConfig(new KafkaConfig.StaticHosts(hosts,3),                    "logs",                    "/storm",// path where brokers and consumers exist eg. /storm/borkers/topics/... and /storm/consumers/...                    topologyName);            normalLogSpoutConfig.forceStartOffsetTime(-1);            KafkaSpout normalLogSpout = new KafkaSpout(normalLogSpoutConfig);
I got this error and worker dies.
INFO  kafka.consumer.SimpleConsumer - Reconnect in get offetset request due to socket error: java.io.EOFException: Received -1 when reading from channel, socket has likely been closed.
I'm using kafka_2.9.2-0.8.1, so is it a version problem? 
or am I using wrong path?

RE: storm-kafka : EOFException: Received -1 when reading from channel, socket has likely been closed.

Posted by 이승진 <sw...@navercorp.com>.

hi,You can use this veersion:
thanks, I already tried this one and worked fine.
but I'm afraid of using this one because it's not official and wurstmeister said he does not maintain this anymore.
anyway, thanks for reply.
Sincerely

-----Original Message-----
From: "傅駿浩"&lt;jamesweb3@yahoo.com.tw&gt; 
To: "user@storm.incubator.apache.org"&lt;user@storm.incubator.apache.org&gt;; "이승진"&lt;sweetest.sj@navercorp.com&gt;; 
Cc: 
Sent: 2014-06-23 (월) 12:59:43
Subject: RE: storm-kafka : EOFException: Received -1 when reading from channel, socket has likely been closed.

hi,You can use this veersion:&lt;dependency&gt;
  &lt;groupId&gt;net.wurstmeister.storm&lt;/groupId&gt;
  &lt;artifactId&gt;storm-kafka-0.8-plus&lt;/artifactId&gt;
  &lt;version&gt;0.4.0&lt;/version&gt;
&lt;/dependency&gt;This version works well with kafka 0.8.1.1 and storm 0.9.1 but with some bugs. If you want, you can git clone the latest version from github:https://github.com/apache/incubator-stormBut you need to change your storm version to latest.

James 
      이승진 &lt;sweetest.sj@navercorp.com&gt; 於 2014/6/23 (週一) 9:44 AM 寫道﹕     I'm trying
 to use storm-kafka 0.9.0-wip16a-scala292 below is my spout config             List&lt;HostPort&gt; hosts = new ArrayList&lt;HostPort&gt;();            hosts.add(new HostPort("host1",2181));            hosts.add(new HostPort("host2",2181));            SpoutConfig config = new SpoutConfig(new KafkaConfig.StaticHosts(hosts,3),                    "logs",                    "/storm",// path where brokers and consumers
 exist eg. /storm/borkers/topics/... and /storm/consumers/...                    topologyName);            normalLogSpoutConfig.forceStartOffsetTime(-1);            KafkaSpout normalLogSpout = new KafkaSpout(normalLogSpoutConfig); I got this error and worker dies. INFO  kafka.consumer.SimpleConsumer - Reconnect in get offetset request due to socket error: java.io.EOFException: Received -1 when reading from channel, socket has likely been closed. I'm using kafka_2.9.2-0.8.1, so is
 it a version problem?  or am I using wrong path?

RE: storm-kafka : EOFException: Received -1 when reading from channel, socket has likely been closed.

Posted by 傅駿浩 <ja...@yahoo.com.tw>.

hi,
You can use this veersion:
<dependency> <groupId>net.wurstmeister.storm</groupId> <artifactId>storm-kafka-0.8-plus</artifactId> <version>0.4.0</version> </dependency>

This version works well with kafka 0.8.1.1 and storm 0.9.1 but with some bugs. If you want, you can git clone the latest version from github:
https://github.com/apache/incubator-storm

But you need to change your storm version to latest.

James


이승진 <sw...@navercorp.com> 於 2014/6/23 (週一) 9:44 AM 寫道﹕
 


I'm trying to use storm-kafka 0.9.0-wip16a-scala292

below is my spout config

            List<HostPort> hosts = new ArrayList<HostPort>();
            hosts.add(new HostPort("host1",2181));
            hosts.add(new HostPort("host2",2181));
            SpoutConfig config = new SpoutConfig(new KafkaConfig.StaticHosts(hosts,3),
                    "logs",
                    "/storm",// path where brokers and consumers exist eg. /storm/borkers/topics/... and /storm/consumers/...
                    topologyName);
            normalLogSpoutConfig.forceStartOffsetTime(-1);
            KafkaSpout normalLogSpout = new KafkaSpout(normalLogSpoutConfig);

I got this error and worker dies.

INFO  kafka.consumer.SimpleConsumer - Reconnect in get offetset request due to socket error: 
java.io.EOFException: Received -1 when reading from channel, socket has likely been closed.

I'm using kafka_2.9.2-0.8.1, so is it a version problem? 

or am I using wrong path?