You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Abhishek Samuel <ab...@gmail.com> on 2016/11/29 02:48:36 UTC
Apache Storm 1.0.2 integration with ElasticSearch 5.0.0
Hi,
I was writing a bolt to write to elasticsearch 5.0.0 running locally using
the examples provided here
http://storm.apache.org/releases/1.0.2/storm-elasticsearch.html
Am using the maven dependency
<dependency>
<groupId>org.apache.storm</groupId>
<artifactId>storm-elasticsearch</artifactId>
<version>1.0.2</version></dependency>
The code compiled, however at runtime i was getting the below error. Could
you please advise on what the issue could be ?
Thanks and Regards
Abhishek Samuel
*On the elasticsearch server terminal*
[2016-11-28T18:17:58,810][WARN ][o.e.t.n.Netty4Transport ] [ZCyigtO]
exception caught on transport layer [[id: 0x2f3da3a0, L:/127.0.0.1:9300 -
R:/127.0.0.1:52299]], closing connection
java.lang.IllegalStateException: Received message from unsupported version:
[1.0.0] minimal compatible version is: [5.0.0]
at
org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:1199)
~[elasticsearch-5.0.0.jar:5.0.0]
at
org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:74)
~[transport-netty4-5.0.0.jar:5.0.0]
*On the java runtime terminal*
8262 [Thread-14-friends-es-bolt-executor[2 2]] ERROR o.a.s.d.executor -
org.elasticsearch.client.transport.NoNodeAvailableException: None of the
configured nodes are available: []
at
org.elasticsearch.client.transport.TransportClientNodesService.ensureNodesAreAvailable(TransportClientNodesService.java:305)
~[elasticsearch-1.6.0.jar:?]
at
org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:200)
~[elasticsearch-1.6.0.jar:?]
at
org.elasticsearch.client.transport.support.InternalTransportClient.execute(InternalTransportClient.java:106)
~[elasticsearch-1.6.0.jar:?]
at
org.elasticsearch.client.support.AbstractClient.index(AbstractClient.java:102)
~[elasticsearch-1.6.0.jar:?]
at
org.elasticsearch.client.transport.TransportClient.index(TransportClient.java:340)
~[elasticsearch-1.6.0.jar:?]
at
org.elasticsearch.action.index.IndexRequestBuilder.doExecute(IndexRequestBuilder.java:266)
~[elasticsearch-1.6.0.jar:?]
at
org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:91)
~[elasticsearch-1.6.0.jar:?]
at
org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:65)
~[elasticsearch-1.6.0.jar:?]
at
org.apache.storm.elasticsearch.bolt.EsIndexBolt.execute(EsIndexBolt.java:64)
[storm-elasticsearch-1.0.2.jar:1.0.2]
at
org.apache.storm.daemon.executor$fn__8058$tuple_action_fn__8060.invoke(executor.clj:731)
[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.daemon.executor$mk_task_receiver$fn__7979.invoke(executor.clj:464)
[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.disruptor$clojure_handler$reify__7492.onEvent(disruptor.clj:40)
[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451)
[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430)
[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73)
[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.daemon.executor$fn__8058$fn__8071$fn__8124.invoke(executor.clj:850)
[storm-core-1.0.2.jar:1.0.2]
at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:484)
[storm-core-1.0.2.jar:1.0.2]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_45]
Re: Apache Storm 1.0.2 integration with ElasticSearch 5.0.0
Posted by Ambud Sharma <as...@gmail.com>.
That is wire-level protocol incompatibility for ES or zen is disabled or
nodes are not reachable in Elasticsearch.
On Mon, Nov 28, 2016 at 7:21 PM, Zhechao Ma <ma...@gmail.com>
wrote:
> As far as I know, storm-elasticsearch still doesn't support elasticsearch
> 5.0. You can use *Elasticsearch-Hadoop *5.x instead, which provides class *EsBolt
> *for writing data from storm to elasitcsearch.
>
> https://github.com/elastic/elasticsearch-hadoop
>
> 2016-11-29 10:48 GMT+08:00 Abhishek Samuel <ab...@gmail.com>:
>
>> Hi,
>>
>> I was writing a bolt to write to elasticsearch 5.0.0 running locally
>> using the examples provided here http://storm.apache.org/r
>> eleases/1.0.2/storm-elasticsearch.html
>>
>> Am using the maven dependency
>>
>> <dependency>
>> <groupId>org.apache.storm</groupId>
>> <artifactId>storm-elasticsearch</artifactId>
>> <version>1.0.2</version></dependency>
>>
>>
>> The code compiled, however at runtime i was getting the below error.
>> Could you please advise on what the issue could be ?
>>
>> Thanks and Regards
>> Abhishek Samuel
>>
>> *On the elasticsearch server terminal*
>>
>> [2016-11-28T18:17:58,810][WARN ][o.e.t.n.Netty4Transport ] [ZCyigtO]
>> exception caught on transport layer [[id: 0x2f3da3a0, L:/127.0.0.1:9300 -
>> R:/127.0.0.1:52299]], closing connection
>>
>> java.lang.IllegalStateException: Received message from unsupported
>> version: [1.0.0] minimal compatible version is: [5.0.0]
>>
>> at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:1199)
>> ~[elasticsearch-5.0.0.jar:5.0.0]
>>
>> at org.elasticsearch.transport.netty4.Netty4MessageChannelHandl
>> er.channelRead(Netty4MessageChannelHandler.java:74)
>> ~[transport-netty4-5.0.0.jar:5.0.0]
>>
>>
>> *On the java runtime terminal*
>>
>>
>> 8262 [Thread-14-friends-es-bolt-executor[2 2]] ERROR o.a.s.d.executor -
>>
>> org.elasticsearch.client.transport.NoNodeAvailableException: None of the
>> configured nodes are available: []
>>
>> at org.elasticsearch.client.transport.TransportClientNodesServi
>> ce.ensureNodesAreAvailable(TransportClientNodesService.java:305)
>> ~[elasticsearch-1.6.0.jar:?]
>>
>> at org.elasticsearch.client.transport.TransportClientNodesServi
>> ce.execute(TransportClientNodesService.java:200)
>> ~[elasticsearch-1.6.0.jar:?]
>>
>> at org.elasticsearch.client.transport.support.InternalTransport
>> Client.execute(InternalTransportClient.java:106)
>> ~[elasticsearch-1.6.0.jar:?]
>>
>> at org.elasticsearch.client.support.AbstractClient.index(AbstractClient.java:102)
>> ~[elasticsearch-1.6.0.jar:?]
>>
>> at org.elasticsearch.client.transport.TransportClient.index(TransportClient.java:340)
>> ~[elasticsearch-1.6.0.jar:?]
>>
>> at org.elasticsearch.action.index.IndexRequestBuilder.doExecute(IndexRequestBuilder.java:266)
>> ~[elasticsearch-1.6.0.jar:?]
>>
>> at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:91)
>> ~[elasticsearch-1.6.0.jar:?]
>>
>> at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:65)
>> ~[elasticsearch-1.6.0.jar:?]
>>
>> at org.apache.storm.elasticsearch.bolt.EsIndexBolt.execute(EsIndexBolt.java:64)
>> [storm-elasticsearch-1.0.2.jar:1.0.2]
>>
>> at org.apache.storm.daemon.executor$fn__8058$tuple_action_fn__8060.invoke(executor.clj:731)
>> [storm-core-1.0.2.jar:1.0.2]
>>
>> at org.apache.storm.daemon.executor$mk_task_receiver$fn__7979.invoke(executor.clj:464)
>> [storm-core-1.0.2.jar:1.0.2]
>>
>> at org.apache.storm.disruptor$clojure_handler$reify__7492.onEvent(disruptor.clj:40)
>> [storm-core-1.0.2.jar:1.0.2]
>>
>> at org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451)
>> [storm-core-1.0.2.jar:1.0.2]
>>
>> at org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430)
>> [storm-core-1.0.2.jar:1.0.2]
>>
>> at org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73)
>> [storm-core-1.0.2.jar:1.0.2]
>>
>> at org.apache.storm.daemon.executor$fn__8058$fn__8071$fn__8124.invoke(executor.clj:850)
>> [storm-core-1.0.2.jar:1.0.2]
>>
>> at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:484)
>> [storm-core-1.0.2.jar:1.0.2]
>>
>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>>
>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_45]
>>
>
>
>
> --
> Thanks
> Zhechao Ma
>
Re: Apache Storm 1.0.2 integration with ElasticSearch 5.0.0
Posted by Zhechao Ma <ma...@gmail.com>.
As far as I know, storm-elasticsearch still doesn't support elasticsearch
5.0. You can use *Elasticsearch-Hadoop *5.x instead, which provides
class *EsBolt
*for writing data from storm to elasitcsearch.
https://github.com/elastic/elasticsearch-hadoop
2016-11-29 10:48 GMT+08:00 Abhishek Samuel <ab...@gmail.com>:
> Hi,
>
> I was writing a bolt to write to elasticsearch 5.0.0 running locally using
> the examples provided here http://storm.apache.org/releases/1.0.2/storm-
> elasticsearch.html
>
> Am using the maven dependency
>
> <dependency>
> <groupId>org.apache.storm</groupId>
> <artifactId>storm-elasticsearch</artifactId>
> <version>1.0.2</version></dependency>
>
>
> The code compiled, however at runtime i was getting the below error. Could
> you please advise on what the issue could be ?
>
> Thanks and Regards
> Abhishek Samuel
>
> *On the elasticsearch server terminal*
>
> [2016-11-28T18:17:58,810][WARN ][o.e.t.n.Netty4Transport ] [ZCyigtO]
> exception caught on transport layer [[id: 0x2f3da3a0, L:/127.0.0.1:9300 -
> R:/127.0.0.1:52299]], closing connection
>
> java.lang.IllegalStateException: Received message from unsupported
> version: [1.0.0] minimal compatible version is: [5.0.0]
>
> at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:1199)
> ~[elasticsearch-5.0.0.jar:5.0.0]
>
> at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.
> channelRead(Netty4MessageChannelHandler.java:74)
> ~[transport-netty4-5.0.0.jar:5.0.0]
>
>
> *On the java runtime terminal*
>
>
> 8262 [Thread-14-friends-es-bolt-executor[2 2]] ERROR o.a.s.d.executor -
>
> org.elasticsearch.client.transport.NoNodeAvailableException: None of the
> configured nodes are available: []
>
> at org.elasticsearch.client.transport.TransportClientNodesService.
> ensureNodesAreAvailable(TransportClientNodesService.java:305)
> ~[elasticsearch-1.6.0.jar:?]
>
> at org.elasticsearch.client.transport.TransportClientNodesService.execute(
> TransportClientNodesService.java:200) ~[elasticsearch-1.6.0.jar:?]
>
> at org.elasticsearch.client.transport.support.InternalTransportClient.
> execute(InternalTransportClient.java:106) ~[elasticsearch-1.6.0.jar:?]
>
> at org.elasticsearch.client.support.AbstractClient.index(AbstractClient.java:102)
> ~[elasticsearch-1.6.0.jar:?]
>
> at org.elasticsearch.client.transport.TransportClient.
> index(TransportClient.java:340) ~[elasticsearch-1.6.0.jar:?]
>
> at org.elasticsearch.action.index.IndexRequestBuilder.
> doExecute(IndexRequestBuilder.java:266) ~[elasticsearch-1.6.0.jar:?]
>
> at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:91)
> ~[elasticsearch-1.6.0.jar:?]
>
> at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:65)
> ~[elasticsearch-1.6.0.jar:?]
>
> at org.apache.storm.elasticsearch.bolt.EsIndexBolt.execute(EsIndexBolt.java:64)
> [storm-elasticsearch-1.0.2.jar:1.0.2]
>
> at org.apache.storm.daemon.executor$fn__8058$tuple_action_fn__8060.invoke(executor.clj:731)
> [storm-core-1.0.2.jar:1.0.2]
>
> at org.apache.storm.daemon.executor$mk_task_receiver$fn__7979.invoke(executor.clj:464)
> [storm-core-1.0.2.jar:1.0.2]
>
> at org.apache.storm.disruptor$clojure_handler$reify__7492.onEvent(disruptor.clj:40)
> [storm-core-1.0.2.jar:1.0.2]
>
> at org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451)
> [storm-core-1.0.2.jar:1.0.2]
>
> at org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430)
> [storm-core-1.0.2.jar:1.0.2]
>
> at org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73)
> [storm-core-1.0.2.jar:1.0.2]
>
> at org.apache.storm.daemon.executor$fn__8058$fn__8071$fn__8124.invoke(executor.clj:850)
> [storm-core-1.0.2.jar:1.0.2]
>
> at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:484)
> [storm-core-1.0.2.jar:1.0.2]
>
> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_45]
>
--
Thanks
Zhechao Ma