You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Mostafa Gomaa <mg...@trendak.com> on 2016/11/03 16:29:55 UTC
ESBolt error
I am currently using apache storm 1.0.2 with elasticsearch 2.2.1 and using
the elasticsearch bolt to write some data.
The machines are on microsoft azure environment, and the ES bolt is giving
me this error
java.lang.RuntimeException:
org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException: Connection
error (check network and/or proxy settings)- all nodes failed; tried [[
127.0.0.1:9200]]
my current configurations doesn't include localhost as elasticsearch node
but it keep saying that it tried localhost, and the thing is that i can
curl the elasticsearch node from the storm machine's terminal and it can be
accessed
Re: ESBolt error
Posted by Mostafa Gomaa <mg...@trendak.com>.
Thanks all for the responses. Turned out that i needed to set
es.nodes.wan.only to true. That fixed the issue.
On Mon, Nov 7, 2016 at 6:26 AM, Zhechao Ma <ma...@gmail.com>
wrote:
> Did you set these two configuration "es.nodes" and "es.port" ? That should
> be set like this:
>
> Config conf = new Config(); conf.put("es.nodes", esNodes); conf.put("es.port", esPort);
>
>
>
> 2016-11-06 15:15 GMT+08:00 saiprasad mishra <sa...@gmail.com>:
>
>> Did you override the es.nodes property, which should be the remote host
>> of your elastic cluster (any one host from your es cluster should work)
>>
>> https://www.elastic.co/guide/en/elasticsearch/hadoop/master/
>> configuration.html
>>
>> Regards
>> Sai
>>
>> On Sat, Nov 5, 2016 at 11:57 PM, Mostafa Gomaa <mg...@trendak.com>
>> wrote:
>>
>>> Hi Zhechao,
>>>
>>> Thanks for the response. I am actually using that bolt, and it's giving
>>> me that error.
>>>
>>> On Fri, Nov 4, 2016 at 5:23 AM, Zhechao Ma <ma...@gmail.com>
>>> wrote:
>>>
>>>> If you use both Storm 1.x and ES 2.x and try to import data to ES from
>>>> Storm, you can try elasitcsearch-hadoop 5.0.
>>>> ES-hadoop provides EsBolt which satisfies your demand.
>>>>
>>>> https://github.com/elastic/elasticsearch-hadoop
>>>>
>>>> 2016-11-04 1:51 GMT+08:00 Mostafa Gomaa <mg...@trendak.com>:
>>>>
>>>>> Thanks Aaron, It's probably a network/firewall issue. I'll try to
>>>>> fiddle around to what's going on.
>>>>>
>>>>> On Thu, Nov 3, 2016 at 7:42 PM, Aaron Niskodé-Dossett <
>>>>> dossett@gmail.com> wrote:
>>>>>
>>>>>> Oh, interesting. I believe that's the same error I saw when I tried
>>>>>> to run the Storm bolt (which only support 1.X) against a 2.X server.
>>>>>> Sorry, other than that I'm not sure what could be causing your problem.
>>>>>>
>>>>>> On Thu, Nov 3, 2016 at 12:39 PM Mostafa Gomaa <mg...@trendak.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Aaron,
>>>>>>>
>>>>>>> Thanks for the response. I am actually using the bolt you linked me
>>>>>>> to. Any ideas?
>>>>>>>
>>>>>>> On Thu, Nov 3, 2016 at 7:36 PM, Aaron Niskodé-Dossett <
>>>>>>> dossett@gmail.com> wrote:
>>>>>>>
>>>>>>> Hi Mostafa Gomaa -- Unfortunately Storm's bolt does not support
>>>>>>> Elastic 2.X. There is a PR to add this support, which I need to put some
>>>>>>> work into. In the meantime, you could try elastic's bolt (
>>>>>>> https://www.elastic.co/guide/en/elasticsearch/hadoop/curren
>>>>>>> t/storm.html).
>>>>>>>
>>>>>>> Thanks, Aaron
>>>>>>>
>>>>>>> On Thu, Nov 3, 2016 at 11:30 AM Mostafa Gomaa <mg...@trendak.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>
>>>>>>> I am currently using apache storm 1.0.2 with elasticsearch 2.2.1 and
>>>>>>> using the elasticsearch bolt to write some data.
>>>>>>> The machines are on microsoft azure environment, and the ES bolt is
>>>>>>> giving me this error
>>>>>>> java.lang.RuntimeException: org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException:
>>>>>>> Connection error (check network and/or proxy settings)- all nodes failed;
>>>>>>> tried [[127.0.0.1:9200]]
>>>>>>> my current configurations doesn't include localhost as elasticsearch
>>>>>>> node but it keep saying that it tried localhost, and the thing is that i
>>>>>>> can curl the elasticsearch node from the storm machine's terminal and it
>>>>>>> can be accessed
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Thanks
>>>> Zhechao Ma
>>>>
>>>
>>>
>>
>
>
> --
> Thanks
> Zhechao Ma
>
Re: ESBolt error
Posted by Zhechao Ma <ma...@gmail.com>.
Did you set these two configuration "es.nodes" and "es.port" ? That should
be set like this:
Config conf = new Config(); conf.put("es.nodes",
esNodes); conf.put("es.port", esPort);
2016-11-06 15:15 GMT+08:00 saiprasad mishra <sa...@gmail.com>:
> Did you override the es.nodes property, which should be the remote host of
> your elastic cluster (any one host from your es cluster should work)
>
> https://www.elastic.co/guide/en/elasticsearch/hadoop/
> master/configuration.html
>
> Regards
> Sai
>
> On Sat, Nov 5, 2016 at 11:57 PM, Mostafa Gomaa <mg...@trendak.com> wrote:
>
>> Hi Zhechao,
>>
>> Thanks for the response. I am actually using that bolt, and it's giving
>> me that error.
>>
>> On Fri, Nov 4, 2016 at 5:23 AM, Zhechao Ma <ma...@gmail.com>
>> wrote:
>>
>>> If you use both Storm 1.x and ES 2.x and try to import data to ES from
>>> Storm, you can try elasitcsearch-hadoop 5.0.
>>> ES-hadoop provides EsBolt which satisfies your demand.
>>>
>>> https://github.com/elastic/elasticsearch-hadoop
>>>
>>> 2016-11-04 1:51 GMT+08:00 Mostafa Gomaa <mg...@trendak.com>:
>>>
>>>> Thanks Aaron, It's probably a network/firewall issue. I'll try to
>>>> fiddle around to what's going on.
>>>>
>>>> On Thu, Nov 3, 2016 at 7:42 PM, Aaron Niskodé-Dossett <
>>>> dossett@gmail.com> wrote:
>>>>
>>>>> Oh, interesting. I believe that's the same error I saw when I tried
>>>>> to run the Storm bolt (which only support 1.X) against a 2.X server.
>>>>> Sorry, other than that I'm not sure what could be causing your problem.
>>>>>
>>>>> On Thu, Nov 3, 2016 at 12:39 PM Mostafa Gomaa <mg...@trendak.com>
>>>>> wrote:
>>>>>
>>>>>> Hi Aaron,
>>>>>>
>>>>>> Thanks for the response. I am actually using the bolt you linked me
>>>>>> to. Any ideas?
>>>>>>
>>>>>> On Thu, Nov 3, 2016 at 7:36 PM, Aaron Niskodé-Dossett <
>>>>>> dossett@gmail.com> wrote:
>>>>>>
>>>>>> Hi Mostafa Gomaa -- Unfortunately Storm's bolt does not support
>>>>>> Elastic 2.X. There is a PR to add this support, which I need to put some
>>>>>> work into. In the meantime, you could try elastic's bolt (
>>>>>> https://www.elastic.co/guide/en/elasticsearch/hadoop/curren
>>>>>> t/storm.html).
>>>>>>
>>>>>> Thanks, Aaron
>>>>>>
>>>>>> On Thu, Nov 3, 2016 at 11:30 AM Mostafa Gomaa <mg...@trendak.com>
>>>>>> wrote:
>>>>>>
>>>>>>
>>>>>> I am currently using apache storm 1.0.2 with elasticsearch 2.2.1 and
>>>>>> using the elasticsearch bolt to write some data.
>>>>>> The machines are on microsoft azure environment, and the ES bolt is
>>>>>> giving me this error
>>>>>> java.lang.RuntimeException: org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException:
>>>>>> Connection error (check network and/or proxy settings)- all nodes failed;
>>>>>> tried [[127.0.0.1:9200]]
>>>>>> my current configurations doesn't include localhost as elasticsearch
>>>>>> node but it keep saying that it tried localhost, and the thing is that i
>>>>>> can curl the elasticsearch node from the storm machine's terminal and it
>>>>>> can be accessed
>>>>>>
>>>>>>
>>>>>>
>>>>
>>>
>>>
>>> --
>>> Thanks
>>> Zhechao Ma
>>>
>>
>>
>
--
Thanks
Zhechao Ma
Re: ESBolt error
Posted by saiprasad mishra <sa...@gmail.com>.
Did you override the es.nodes property, which should be the remote host of
your elastic cluster (any one host from your es cluster should work)
https://www.elastic.co/guide/en/elasticsearch/hadoop/master/configuration.html
Regards
Sai
On Sat, Nov 5, 2016 at 11:57 PM, Mostafa Gomaa <mg...@trendak.com> wrote:
> Hi Zhechao,
>
> Thanks for the response. I am actually using that bolt, and it's giving me
> that error.
>
> On Fri, Nov 4, 2016 at 5:23 AM, Zhechao Ma <ma...@gmail.com>
> wrote:
>
>> If you use both Storm 1.x and ES 2.x and try to import data to ES from
>> Storm, you can try elasitcsearch-hadoop 5.0.
>> ES-hadoop provides EsBolt which satisfies your demand.
>>
>> https://github.com/elastic/elasticsearch-hadoop
>>
>> 2016-11-04 1:51 GMT+08:00 Mostafa Gomaa <mg...@trendak.com>:
>>
>>> Thanks Aaron, It's probably a network/firewall issue. I'll try to fiddle
>>> around to what's going on.
>>>
>>> On Thu, Nov 3, 2016 at 7:42 PM, Aaron Niskodé-Dossett <dossett@gmail.com
>>> > wrote:
>>>
>>>> Oh, interesting. I believe that's the same error I saw when I tried to
>>>> run the Storm bolt (which only support 1.X) against a 2.X server. Sorry,
>>>> other than that I'm not sure what could be causing your problem.
>>>>
>>>> On Thu, Nov 3, 2016 at 12:39 PM Mostafa Gomaa <mg...@trendak.com>
>>>> wrote:
>>>>
>>>>> Hi Aaron,
>>>>>
>>>>> Thanks for the response. I am actually using the bolt you linked me
>>>>> to. Any ideas?
>>>>>
>>>>> On Thu, Nov 3, 2016 at 7:36 PM, Aaron Niskodé-Dossett <
>>>>> dossett@gmail.com> wrote:
>>>>>
>>>>> Hi Mostafa Gomaa -- Unfortunately Storm's bolt does not support
>>>>> Elastic 2.X. There is a PR to add this support, which I need to put some
>>>>> work into. In the meantime, you could try elastic's bolt (
>>>>> https://www.elastic.co/guide/en/elasticsearch/hadoop/curren
>>>>> t/storm.html).
>>>>>
>>>>> Thanks, Aaron
>>>>>
>>>>> On Thu, Nov 3, 2016 at 11:30 AM Mostafa Gomaa <mg...@trendak.com>
>>>>> wrote:
>>>>>
>>>>>
>>>>> I am currently using apache storm 1.0.2 with elasticsearch 2.2.1 and
>>>>> using the elasticsearch bolt to write some data.
>>>>> The machines are on microsoft azure environment, and the ES bolt is
>>>>> giving me this error
>>>>> java.lang.RuntimeException: org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException:
>>>>> Connection error (check network and/or proxy settings)- all nodes failed;
>>>>> tried [[127.0.0.1:9200]]
>>>>> my current configurations doesn't include localhost as elasticsearch
>>>>> node but it keep saying that it tried localhost, and the thing is that i
>>>>> can curl the elasticsearch node from the storm machine's terminal and it
>>>>> can be accessed
>>>>>
>>>>>
>>>>>
>>>
>>
>>
>> --
>> Thanks
>> Zhechao Ma
>>
>
>
Re: ESBolt error
Posted by Mostafa Gomaa <mg...@trendak.com>.
Hi Zhechao,
Thanks for the response. I am actually using that bolt, and it's giving me
that error.
On Fri, Nov 4, 2016 at 5:23 AM, Zhechao Ma <ma...@gmail.com>
wrote:
> If you use both Storm 1.x and ES 2.x and try to import data to ES from
> Storm, you can try elasitcsearch-hadoop 5.0.
> ES-hadoop provides EsBolt which satisfies your demand.
>
> https://github.com/elastic/elasticsearch-hadoop
>
> 2016-11-04 1:51 GMT+08:00 Mostafa Gomaa <mg...@trendak.com>:
>
>> Thanks Aaron, It's probably a network/firewall issue. I'll try to fiddle
>> around to what's going on.
>>
>> On Thu, Nov 3, 2016 at 7:42 PM, Aaron Niskodé-Dossett <do...@gmail.com>
>> wrote:
>>
>>> Oh, interesting. I believe that's the same error I saw when I tried to
>>> run the Storm bolt (which only support 1.X) against a 2.X server. Sorry,
>>> other than that I'm not sure what could be causing your problem.
>>>
>>> On Thu, Nov 3, 2016 at 12:39 PM Mostafa Gomaa <mg...@trendak.com>
>>> wrote:
>>>
>>>> Hi Aaron,
>>>>
>>>> Thanks for the response. I am actually using the bolt you linked me to.
>>>> Any ideas?
>>>>
>>>> On Thu, Nov 3, 2016 at 7:36 PM, Aaron Niskodé-Dossett <
>>>> dossett@gmail.com> wrote:
>>>>
>>>> Hi Mostafa Gomaa -- Unfortunately Storm's bolt does not support Elastic
>>>> 2.X. There is a PR to add this support, which I need to put some work
>>>> into. In the meantime, you could try elastic's bolt (
>>>> https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html
>>>> ).
>>>>
>>>> Thanks, Aaron
>>>>
>>>> On Thu, Nov 3, 2016 at 11:30 AM Mostafa Gomaa <mg...@trendak.com>
>>>> wrote:
>>>>
>>>>
>>>> I am currently using apache storm 1.0.2 with elasticsearch 2.2.1 and
>>>> using the elasticsearch bolt to write some data.
>>>> The machines are on microsoft azure environment, and the ES bolt is
>>>> giving me this error
>>>> java.lang.RuntimeException: org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException:
>>>> Connection error (check network and/or proxy settings)- all nodes failed;
>>>> tried [[127.0.0.1:9200]]
>>>> my current configurations doesn't include localhost as elasticsearch
>>>> node but it keep saying that it tried localhost, and the thing is that i
>>>> can curl the elasticsearch node from the storm machine's terminal and it
>>>> can be accessed
>>>>
>>>>
>>>>
>>
>
>
> --
> Thanks
> Zhechao Ma
>
Re: ESBolt error
Posted by Zhechao Ma <ma...@gmail.com>.
If you use both Storm 1.x and ES 2.x and try to import data to ES from
Storm, you can try elasitcsearch-hadoop 5.0.
ES-hadoop provides EsBolt which satisfies your demand.
https://github.com/elastic/elasticsearch-hadoop
2016-11-04 1:51 GMT+08:00 Mostafa Gomaa <mg...@trendak.com>:
> Thanks Aaron, It's probably a network/firewall issue. I'll try to fiddle
> around to what's going on.
>
> On Thu, Nov 3, 2016 at 7:42 PM, Aaron Niskodé-Dossett <do...@gmail.com>
> wrote:
>
>> Oh, interesting. I believe that's the same error I saw when I tried to
>> run the Storm bolt (which only support 1.X) against a 2.X server. Sorry,
>> other than that I'm not sure what could be causing your problem.
>>
>> On Thu, Nov 3, 2016 at 12:39 PM Mostafa Gomaa <mg...@trendak.com> wrote:
>>
>>> Hi Aaron,
>>>
>>> Thanks for the response. I am actually using the bolt you linked me to.
>>> Any ideas?
>>>
>>> On Thu, Nov 3, 2016 at 7:36 PM, Aaron Niskodé-Dossett <dossett@gmail.com
>>> > wrote:
>>>
>>> Hi Mostafa Gomaa -- Unfortunately Storm's bolt does not support Elastic
>>> 2.X. There is a PR to add this support, which I need to put some work
>>> into. In the meantime, you could try elastic's bolt (
>>> https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html
>>> ).
>>>
>>> Thanks, Aaron
>>>
>>> On Thu, Nov 3, 2016 at 11:30 AM Mostafa Gomaa <mg...@trendak.com>
>>> wrote:
>>>
>>>
>>> I am currently using apache storm 1.0.2 with elasticsearch 2.2.1 and
>>> using the elasticsearch bolt to write some data.
>>> The machines are on microsoft azure environment, and the ES bolt is
>>> giving me this error
>>> java.lang.RuntimeException: org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException:
>>> Connection error (check network and/or proxy settings)- all nodes failed;
>>> tried [[127.0.0.1:9200]]
>>> my current configurations doesn't include localhost as elasticsearch
>>> node but it keep saying that it tried localhost, and the thing is that i
>>> can curl the elasticsearch node from the storm machine's terminal and it
>>> can be accessed
>>>
>>>
>>>
>
--
Thanks
Zhechao Ma
Re: ESBolt error
Posted by Mostafa Gomaa <mg...@trendak.com>.
Thanks Aaron, It's probably a network/firewall issue. I'll try to fiddle
around to what's going on.
On Thu, Nov 3, 2016 at 7:42 PM, Aaron Niskodé-Dossett <do...@gmail.com>
wrote:
> Oh, interesting. I believe that's the same error I saw when I tried to
> run the Storm bolt (which only support 1.X) against a 2.X server. Sorry,
> other than that I'm not sure what could be causing your problem.
>
> On Thu, Nov 3, 2016 at 12:39 PM Mostafa Gomaa <mg...@trendak.com> wrote:
>
>> Hi Aaron,
>>
>> Thanks for the response. I am actually using the bolt you linked me to.
>> Any ideas?
>>
>> On Thu, Nov 3, 2016 at 7:36 PM, Aaron Niskodé-Dossett <do...@gmail.com>
>> wrote:
>>
>> Hi Mostafa Gomaa -- Unfortunately Storm's bolt does not support Elastic
>> 2.X. There is a PR to add this support, which I need to put some work
>> into. In the meantime, you could try elastic's bolt (
>> https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html).
>>
>> Thanks, Aaron
>>
>> On Thu, Nov 3, 2016 at 11:30 AM Mostafa Gomaa <mg...@trendak.com> wrote:
>>
>>
>> I am currently using apache storm 1.0.2 with elasticsearch 2.2.1 and
>> using the elasticsearch bolt to write some data.
>> The machines are on microsoft azure environment, and the ES bolt is
>> giving me this error
>> java.lang.RuntimeException: org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException:
>> Connection error (check network and/or proxy settings)- all nodes failed;
>> tried [[127.0.0.1:9200]]
>> my current configurations doesn't include localhost as elasticsearch node
>> but it keep saying that it tried localhost, and the thing is that i can
>> curl the elasticsearch node from the storm machine's terminal and it can be
>> accessed
>>
>>
>>
Re: ESBolt error
Posted by Aaron Niskodé-Dossett <do...@gmail.com>.
Oh, interesting. I believe that's the same error I saw when I tried to run
the Storm bolt (which only support 1.X) against a 2.X server. Sorry, other
than that I'm not sure what could be causing your problem.
On Thu, Nov 3, 2016 at 12:39 PM Mostafa Gomaa <mg...@trendak.com> wrote:
> Hi Aaron,
>
> Thanks for the response. I am actually using the bolt you linked me to.
> Any ideas?
>
> On Thu, Nov 3, 2016 at 7:36 PM, Aaron Niskodé-Dossett <do...@gmail.com>
> wrote:
>
> Hi Mostafa Gomaa -- Unfortunately Storm's bolt does not support Elastic
> 2.X. There is a PR to add this support, which I need to put some work
> into. In the meantime, you could try elastic's bolt (
> https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html).
>
> Thanks, Aaron
>
> On Thu, Nov 3, 2016 at 11:30 AM Mostafa Gomaa <mg...@trendak.com> wrote:
>
>
> I am currently using apache storm 1.0.2 with elasticsearch 2.2.1 and using
> the elasticsearch bolt to write some data.
> The machines are on microsoft azure environment, and the ES bolt is giving
> me this error
> java.lang.RuntimeException:
> org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException: Connection
> error (check network and/or proxy settings)- all nodes failed; tried [[
> 127.0.0.1:9200]]
> my current configurations doesn't include localhost as elasticsearch node
> but it keep saying that it tried localhost, and the thing is that i can
> curl the elasticsearch node from the storm machine's terminal and it can be
> accessed
>
>
>
Re: ESBolt error
Posted by Mostafa Gomaa <mg...@trendak.com>.
Hi Aaron,
Thanks for the response. I am actually using the bolt you linked me to. Any
ideas?
On Thu, Nov 3, 2016 at 7:36 PM, Aaron Niskodé-Dossett <do...@gmail.com>
wrote:
> Hi Mostafa Gomaa -- Unfortunately Storm's bolt does not support Elastic
> 2.X. There is a PR to add this support, which I need to put some work
> into. In the meantime, you could try elastic's bolt (
> https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html).
>
> Thanks, Aaron
>
> On Thu, Nov 3, 2016 at 11:30 AM Mostafa Gomaa <mg...@trendak.com> wrote:
>
>>
>> I am currently using apache storm 1.0.2 with elasticsearch 2.2.1 and
>> using the elasticsearch bolt to write some data.
>> The machines are on microsoft azure environment, and the ES bolt is
>> giving me this error
>> java.lang.RuntimeException: org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException:
>> Connection error (check network and/or proxy settings)- all nodes failed;
>> tried [[127.0.0.1:9200]]
>> my current configurations doesn't include localhost as elasticsearch node
>> but it keep saying that it tried localhost, and the thing is that i can
>> curl the elasticsearch node from the storm machine's terminal and it can be
>> accessed
>>
>>
Re: ESBolt error
Posted by Aaron Niskodé-Dossett <do...@gmail.com>.
Hi Mostafa Gomaa -- Unfortunately Storm's bolt does not support Elastic
2.X. There is a PR to add this support, which I need to put some work
into. In the meantime, you could try elastic's bolt (
https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html).
Thanks, Aaron
On Thu, Nov 3, 2016 at 11:30 AM Mostafa Gomaa <mg...@trendak.com> wrote:
>
> I am currently using apache storm 1.0.2 with elasticsearch 2.2.1 and using
> the elasticsearch bolt to write some data.
> The machines are on microsoft azure environment, and the ES bolt is giving
> me this error
> java.lang.RuntimeException:
> org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException: Connection
> error (check network and/or proxy settings)- all nodes failed; tried [[
> 127.0.0.1:9200]]
> my current configurations doesn't include localhost as elasticsearch node
> but it keep saying that it tried localhost, and the thing is that i can
> curl the elasticsearch node from the storm machine's terminal and it can be
> accessed
>
>