You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by José Luis Larroque <la...@gmail.com> on 2015/08/11 03:46:07 UTC
Re: Graph 1.1.0 - Worker failed during input split (currently not supported)
Hello everybody. I'm executing a BFS algoritm on giraph, and i hit with
this error. I searched for uppercase letters in the following files:
/etc/*hostname*
/etc/*hosts*
/usr/local/hadoop/zookeeper/conf/*zoo.cfg* (contains zookeeper
configuration)
/usr/local/hadoop/etc/hadoop/*masters*
/usr/local/hadoop/etc/hadoop/*slaves*
In my entire cluster (one master and two child nodes)*. *I couldn't find a
single uppercase letter in those configurations files. My nodes have this
names:
*hdnode01*
*hadoop100*
*hadoop101*
Is there any file left that i should check in order to detect where is my
mistake? This problem can be related with any other configuration problem?
Thanks Alessio for your contribution, you help me a lot writing this, and
you could help me a lot more if you help me here !! :D
Bye!
Jose Luis Larroque
Pd: Numbers aren't considered uppercase letters... right?
2015-02-10 5:56 GMT-03:00 Alessio Arleo <in...@icloud.com>:
> Hello everybody
>
> I’m here to share my experience with the error “Worker failed during input split (currently not supported)”. I have seen several help requests in this mailing list asking for help for this kind of situation, so I’d like to share my experience: it could help at least some of you.
>
> This is the incriminated error log:
>
> > barrierOnWorkerList: Missing chosen workers [Worker(hostname=01hw789772,
> > MRtaskID=1, port=30001)] on superstep -1
> > 2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.MasterThread:
> > masterThread: Master algorithm failed with IllegalStateException
> > java.lang.IllegalStateException: coordinateVertexInputSplits: Worker failed
> > during input split (currently not supported)
>
> In my case the error was related to Giraph-904 bug (
> https://issues.apache.org/jira/browse/GIRAPH-904). In fact, in the first
> line the system logs that there are missing workers (and my hostname was
> written in only lowercase chars, while my former hostname had both
> lowercase and uppercase chars). I managed to solve my issue by using a
> hostname made up by only lowercase chars.
>
> Hope this helps someone: in the meantime, I’ll report that this issue is
> still open (and not fixed) in Jira.
>
> ~~~~~~~~~~~~~~~~~~~
>
> Ing. Alessio Arleo
>
> Dottorando in Ingegneria Industriale e dell’Informazione
>
> Dottore Magistrale in Ingegneria Informatica e dell’Automazione
> Dottore in Ingegneria Informatica ed Elettronica
>
> Linkedin: it.linkedin.com/in/IngArleo
> Skype: Ing. Alessio Arleo
>
> Tel: +39 075 5853920
> Cell: +39 349 0575782
>
> ~~~~~~~~~~~~~~~~~~~
>
>
>
>
Re: Graph 1.1.0 - Worker failed during input split (currently not supported)
Posted by José Luis Larroque <la...@gmail.com>.
Finally, this problem was related to something else...in one container says
"*Worker failed during input split (currently not supported)*" but in
another one says a *totally different error*. I will send a separate email
for this. But i leave this here for documentation purposes.
Bye and thanks!
Jose
2015-08-12 1:03 GMT-03:00 José Luis Larroque <la...@gmail.com>:
> Thanks sonja for your answer. I check *core-site.xml* and
> *mapred-site.xml* on all nodes of the cluster. Also* yarn-site.xml* and
> *$HOME/.ssh/authorized_keys*.
>
> I looked for hdnode01, hadoop100 and hadoop101 using grep like this:
> *sudo grep -Riol "hadoop101" $HADOOP_HOME*
>
> I also search in $GIRAPH_HOME. I couldn't find any letter in uppercase.
>
> *grep -io* lets us search without giving attention to upper or lowercase
> letters, just search the value. I used it for searching if i have some
> uppercase letters for those values.
>
> I'm starting to believe that must be related, maybe, with something else.
> Anyway, help is always welcome!! :D
>
> Bye!
>
> 2015-08-11 5:38 GMT-03:00 Sonja Koenig <so...@uni-ulm.de>:
>
>> Hi there!
>>
>> Have you checked your hadoop config files ($HADOOP_HOME/conf)?
>> especially $HADOOP_HOME/conf/*core-site.xml*
>> and $HADOOP_HOME/conf/*mapred-site.xml*
>>
>> And you might also want to check in your ~/*.ssh/config* - if you have
>> one.
>>
>> Hope that helps :)
>> Sonja
>>
>>
>>
>> Am 11.08.2015 um 03:46 schrieb José Luis Larroque:
>>
>> Hello everybody. I'm executing a BFS algoritm on giraph, and i hit with
>> this error. I searched for uppercase letters in the following files:
>>
>> /etc/*hostname*
>> /etc/*hosts*
>>
>> /usr/local/hadoop/zookeeper/conf/*zoo.cfg* (contains zookeeper
>> configuration)
>> /usr/local/hadoop/etc/hadoop/*masters*
>> /usr/local/hadoop/etc/hadoop/*slaves*
>>
>>
>> In my entire cluster (one master and two child nodes)*. *I couldn't find
>> a single uppercase letter in those configurations files. My nodes have this
>> names:
>>
>> *hdnode01 *
>>
>> *hadoop100 *
>> *hadoop101*
>>
>> Is there any file left that i should check in order to detect where is my
>> mistake? This problem can be related with any other configuration problem?
>>
>> Thanks Alessio for your contribution, you help me a lot writing this, and
>> you could help me a lot more if you help me here !! :D
>>
>> Bye!
>> Jose Luis Larroque
>>
>> Pd: Numbers aren't considered uppercase letters... right?
>>
>> 2015-02-10 5:56 GMT-03:00 Alessio Arleo <in...@icloud.com>:
>>
>>> Hello everybody
>>>
>>> I’m here to share my experience with the error “Worker failed during input split (currently not supported)”. I have seen several help requests in this mailing list asking for help for this kind of situation, so I’d like to share my experience: it could help at least some of you.
>>>
>>> This is the incriminated error log:
>>>
>>> > barrierOnWorkerList: Missing chosen workers [Worker(hostname=01hw789772,
>>> > MRtaskID=1, port=30001)] on superstep -1
>>> > 2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.MasterThread:
>>> > masterThread: Master algorithm failed with IllegalStateException
>>> > java.lang.IllegalStateException: coordinateVertexInputSplits: Worker failed
>>> > during input split (currently not supported)
>>>
>>> In my case the error was related to Giraph-904 bug (
>>> https://issues.apache.org/jira/browse/GIRAPH-904). In fact, in the
>>> first line the system logs that there are missing workers (and my hostname
>>> was written in only lowercase chars, while my former hostname had both
>>> lowercase and uppercase chars). I managed to solve my issue by using a
>>> hostname made up by only lowercase chars.
>>>
>>> Hope this helps someone: in the meantime, I’ll report that this issue is
>>> still open (and not fixed) in Jira.
>>>
>>> ~~~~~~~~~~~~~~~~~~~
>>>
>>> Ing. Alessio Arleo
>>>
>>> Dottorando in Ingegneria Industriale e dell’Informazione
>>>
>>> Dottore Magistrale in Ingegneria Informatica e dell’Automazione
>>> Dottore in Ingegneria Informatica ed Elettronica
>>>
>>> Linkedin: it.linkedin.com/in/IngArleo
>>> Skype: Ing. Alessio Arleo
>>>
>>> Tel: +39 075 5853920
>>> Cell: +39 349 0575782
>>>
>>> ~~~~~~~~~~~~~~~~~~~
>>>
>>>
>>>
>>>
>>
>>
>
Re: Graph 1.1.0 - Worker failed during input split (currently not supported)
Posted by José Luis Larroque <la...@gmail.com>.
Thanks sonja for your answer. I check *core-site.xml* and *mapred-site.xml*
on all nodes of the cluster. Also* yarn-site.xml* and
*$HOME/.ssh/authorized_keys*.
I looked for hdnode01, hadoop100 and hadoop101 using grep like this:
*sudo grep -Riol "hadoop101" $HADOOP_HOME*
I also search in $GIRAPH_HOME. I couldn't find any letter in uppercase.
*grep -io* lets us search without giving attention to upper or lowercase
letters, just search the value. I used it for searching if i have some
uppercase letters for those values.
I'm starting to believe that must be related, maybe, with something else.
Anyway, help is always welcome!! :D
Bye!
2015-08-11 5:38 GMT-03:00 Sonja Koenig <so...@uni-ulm.de>:
> Hi there!
>
> Have you checked your hadoop config files ($HADOOP_HOME/conf)?
> especially $HADOOP_HOME/conf/*core-site.xml*
> and $HADOOP_HOME/conf/*mapred-site.xml*
>
> And you might also want to check in your ~/*.ssh/config* - if you have
> one.
>
> Hope that helps :)
> Sonja
>
>
>
> Am 11.08.2015 um 03:46 schrieb José Luis Larroque:
>
> Hello everybody. I'm executing a BFS algoritm on giraph, and i hit with
> this error. I searched for uppercase letters in the following files:
>
> /etc/*hostname*
> /etc/*hosts*
>
> /usr/local/hadoop/zookeeper/conf/*zoo.cfg* (contains zookeeper
> configuration)
> /usr/local/hadoop/etc/hadoop/*masters*
> /usr/local/hadoop/etc/hadoop/*slaves*
>
>
> In my entire cluster (one master and two child nodes)*. *I couldn't find
> a single uppercase letter in those configurations files. My nodes have this
> names:
>
> *hdnode01 *
>
> *hadoop100 *
> *hadoop101*
>
> Is there any file left that i should check in order to detect where is my
> mistake? This problem can be related with any other configuration problem?
>
> Thanks Alessio for your contribution, you help me a lot writing this, and
> you could help me a lot more if you help me here !! :D
>
> Bye!
> Jose Luis Larroque
>
> Pd: Numbers aren't considered uppercase letters... right?
>
> 2015-02-10 5:56 GMT-03:00 Alessio Arleo <in...@icloud.com>:
>
>> Hello everybody
>>
>> I’m here to share my experience with the error “Worker failed during input split (currently not supported)”. I have seen several help requests in this mailing list asking for help for this kind of situation, so I’d like to share my experience: it could help at least some of you.
>>
>> This is the incriminated error log:
>>
>> > barrierOnWorkerList: Missing chosen workers [Worker(hostname=01hw789772,
>> > MRtaskID=1, port=30001)] on superstep -1
>> > 2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.MasterThread:
>> > masterThread: Master algorithm failed with IllegalStateException
>> > java.lang.IllegalStateException: coordinateVertexInputSplits: Worker failed
>> > during input split (currently not supported)
>>
>> In my case the error was related to Giraph-904 bug (
>> https://issues.apache.org/jira/browse/GIRAPH-904). In fact, in the first
>> line the system logs that there are missing workers (and my hostname was
>> written in only lowercase chars, while my former hostname had both
>> lowercase and uppercase chars). I managed to solve my issue by using a
>> hostname made up by only lowercase chars.
>>
>> Hope this helps someone: in the meantime, I’ll report that this issue is
>> still open (and not fixed) in Jira.
>>
>> ~~~~~~~~~~~~~~~~~~~
>>
>> Ing. Alessio Arleo
>>
>> Dottorando in Ingegneria Industriale e dell’Informazione
>>
>> Dottore Magistrale in Ingegneria Informatica e dell’Automazione
>> Dottore in Ingegneria Informatica ed Elettronica
>>
>> Linkedin: it.linkedin.com/in/IngArleo
>> Skype: Ing. Alessio Arleo
>>
>> Tel: +39 075 5853920
>> Cell: +39 349 0575782
>>
>> ~~~~~~~~~~~~~~~~~~~
>>
>>
>>
>>
>
>
Re: Graph 1.1.0 - Worker failed during input split (currently not
supported)
Posted by Sonja Koenig <so...@uni-ulm.de>.
Hi there!
Have you checked your hadoop config files ($HADOOP_HOME/conf)?
especially $HADOOP_HOME/conf/*core-site.xml*
and $HADOOP_HOME/conf/*mapred-site.xml*
And you might also want to check in your ~/*.ssh/config* - if you have one.
Hope that helps :)
Sonja
Am 11.08.2015 um 03:46 schrieb José Luis Larroque:
> Hello everybody. I'm executing a BFS algoritm on giraph, and i hit
> with this error. I searched for uppercase letters in the following files:
>
> /etc/*hostname*
> /etc/*hosts*
>
> /usr/local/hadoop/zookeeper/conf/*zoo.cfg* (contains zookeeper
> configuration)
> /usr/local/hadoop/etc/hadoop/*masters*
> /usr/local/hadoop/etc/hadoop/*slaves*
>
>
> In my entire cluster (one master and two child nodes)*. *I couldn't
> find a single uppercase letter in those configurations files. My nodes
> have this names:
>
> *hdnode01
> *
> *hadoop100
> *
> *hadoop101*
>
> Is there any file left that i should check in order to detect where is
> my mistake? This problem can be related with any other configuration
> problem?
>
> Thanks Alessio for your contribution, you help me a lot writing this,
> and you could help me a lot more if you help me here !! :D
>
> Bye!
> Jose Luis Larroque
>
> Pd: Numbers aren't considered uppercase letters... right?
>
> 2015-02-10 5:56 GMT-03:00 Alessio Arleo <ingarleo@icloud.com
> <ma...@icloud.com>>:
>
> Hello everybody
>
> I’m here to share my experience with the error “Worker failed during input split (currently not supported)”. I have seen several help requests in this mailing list asking for help for this kind of situation, so I’d like to share my experience: it could help at least some of you.
>
> This is the incriminated error log:
>
> > barrierOnWorkerList: Missing chosen workers [Worker(hostname=01hw789772,
> > MRtaskID=1, port=30001)] on superstep -1
> > 2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.MasterThread:
> > masterThread: Master algorithm failed with IllegalStateException
> > java.lang.IllegalStateException: coordinateVertexInputSplits: Worker failed
> > during input split (currently not supported)
>
> In my case the error was related to Giraph-904 bug
> (https://issues.apache.org/jira/browse/GIRAPH-904). In fact, in
> the first line the system logs that there are missing workers (and
> my hostname was written in only lowercase chars, while my former
> hostname had both lowercase and uppercase chars). I managed to
> solve my issue by using a hostname made up by only lowercase chars.
>
> Hope this helps someone: in the meantime, I’ll report that this
> issue is still open (and not fixed) in Jira.
>
> ~~~~~~~~~~~~~~~~~~~
>
> Ing. Alessio Arleo
>
> Dottorando in Ingegneria Industriale e dell’Informazione
>
> Dottore Magistrale in Ingegneria Informatica e dell’Automazione
> Dottore in Ingegneria Informatica ed Elettronica
>
> Linkedin: it.linkedin.com/in/IngArleo
> <http://it.linkedin.com/in/IngArleo>
> Skype: Ing. Alessio Arleo
>
> Tel: +39 075 5853920
> Cell: +39 349 0575782
>
> ~~~~~~~~~~~~~~~~~~~
>
>
>
>