You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by Liannet Reyes <li...@gmail.com> on 2014/03/04 21:36:45 UTC
Re:
Have you tried this link
https://giraph.apache.org/quick_start.html#qs_section_4 ?
I follow that guide step by step and did work!
good luck!
2014-03-04 18:46 GMT+01:00 Jyoti Yadav <ra...@gmail.com>:
> Hi Giraph Experts..
>
> I am just new to hadoop 2.2.0.. I am not able to compile even sample
> example.
>
> I gave following command.
>
>
> hadoop jar
> /home/hadoopAdmin/hadoop/giraph-1.0.0/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
> org.apache.giraph.GiraphRunner -Dgiraph.zkList=127.0.0.1:2181 -libjars
> /home/hadoopAdmin/hadoop/giraph-1.0.0/giraph-core/target/giraph-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
> -vip /user/nitw-jyothi/graphInput/input -vof
> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
> /user/nitw-jyothi/goutput2/shortestpathsC2 -ca
> SimpleShortestPathsVertex.source=2 -w 2
>
>
> And following error is thrownn..
>
> INFO yarn.GiraphYarnClient: GiraphApplicationMaster container request was
> submitted to ResourceManager for job: Giraph:
> org.apache.giraph.examples.SimpleShortestPathsComputation
> 14/03/04 22:53:11 INFO yarn.GiraphYarnClient: Giraph:
> org.apache.giraph.examples.SimpleShortestPathsComputation, Elapsed: 0.84
> secs
> 14/03/04 22:53:11 INFO yarn.GiraphYarnClient:
> appattempt_1393923555664_0021_000001, State: ACCEPTED, Containers used: 1
> 14/03/04 22:53:13
> * ERROR yarn.GiraphYarnClient: Giraph:
> org.apache.giraph.examples.SimpleShortestPathsComputation reports FAILED
> state, diagnostics show: Application application_1393923555664_0021 failed
> 2 times due to AM Container for appattempt_1393923555664_0021_000002 exited
> with exitCode: 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException: *
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
> at org.apache.hadoop.util.Shell.run(Shell.java:379)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
>
>
> .Failing this attempt.. Failing the application.
> 14/03/04 22:53:13 INFO yarn.GiraphYarnClient: Cleaning up HDFS distributed
> cache directory for Giraph job.
> 14/03/04 22:53:13 INFO yarn.GiraphYarnClient: Completed Giraph:
> org.apache.giraph.examples.SimpleShortestPathsComputation: FAILED, total
> running time: 0 minutes, 3 seconds.
>
>
> Can anyone give me a pointer to fix this..
>
> Thanks..
> Jyoti
>
Re:
Posted by Arko Provo Mukherjee <ar...@gmail.com>.
Thanks much! I will surely try this out.
Warm regards
Arko
On Tue, Mar 4, 2014 at 2:36 PM, Liannet Reyes <li...@gmail.com> wrote:
> Have you tried this link
> https://giraph.apache.org/quick_start.html#qs_section_4 ?
>
> I follow that guide step by step and did work!
>
> good luck!
>
>
>
>
>
> 2014-03-04 18:46 GMT+01:00 Jyoti Yadav <ra...@gmail.com>:
>
>> Hi Giraph Experts..
>>
>> I am just new to hadoop 2.2.0.. I am not able to compile even sample
>> example.
>>
>> I gave following command.
>>
>>
>> hadoop jar
>> /home/hadoopAdmin/hadoop/giraph-1.0.0/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
>> org.apache.giraph.GiraphRunner -Dgiraph.zkList=127.0.0.1:2181 -libjars
>> /home/hadoopAdmin/hadoop/giraph-1.0.0/giraph-core/target/giraph-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
>> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
>> -vip /user/nitw-jyothi/graphInput/input -vof
>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>> /user/nitw-jyothi/goutput2/shortestpathsC2 -ca
>> SimpleShortestPathsVertex.source=2 -w 2
>>
>>
>> And following error is thrownn..
>>
>> INFO yarn.GiraphYarnClient: GiraphApplicationMaster container request was
>> submitted to ResourceManager for job: Giraph:
>> org.apache.giraph.examples.SimpleShortestPathsComputation
>> 14/03/04 22:53:11 INFO yarn.GiraphYarnClient: Giraph:
>> org.apache.giraph.examples.SimpleShortestPathsComputation, Elapsed: 0.84
>> secs
>> 14/03/04 22:53:11 INFO yarn.GiraphYarnClient:
>> appattempt_1393923555664_0021_000001, State: ACCEPTED, Containers used: 1
>> 14/03/04 22:53:13
>> * ERROR yarn.GiraphYarnClient: Giraph:
>> org.apache.giraph.examples.SimpleShortestPathsComputation reports FAILED
>> state, diagnostics show: Application application_1393923555664_0021 failed
>> 2 times due to AM Container for appattempt_1393923555664_0021_000002 exited
>> with exitCode: 1 due to: Exception from container-launch:
>> org.apache.hadoop.util.Shell$ExitCodeException: *
>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
>> at org.apache.hadoop.util.Shell.run(Shell.java:379)
>> at
>> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>>
>>
>> .Failing this attempt.. Failing the application.
>> 14/03/04 22:53:13 INFO yarn.GiraphYarnClient: Cleaning up HDFS
>> distributed cache directory for Giraph job.
>> 14/03/04 22:53:13 INFO yarn.GiraphYarnClient: Completed Giraph:
>> org.apache.giraph.examples.SimpleShortestPathsComputation: FAILED, total
>> running time: 0 minutes, 3 seconds.
>>
>>
>> Can anyone give me a pointer to fix this..
>>
>> Thanks..
>> Jyoti
>>
>
>
Re:
Posted by Eli Reisman <ap...@gmail.com>.
It looks like you were able to get an ApplicationMaster to run on your YARN
cluster, but when it requested some containers for actual Giraph
master/worker tasks, it died. Could your YARN cluster configs? Could be
permissions issue too if you're running a local job.
On Tue, Mar 4, 2014 at 3:36 PM, Rocky Grey <ro...@gmail.com> wrote:
> Hi Liannet,
>
> Were you able to run giraph program in Hadoop 2.2.0? Seems like running it
> in Hadoop 2.2.0 is a challenge. May be if some one who has success running
> in 2.2.0 can update the documentation that would be very helpful. Lot of
> people are having similar issues.
>
>
> On Tue, Mar 4, 2014 at 12:36 PM, Liannet Reyes <li...@gmail.com>wrote:
>
>> Have you tried this link
>> https://giraph.apache.org/quick_start.html#qs_section_4 ?
>>
>> I follow that guide step by step and did work!
>>
>> good luck!
>>
>>
>>
>>
>>
>> 2014-03-04 18:46 GMT+01:00 Jyoti Yadav <ra...@gmail.com>:
>>
>> Hi Giraph Experts..
>>>
>>> I am just new to hadoop 2.2.0.. I am not able to compile even sample
>>> example.
>>>
>>> I gave following command.
>>>
>>>
>>> hadoop jar
>>> /home/hadoopAdmin/hadoop/giraph-1.0.0/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
>>> org.apache.giraph.GiraphRunner -Dgiraph.zkList=127.0.0.1:2181 -libjars
>>> /home/hadoopAdmin/hadoop/giraph-1.0.0/giraph-core/target/giraph-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
>>> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
>>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
>>> -vip /user/nitw-jyothi/graphInput/input -vof
>>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>>> /user/nitw-jyothi/goutput2/shortestpathsC2 -ca
>>> SimpleShortestPathsVertex.source=2 -w 2
>>>
>>>
>>> And following error is thrownn..
>>>
>>> INFO yarn.GiraphYarnClient: GiraphApplicationMaster container request
>>> was submitted to ResourceManager for job: Giraph:
>>> org.apache.giraph.examples.SimpleShortestPathsComputation
>>> 14/03/04 22:53:11 INFO yarn.GiraphYarnClient: Giraph:
>>> org.apache.giraph.examples.SimpleShortestPathsComputation, Elapsed: 0.84
>>> secs
>>> 14/03/04 22:53:11 INFO yarn.GiraphYarnClient:
>>> appattempt_1393923555664_0021_000001, State: ACCEPTED, Containers used: 1
>>> 14/03/04 22:53:13
>>> * ERROR yarn.GiraphYarnClient: Giraph:
>>> org.apache.giraph.examples.SimpleShortestPathsComputation reports FAILED
>>> state, diagnostics show: Application application_1393923555664_0021 failed
>>> 2 times due to AM Container for appattempt_1393923555664_0021_000002 exited
>>> with exitCode: 1 due to: Exception from container-launch:
>>> org.apache.hadoop.util.Shell$ExitCodeException: *
>>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
>>> at org.apache.hadoop.util.Shell.run(Shell.java:379)
>>> at
>>> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
>>> at
>>> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>>> at
>>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
>>> at
>>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:744)
>>>
>>>
>>> .Failing this attempt.. Failing the application.
>>> 14/03/04 22:53:13 INFO yarn.GiraphYarnClient: Cleaning up HDFS
>>> distributed cache directory for Giraph job.
>>> 14/03/04 22:53:13 INFO yarn.GiraphYarnClient: Completed Giraph:
>>> org.apache.giraph.examples.SimpleShortestPathsComputation: FAILED, total
>>> running time: 0 minutes, 3 seconds.
>>>
>>>
>>> Can anyone give me a pointer to fix this..
>>>
>>> Thanks..
>>> Jyoti
>>>
>>
>>
>
Re:
Posted by Rocky Grey <ro...@gmail.com>.
Hi Liannet,
Were you able to run giraph program in Hadoop 2.2.0? Seems like running it
in Hadoop 2.2.0 is a challenge. May be if some one who has success running
in 2.2.0 can update the documentation that would be very helpful. Lot of
people are having similar issues.
On Tue, Mar 4, 2014 at 12:36 PM, Liannet Reyes <li...@gmail.com> wrote:
> Have you tried this link
> https://giraph.apache.org/quick_start.html#qs_section_4 ?
>
> I follow that guide step by step and did work!
>
> good luck!
>
>
>
>
>
> 2014-03-04 18:46 GMT+01:00 Jyoti Yadav <ra...@gmail.com>:
>
> Hi Giraph Experts..
>>
>> I am just new to hadoop 2.2.0.. I am not able to compile even sample
>> example.
>>
>> I gave following command.
>>
>>
>> hadoop jar
>> /home/hadoopAdmin/hadoop/giraph-1.0.0/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
>> org.apache.giraph.GiraphRunner -Dgiraph.zkList=127.0.0.1:2181 -libjars
>> /home/hadoopAdmin/hadoop/giraph-1.0.0/giraph-core/target/giraph-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
>> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
>> -vip /user/nitw-jyothi/graphInput/input -vof
>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>> /user/nitw-jyothi/goutput2/shortestpathsC2 -ca
>> SimpleShortestPathsVertex.source=2 -w 2
>>
>>
>> And following error is thrownn..
>>
>> INFO yarn.GiraphYarnClient: GiraphApplicationMaster container request was
>> submitted to ResourceManager for job: Giraph:
>> org.apache.giraph.examples.SimpleShortestPathsComputation
>> 14/03/04 22:53:11 INFO yarn.GiraphYarnClient: Giraph:
>> org.apache.giraph.examples.SimpleShortestPathsComputation, Elapsed: 0.84
>> secs
>> 14/03/04 22:53:11 INFO yarn.GiraphYarnClient:
>> appattempt_1393923555664_0021_000001, State: ACCEPTED, Containers used: 1
>> 14/03/04 22:53:13
>> * ERROR yarn.GiraphYarnClient: Giraph:
>> org.apache.giraph.examples.SimpleShortestPathsComputation reports FAILED
>> state, diagnostics show: Application application_1393923555664_0021 failed
>> 2 times due to AM Container for appattempt_1393923555664_0021_000002 exited
>> with exitCode: 1 due to: Exception from container-launch:
>> org.apache.hadoop.util.Shell$ExitCodeException: *
>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
>> at org.apache.hadoop.util.Shell.run(Shell.java:379)
>> at
>> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>>
>>
>> .Failing this attempt.. Failing the application.
>> 14/03/04 22:53:13 INFO yarn.GiraphYarnClient: Cleaning up HDFS
>> distributed cache directory for Giraph job.
>> 14/03/04 22:53:13 INFO yarn.GiraphYarnClient: Completed Giraph:
>> org.apache.giraph.examples.SimpleShortestPathsComputation: FAILED, total
>> running time: 0 minutes, 3 seconds.
>>
>>
>> Can anyone give me a pointer to fix this..
>>
>> Thanks..
>> Jyoti
>>
>
>