You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by Gustavo Enrique Salazar Torres <gs...@ime.usp.br> on 2014/06/10 21:38:07 UTC
Help needed running Pagerank benchmarks
Hi there:
I'm running a little test on a hadoop 2.2.0 installation with Giraph
1.1.0-snapshot.
Here is the command I'm running:
hadoop jar
giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
org.apache.giraph.benchmark.PageRankBenchmark -Dgiraph.zkList=127.0.0.1:2181
-e 3 -s 10 -v -V 1000000 -w 8
This is my mapred-site.xml:
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapreduce.jobtracker.address</name>
<value>localhost:54311</value>
</property>
<property>
<name>mapreduce.tasktracker.map.tasks.maximum</name>
<value>10</value>
</property>
<property>
<name>mapreduce.tasktracker.map.tasks.minimum</name>
<value>10</value>
</property>
<property>
<name>mapreduce.job.maps</name>
<value>10</value>
</property>
and I'm getting this at the application log:
org.apache.giraph.master.BspServiceMaster: checkWorkers: Only found 5
responses of 8 needed to start superstep -1. Reporting every 30000 msecs,
535020 more msecs left before giving up
And finally the job finishes with an error (after a long wait).
Did anybody have this problem?
This doesn't happen if I run the benchmark with 5 workers. I couldn't find
any hint why it works with 5 and not with 6 or more.
Thanks for any help.
Gustavo