You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by Carmen Manzulli <ca...@gmail.com> on 2014/07/11 11:14:42 UTC

Problem when my Algorithm runs on giraph:loadVertices failed with KeeperException

hello, my name is Carmen and i've written my simple algorithm to read
triples from a file and to compute a selection of one of three elements; i
followed all indications to write my VertexInputFormat but, now, when Job
runs it gives me :

java.lang.IllegalStateException: run: Caught an unrecoverable
exception setup: loadVertices failed with KeeperException
	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:101)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
	at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalStateException: setup: loadVertices failed
with KeeperException
	at org.apache.giraph.worker.BspServiceWorker.setup(BspServiceWorker.java:515)
	at org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:260)
	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:91)
	... 7 more
Caused by: org.apache.zookeeper.KeeperException$NoNodeException:
KeeperErrorCode = NoNode for
/_hadoopBsp/job_201407110937_0001/_vertexInputSplitDir
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1496)
	at org.apache.giraph.zk.ZooKeeperExt.getChildrenExt(ZooKeeperExt.java:504)
	at org.apache.giraph.worker.BspServiceWorker.loadVertices(BspServiceWorker.java:305)
	at org.apache.giraph.worker.BspServiceWorker.setup(BspServiceWorker.java:510)
	... 9 more

and, from the command line:


hduser@carmen-HP-Pavilion-Sleekbook-15:/usr/local/hadoop$ bin/hadoop
jar /home/carmen/Desktop/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner sisinflab.SimpleSelectionComputation
-vif sisinflab.SimpleRDFVertexInputFormat -vip /user/hduser/labels.nt
-w 1
14/07/11 09:46:16 INFO utils.ConfigurationUtils: No edge input format
specified. Ensure your InputFormat does not require one.
14/07/11 09:46:16 INFO utils.ConfigurationUtils: No vertex output
format specified. Ensure your OutputFormat does not require one.
14/07/11 09:46:16 INFO utils.ConfigurationUtils: No edge output format
specified. Ensure your OutputFormat does not require one.
14/07/11 09:46:17 INFO job.GiraphJob: run: Since checkpointing is
disabled (default), do not allow any task retries (setting
mapred.map.max.attempts = 0, old value = 4)
14/07/11 09:46:17 WARN bsp.BspOutputFormat: checkOutputSpecs:
ImmutableOutputCommiter will not check anything
14/07/11 09:46:18 INFO job.GiraphJob: run: Tracking URL:
http://localhost:50030/jobdetails.jsp?jobid=job_201407110937_0001
14/07/11 09:46:34 INFO mapred.JobClient: Running job: job_201407110937_0001
14/07/11 09:46:34 INFO mapred.JobClient: Job complete: job_201407110937_0001
14/07/11 09:46:34 INFO mapred.JobClient: Counters: 5
14/07/11 09:46:34 INFO mapred.JobClient:   Job Counters
14/07/11 09:46:34 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=22485
14/07/11 09:46:34 INFO mapred.JobClient:     Total time spent by all
reduces waiting after reserving slots (ms)=0
14/07/11 09:46:34 INFO mapred.JobClient:     Total time spent by all
maps waiting after reserving slots (ms)=0
14/07/11 09:46:34 INFO mapred.JobClient:     Launched map tasks=2
14/07/11 09:46:34 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=1453
hduser@carmen-HP-Pavilion-Sleekbook-15:/usr/local/hadoop$ bin/hadoop
jar /home/carmen/Desktop/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner sisinflab.SimpleSelectionComputation
-vif sisinflab.SimpleRDFVertexInputFormat -vip /user/hduser/labels.nt
-w 1
14/07/11 10:19:52 INFO utils.ConfigurationUtils: No edge input format
specified. Ensure your InputFormat does not require one.
14/07/11 10:19:52 INFO utils.ConfigurationUtils: No vertex output
format specified. Ensure your OutputFormat does not require one.
14/07/11 10:19:52 INFO utils.ConfigurationUtils: No edge output format
specified. Ensure your OutputFormat does not require one.
14/07/11 10:19:52 INFO job.GiraphJob: run: Since checkpointing is
disabled (default), do not allow any task retries (setting
mapred.map.max.attempts = 0, old value = 4)
14/07/11 10:19:53 WARN bsp.BspOutputFormat: checkOutputSpecs:
ImmutableOutputCommiter will not check anything
14/07/11 10:19:53 INFO job.GiraphJob: run: Tracking URL:
http://localhost:50030/jobdetails.jsp?jobid=job_201407110937_0002
14/07/11 10:20:06 INFO mapred.JobClient: Running job: job_201407110937_0002
14/07/11 10:20:06 INFO mapred.JobClient: Job complete: job_201407110937_0002
14/07/11 10:20:06 INFO mapred.JobClient: Counters: 5
14/07/11 10:20:06 INFO mapred.JobClient:   Job Counters
14/07/11 10:20:06 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=17364
14/07/11 10:20:06 INFO mapred.JobClient:     Total time spent by all
reduces waiting after reserving slots (ms)=0
14/07/11 10:20:06 INFO mapred.JobClient:     Total time spent by all
maps waiting after reserving slots (ms)=0
14/07/11 10:20:06 INFO mapred.JobClient:     Launched map tasks=2
14/07/11 10:20:06 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=2001

i don't understand how can i resolve this problem because i don't know the
root (is it about configurations?, is it about my inputformat?); please
somebody can help me?