Re: _zkServer does not Exist

[Tripti Singh <tr...@yahoo-inc.com>]

Hi,
Update on this one.
I was able to resolve this error with the patch here:
https://issues.apache.org/jira/browse/GIRAPH-391

Thanks,
Tripti.

From: "Yahoo! Inc." <tr...@yahoo-inc.com>>
Reply-To: "user@giraph.apache.org<ma...@giraph.apache.org>" <us...@giraph.apache.org>>
Date: Monday, October 22, 2012 5:19 PM
To: "user@giraph.apache.org<ma...@giraph.apache.org>" <us...@giraph.apache.org>>
Subject: Re: _zkServer does not Exist

Hi,
I am trying to build Giraph with Hadoop_0.23 profile.
When I try to run the PageRankBenchmark, I get the following error:

Cmd> hadoop jar giraph-0.71-SNAPSHOT-for-hadoop-0.23.4.1210022201-jar-with-dependencies.jar org.apache.giraph.benchmark.PageRankBenchmark
 -Dmapred.job.tracker=<host:port> -Dgiraph.zkManagerDirectory='/tmp/giraph/cc/_bsp/_defaultZkManagerDir' -c 1 -e 2 -s 2 -V 10 -w 1

2012-10-22 10:53:33,446 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: yarn.app.mapreduce.am.job.client.port-range;  Ignoring.
2012-10-22 10:53:33,446 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.admin.reduce.child.java.opts;  Ignoring.
2012-10-22 10:53:33,447 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: hadoop.tmp.dir;  Ignoring.
2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper: setup: Set log level to info
2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper: Distributed cache is empty. Assuming fatjar.
2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper: setup: classpath @ {path}/job.jar for job org.apache.giraph.benchmark.PageRankBenchmark
2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration: mapred.job.id is deprecated. Instead, use mapreduce.job.id
2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration: job.local.dir is deprecated. Instead, use mapreduce.job.local.dir
2012-10-22 10:53:33,565 INFO [main] org.apache.giraph.zk.ZooKeeperManager: createCandidateStamp: Made the directory /tmp/giraph/cc/_bsp/_defaultZkManagerDir
2012-10-22 10:53:33,568 INFO [main] org.apache.giraph.zk.ZooKeeperManager: createCandidateStamp: Creating my filestamp /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_task/gsrd215n08.red.ygrid.yahoo.com 1
2012-10-22 10:53:33,601 INFO [main] org.apache.giraph.zk.ZooKeeperManager: getZooKeeperServerList: For task 1, got file 'zkServerList_gsrd208n08.red.ygrid.yahoo.com 0 ' (polling period is 3000)
2012-10-22 10:53:33,601 INFO [main] org.apache.giraph.zk.ZooKeeperManager: getZooKeeperServerList: Found [gsrd208n08.red.ygrid.yahoo.com, 0] 2 hosts in filename 'zkServerList_gsrd208n08.red.ygrid.yahoo.com 0 '
2012-10-22 10:53:33,603 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.IllegalStateException: run: Caught an unrecoverable exception java.io.FileNotFoundException: File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer does not exist.
        at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:595)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1212)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152)
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer does not exist.
        at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:796)
        at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:328)
        at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:573)
        ... 7 more
Caused by: java.io.FileNotFoundException: File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer does not exist.
        at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:362)
        at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:755)
        ... 9 more

2012-10-22 10:53:33,607 INFO [main] org.apache.hadoop.mapred.Task: Runnning cleanup for the task
2012-10-22 10:53:33,609 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping MapTask metrics system...
2012-10-22 10:53:33,610 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system stopped.
2012-10-22 10:53:33,610 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system shutdown complete.

How can I resolve this.

Thanks,
Tripti.