Problem with zookeeper setup

[Jonathan Bishop <jb...@gmail.com>]

Hi,

I am exploring Giraph 0.1 and was able to download, build, and run all the
tests - all 58 passed.

I can also run the SimpleShortestPathsVertex test using the supplied giraph
jar. However, when I copy the java src file into eclipse and build my own
jar I get the following error which leads me to believe that something is
going wrong with the ZK setup.


12/06/19 17:31:31 INFO mapred.JobClient: Running job: job_201206191708_0003
12/06/19 17:31:32 INFO mapred.JobClient:  map 0% reduce 0%
12/06/19 17:32:14 INFO mapred.JobClient: Task Id :
attempt_201206191708_0003_m_000000_0, Status : FAILED
java.lang.IllegalStateException: run: Caught an unrecoverable exception
onlineZooKeeperServers: Failed to connect in 10 tries!
at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:641)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalStateException: onlineZooKeeperServers: Failed
to connect in 10 tries!
at
org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:658)
at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:409)
at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:630)
... 7 more

attempt_201206191708_0003_m_000000_0: log4j:WARN No appenders could be
found for logger (org.apache.giraph.zk.ZooKeeperManager).
attempt_201206191708_0003_m_000000_0: log4j:WARN Please initialize the
log4j system properly.


BTW, I needed to add the following line to get this to run from my own jar
file...

job.setJarByClass(SimpleShortestPathsVertex.class)


Not sure if that is related but it seems that it will not run without this
(it can not find  SimpleShortestPathsVertex.

Thanks,

Jon Bishop

Re: Problem with zookeeper setup

[Avery Ching <ac...@apache.org>]

If you're running without a real Hadoop instance, you'll need to blow 
away the zk directories after running the first time.  Hope that helps,

Avery

On 6/19/12 5:39 PM, Jonathan Bishop wrote:
> Hi,
>
> I am exploring Giraph 0.1 and was able to download, build, and run all 
> the tests - all 58 passed.
>
> I can also run the SimpleShortestPathsVertex test using the supplied 
> giraph jar. However, when I copy the java src file into eclipse and 
> build my own jar I get the following error which leads me to believe 
> that something is going wrong with the ZK setup.
>
>
>     12/06/19 17:31:31 INFO mapred.JobClient: Running job:
>     job_201206191708_0003
>     12/06/19 17:31:32 INFO mapred.JobClient:  map 0% reduce 0%
>     12/06/19 17:32:14 INFO mapred.JobClient: Task Id :
>     attempt_201206191708_0003_m_000000_0, Status : FAILED
>     java.lang.IllegalStateException: run: Caught an unrecoverable
>     exception onlineZooKeeperServers: Failed to connect in 10 tries!
>     at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:641)
>     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
>     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
>     at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:416)
>     at
>     org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>     at org.apache.hadoop.mapred.Child.main(Child.java:249)
>     Caused by: java.lang.IllegalStateException:
>     onlineZooKeeperServers: Failed to connect in 10 tries!
>     at
>     org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:658)
>     at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:409)
>     at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:630)
>     ... 7 more
>
>     attempt_201206191708_0003_m_000000_0: log4j:WARN No appenders
>     could be found for logger (org.apache.giraph.zk.ZooKeeperManager).
>     attempt_201206191708_0003_m_000000_0: log4j:WARN Please initialize
>     the log4j system properly.
>
> BTW, I needed to add the following line to get this to run from my own 
> jar file...
>
>     job.setJarByClass(SimpleShortestPathsVertex.class)
>
>
> Not sure if that is related but it seems that it will not run without 
> this (it can not find SimpleShortestPathsVertex.
>
> Thanks,
>
> Jon Bishop
>
>