You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by Rocky Grey <ro...@gmail.com> on 2014/03/03 05:45:27 UTC
SimpleShortestPathsComputation Successful but PageRankComputation failed

Hi,

I was able to run SimpleShortestPathsComputation program successfully in
giraph 1.1.0 and hadoop 1.2.1, but got an error while running the
PageRankComputation program.

*SimpleShortestPathsComputation *
hadoop jar
$GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimpleShortestPathsComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/hduser/input/tiny_graph.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/hduser/output/shortestpaths -w 1


*PageRankComputation *
hadoop jar
$GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimplePageRankComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/hduser/input/tiny_graph.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/hduser/output/pagerank -w 1

The strange thing is even though it looks like a zookeeper issue, it didnt
happen when running the SimpleShortestPathsComputation.

Any help would be much appreciated.

*Error Message*
14/03/02 18:19:50 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=/usr/local/hadoop/libexec/../lib/native/Linux-amd64-64
14/03/02 18:19:50 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
14/03/02 18:19:50 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
14/03/02 18:19:50 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
14/03/02 18:19:50 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
14/03/02 18:19:50 INFO zookeeper.ZooKeeper: Client
environment:os.version=2.6.32-431.5.1.el6.x86_64
14/03/02 18:19:50 INFO zookeeper.ZooKeeper: Client environment:user.name
=root
14/03/02 18:19:50 INFO zookeeper.ZooKeeper: Client
environment:user.home=/root
14/03/02 18:19:50 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/usr/local/giraph
14/03/02 18:19:50 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=hdnode01:22181 sessionTimeout=60000
watcher=org.apache.giraph.job.JobProgressTracker@73a0ff87
14/03/02 18:19:50 INFO mapred.JobClient: Running job: job_201403021041_0012
14/03/02 18:19:50 INFO zookeeper.ClientCnxn: Opening socket connection to
server hdnode01/10.0.2.15:22181. Will not attempt to authenticate using
SASL (unknown error)
14/03/02 18:19:50 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14/03/02 18:19:50 WARN zk.ZooKeeperExt: exists: Connection loss on attempt
0, waiting 5000 msecs before retrying.
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for
/_hadoopBsp/job_201403021041_0012/_workerProgresses
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
    at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
    at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1069)
    at org.apache.giraph.zk.ZooKeeperExt.exists(ZooKeeperExt.java:360)
    at
org.apache.giraph.job.JobProgressTracker$2.run(JobProgressTracker.java:88)
    at java.lang.Thread.run(Thread.java:744)
14/03/02 18:19:51 INFO mapred.JobClient:  map 50% reduce 0%
14/03/02 18:19:51 INFO zookeeper.ClientCnxn: Opening socket connection to
server hdnode01/10.0.2.15:22181. Will not attempt to authenticate using
SASL (unknown error)
14/03/02 18:19:51 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14/03/02 18:19:52 INFO zookeeper.ClientCnxn: Opening socket connection to
server hdnode01/10.0.2.15:22181. Will not attempt to authenticate using
SASL (unknown error)
14/03/02 18:19:52 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14/03/02 18:19:53 INFO zookeeper.ClientCnxn: Opening socket connection to
server hdnode01/10.0.2.15:22181. Will not attempt to authenticate using
SASL (unknown error)
14/03/02 18:19:53 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14/03/02 18:19:54 INFO zookeeper.ClientCnxn: Opening socket connection to
server hdnode01/10.0.2.15:22181. Will not attempt to authenticate using
SASL (unknown error)
14/03/02 18:19:54 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14/03/02 18:19:55 INFO zookeeper.ClientCnxn: Opening socket connection to
server hdnode01/10.0.2.15:22181. Will not attempt to authenticate using
SASL (unknown error)
14/03/02 18:19:55 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14/03/02 18:19:56 WARN zk.ZooKeeperExt: exists: Connection loss on attempt
1, waiting 5000 msecs before retrying.
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for
/_hadoopBsp/job_201403021041_0012/_workerProgresses
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
    at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
    at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1069)
    at org.apache.giraph.zk.ZooKeeperExt.exists(ZooKeeperExt.java:360)
    at
org.apache.giraph.job.JobProgressTracker$2.run(JobProgressTracker.java:88)
    at java.lang.Thread.run(Thread.java:744)
14/03/02 18:19:57 INFO zookeeper.ClientCnxn: Opening socket connection to
server hdnode01/10.0.2.15:22181. Will not attempt to authenticate using
SASL (unknown error)
14/03/02 18:19:57 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14/03/02 18:19:58 INFO zookeeper.ClientCnxn: Opening socket connection to
server hdnode01/10.0.2.15:22181. Will not attempt to authenticate using
SASL (unknown error)
14/03/02 18:19:58 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14/03/02 18:19:59 INFO zookeeper.ClientCnxn: Opening socket connection to
server hdnode01/10.0.2.15:22181. Will not attempt to authenticate using
SASL (unknown error)
14/03/02 18:19:59 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14/03/02 18:20:00 INFO zookeeper.ClientCnxn: Opening socket connection to
server hdnode01/10.0.2.15:22181. Will not attempt to authenticate using
SASL (unknown error)
14/03/02 18:20:00 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14/03/02 18:20:01 INFO zookeeper.ClientCnxn: Opening socket connection to
server hdnode01/10.0.2.15:22181. Will not attempt to authenticate using
SASL (unknown error)
14/03/02 18:20:01 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14/03/02 18:20:01 WARN zk.ZooKeeperExt: exists: Connection loss on attempt
2, waiting 5000 msecs before retrying.
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for
/_hadoopBsp/job_201403021041_0012/_workerProgresses
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
    at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
    at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1069)
    at org.apache.giraph.zk.ZooKeeperExt.exists(ZooKeeperExt.java:360)
    at
org.apache.giraph.job.JobProgressTracker$2.run(JobProgressTracker.java:88)
    at java.lang.Thread.run(Thread.java:744)

Thanks
Kousi