StackOverflowError

[Sundara Raghavan Sankaran <su...@crayondata.com>]

Hi,

I'm trying to run a Giraph Job having 60,000 nodes and 20,000,000 edges
[highly connected].

Cluster consists of 4 nodes each with 17 GB RAM. I'm running only one
worker per node and a master [so that'll be 1 Master & 3 Workers]

I keep getting the java.lang.StackOverflowError in one of the workers.

Here is the log:-
2013-12-02 12:14:48,698 WARN org.apache.hadoop.mapred.Child: Error running
child
java.lang.IllegalStateException: run: Caught an unrecoverable exception
waitFor: ExecutionException occurred while waiting for
org.apache.giraph.utils.ProgressableUtils$FutureWaitable@928dc74
at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalStateException: waitFor: ExecutionException
occurred while waiting for
org.apache.giraph.utils.ProgressableUtils$FutureWaitable@928dc74
at
org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:151)
at
org.apache.giraph.utils.ProgressableUtils.waitForever(ProgressableUtils.java:111)
at
org.apache.giraph.utils.ProgressableUtils.getFutureResult(ProgressableUtils.java:73)
at
org.apache.giraph.utils.ProgressableUtils.getResultsWithNCallables(ProgressableUtils.java:192)
at
org.apache.giraph.graph.GraphTaskManager.processGraphPartitions(GraphTaskManager.java:753)
at
org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:273)
at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:92)
... 7 more
Caused by: java.util.concurrent.ExecutionException:
java.lang.StackOverflowError
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:262)
at java.util.concurrent.FutureTask.get(FutureTask.java:119)
at
org.apache.giraph.utils.ProgressableUtils$FutureWaitable.waitFor(ProgressableUtils.java:271)
at
org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:143)
... 13 more
Caused by: java.lang.StackOverflowError
at com.google.common.collect.Iterables$3.hasNext(Iterables.java:504)
at com.google.common.collect.Iterators$5.hasNext(Iterators.java:543)
at com.google.common.collect.Iterators$5.hasNext(Iterators.java:543)
at com.google.common.collect.Iterators$5.hasNext(Iterators.java:543)
<goes on for about 1000 times>
at com.google.common.collect.Iterators$5.hasNext(Iterators.java:543)
2013-12-02 12:14:48,740 INFO org.apache.hadoop.mapred.Task: Runnning
cleanup for the task

Any help appreciated.

--
Thanks,
Sundar