You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Matthew Farrellee (JIRA)" <ji...@apache.org> on 2014/09/21 18:56:33 UTC
[jira] [Commented] (SPARK-690) Stack overflow when running pagerank
more than 10000 iterators
[ https://issues.apache.org/jira/browse/SPARK-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142511#comment-14142511 ]
Matthew Farrellee commented on SPARK-690:
-----------------------------------------
[~andrew xia] this is reported against a very old version. i'm going to close it out, but if you can reproduce please re-open
> Stack overflow when running pagerank more than 10000 iterators
> --------------------------------------------------------------
>
> Key: SPARK-690
> URL: https://issues.apache.org/jira/browse/SPARK-690
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 0.6.1
> Reporter: xiajunluan
>
> when I run PageRank example more than 10000 iterators, Job client will report stack overflow errors.
> 13/02/07 13:41:40 INFO CacheTracker: Registering RDD ID 57993 with cache
> Exception in thread "DAGScheduler" java.lang.StackOverflowError
> at java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryAcquireShared(ReentrantReadWriteLock.java:467)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1281)
> at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:731)
> at org.jboss.netty.akka.util.HashedWheelTimer.scheduleTimeout(HashedWheelTimer.java:277)
> at org.jboss.netty.akka.util.HashedWheelTimer.newTimeout(HashedWheelTimer.java:264)
> at akka.actor.DefaultScheduler.scheduleOnce(Scheduler.scala:186)
> at akka.pattern.PromiseActorRef$.apply(AskSupport.scala:274)
> at akka.pattern.AskSupport$class.ask(AskSupport.scala:83)
> at akka.pattern.package$.ask(package.scala:43)
> at akka.pattern.AskSupport$AskableActorRef.ask(AskSupport.scala:123)
> at spark.CacheTracker.askTracker(CacheTracker.scala:121)
> at spark.CacheTracker.communicate(CacheTracker.scala:131)
> at spark.CacheTracker.registerRDD(CacheTracker.scala:142)
> at spark.scheduler.DAGScheduler.visit$1(DAGScheduler.scala:149)
> at spark.scheduler.DAGScheduler$$anonfun$visit$1$2.apply(DAGScheduler.scala:155)
> at spark.scheduler.DAGScheduler$$anonfun$visit$1$2.apply(DAGScheduler.scala:150)
> at scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.scala:59)
> at scala.collection.immutable.List.foreach(List.scala:76)
> at spark.scheduler.DAGScheduler.visit$1(DAGScheduler.scala:150)
> at spark.scheduler.DAGScheduler.getParentStages(DAGScheduler.scala:160)
> at spark.scheduler.DAGScheduler.newStage(DAGScheduler.scala:131)
> at spark.scheduler.DAGScheduler.getShuffleMapStage(DAGScheduler.scala:111)
> at spark.scheduler.DAGScheduler$$anonfun$visit$1$2.apply(DAGScheduler.scala:153)
> at spark.scheduler.DAGScheduler$$anonfun$visit$1$2.apply(DAGScheduler.scala:150)
> at scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.scala:59)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org