You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by thlee <ti...@ooyala.com> on 2014/12/19 19:51:53 UTC

Re: Confirming race condition in DagScheduler (NoSuchElementException)

any comments?



--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Confirming-race-condition-in-DagScheduler-NoSuchElementException-tp9798p9855.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Re: Confirming race condition in DagScheduler (NoSuchElementException)

Posted by Josh Rosen <ro...@gmail.com>.
I’m investigating this issue and left some comments on the proposed fix: https://github.com/apache/spark/pull/3345#issuecomment-68014353

To summarize, I agree with your description of the problem but think that the right fix may be a bit more involved than what’s proposed in that PR (that PR’s fix shouldn’t actually work, as far as I can tell).

- Josh

On December 19, 2014 at 10:57:41 AM, thlee (tiong@ooyala.com) wrote:

any comments?  



--  
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Confirming-race-condition-in-DagScheduler-NoSuchElementException-tp9798p9855.html  
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.  

---------------------------------------------------------------------  
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org  
For additional commands, e-mail: dev-help@spark.apache.org