You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by dimoes <di...@gmail.com> on 2016/06/02 04:27:39 UTC

How should I interpret Spark's toDebugString()?

This may be a dumb question, but can someone explain how I should interpret
this DAG?

Please ignore the types of RDDs. Specifically, what do 2 parallel lines
(e.g. B) mean? What does a single parallel line with no previous single
parallel line (e.g.: A) signify?

(N) MappedRDD[3] 
 |  ShuffledRDD[2] 
 +-(N) MappedRDD[1] 
    |  ParallelCollectionRDD[0]       
    |  ParallelCollectionRDD[0]   
 |  ShuffledRDD[2]                      (A)
 +-(N) MappedRDD[1] 
 |  |  ParallelCollectionRDD[0]      (B)
 |  |  ParallelCollectionRDD[0]
 |  ShuffledRDD[2] 



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-should-I-interpret-Spark-s-toDebugString-tp27073.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org