You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Soumitra Kumar <ku...@gmail.com> on 2016/01/05 22:43:09 UTC

sortBy transformation shows as a job

Fellows,
I have a simple code.
sc.parallelize (Array (1, 4, 3, 2), 2).sortBy (i=>i).foreach (println)
This results in 2 jobs (sortBy, foreach) in Spark's application master ui.
I thought there is one to one relationship between RDD action and job. Here, only action is foreach, so should be only one job.
Please help me understand.
Thanks,-Soumitra.