You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Adrian Mocanu <am...@verticalscope.com> on 2014/03/20 17:00:24 UTC

is sorting necessary after join of sorted RDD

Is sorting necessary after a join on 2 sorted RDD?

Example:
val stream1= mystream.transform(rdd=>rdd.sortByKey(true))
val stream2= mystream.transform(rdd=>rdd.sortByKey(true))
val stream3= stream1.join(stream2)

Will stream3 be ordered?

-Adrian