You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Pavel Ajtkulov <aj...@gmail.com> on 2013/10/23 10:14:04 UTC

Join, order

Hi,

Should join save order?

Code:
val vals = sc.makeRDD(Array(1,2,3,4,5))
val links = sc.makeRDD(Array(4,1))
new PairRDDFunctions(vals zip vals).join(links zip links).collect

Returns Array((1,(1,1)), (4,(4,4)))
But I expect reverse order, without sort by key.

Are there other functions that save order on join operation?

Regards,
Pavel