You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by sandudi <ph...@gmail.com> on 2018/02/12 12:38:55 UTC

Spark sortByKey is not lazy evaluated

Hey people, sortByKey is not lazy evaluated in spark because of it will use
rang partition but i have one confusion it will load whole data from source
or only sample data. so if i use sortByKey it will get whole data in memory
or only sample so second time when i run real action it will load the whole
data in memory



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org