You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Manku Timma <ma...@gmail.com> on 2014/09/08 10:59:58 UTC

sharing off_heap rdds

I see that the tachyon url constructed for an rdd partition has executor id
in it. So if the same partition is being processed by a different executor
on a reexecution of the same computation, it cannot really use the earlier
result. Is this a correct assessment? Will removing the executor id from
the tachyon path fix the issue without introducing any problems?

--
Thanks