You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by rapelly kartheek <ka...@gmail.com> on 2014/12/26 06:04:36 UTC

Profiling a spark application.

Hi,

I want to find the time taken for replicating an rdd in spark cluster along
with the computation time on the replicated rdd.

Can someone please suggest some ideas?

Thank you

Re: Profiling a spark application.

Posted by Rishi Yadav <ri...@infoobjects.com>.

as per my understanding RDDs do not get replicated, underlying Data does if
it's in HDFS.

On Thu, Dec 25, 2014 at 9:04 PM, rapelly kartheek <ka...@gmail.com>
wrote:

> Hi,
>
> I want to find the time taken for replicating an rdd in spark cluster
> along with the computation time on the replicated rdd.
>
> Can someone please suggest some ideas?
>
> Thank you
>