You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by James King <ja...@gmail.com> on 2015/04/17 09:26:08 UTC

Spark Directed Acyclic Graph / Jobs

Is there a good resource that explains how Spark jobs gets broken down to
tasks and executions.

I just need to get a better understanding of this.

Regards
j

Re: Spark Directed Acyclic Graph / Jobs

Posted by James King <ja...@gmail.com>.

Thanks Jerry,

The other paper you refer to is may be ?

http://research.microsoft.com/pubs/63785/eurosys07.pdf

Regards
j


On Fri, Apr 17, 2015 at 9:45 AM, Shao, Saisai <sa...@intel.com> wrote:

>  I think this paper will be a good resource (
> https://www.cs.berkeley.edu/~matei/papers/2012/nsdi_spark.pdf), also the
> paper of Dryad is also a good one.
>
>
>
> Thanks
>
> Jerry
>
>
>
> *From:* James King [mailto:jakwebinbox@gmail.com]
> *Sent:* Friday, April 17, 2015 3:26 PM
> *To:* user
> *Subject:* Spark Directed Acyclic Graph / Jobs
>
>
>
> Is there a good resource that explains how Spark jobs gets broken down to
> tasks and executions.
>
>
>
> I just need to get a better understanding of this.
>
>
>
> Regards
>
> j
>
>
>

RE: Spark Directed Acyclic Graph / Jobs

Posted by "Shao, Saisai" <sa...@intel.com>.

I think this paper will be a good resource (https://www.cs.berkeley.edu/~matei/papers/2012/nsdi_spark.pdf), also the paper of Dryad is also a good one.

Thanks
Jerry

From: James King [mailto:jakwebinbox@gmail.com]
Sent: Friday, April 17, 2015 3:26 PM
To: user
Subject: Spark Directed Acyclic Graph / Jobs

Is there a good resource that explains how Spark jobs gets broken down to tasks and executions.

I just need to get a better understanding of this.

Regards
j