You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by rapelly kartheek <ka...@gmail.com> on 2014/06/07 10:24:23 UTC

Scheduling code for Spark

Hi,
   *I am  new to Spark framework. I understood Spark framework to some
extent. I have some experience with Hadoop as well. The concepts of
in-memory computation and RDD's  *are extremely fascinating.

I am trying to understand the scheduler of Spark framework. Can someone
help me out where to look for "Spark Scheduler code".

Thank you!!

Re: Scheduling code for Spark

Posted by Gerard Maas <ge...@gmail.com>.
Hi,

The scheduling related code can be found at:
https://github.com/apache/spark/tree/master/core/src/main/scala/org/apache/spark/scheduler

The DAG (Directed Acyclic Graph) scheduler is a good start point:
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala

Enjoy!

-Gerard.



On Sat, Jun 7, 2014 at 10:24 AM, rapelly kartheek <ka...@gmail.com>
wrote:

> Hi,
>    *I am  new to Spark framework. I understood Spark framework to some
> extent. I have some experience with Hadoop as well. The concepts of
> in-memory computation and RDD's  *are extremely fascinating.
>
> I am trying to understand the scheduler of Spark framework. Can someone
> help me out where to look for "Spark Scheduler code".
>
> Thank you!!
>