You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by rapelly kartheek <ka...@gmail.com> on 2014/06/07 10:24:23 UTC
Scheduling code for Spark
Hi,
*I am new to Spark framework. I understood Spark framework to some
extent. I have some experience with Hadoop as well. The concepts of
in-memory computation and RDD's *are extremely fascinating.
I am trying to understand the scheduler of Spark framework. Can someone
help me out where to look for "Spark Scheduler code".
Thank you!!
Re: Scheduling code for Spark
Posted by Gerard Maas <ge...@gmail.com>.
Hi,
The scheduling related code can be found at:
https://github.com/apache/spark/tree/master/core/src/main/scala/org/apache/spark/scheduler
The DAG (Directed Acyclic Graph) scheduler is a good start point:
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
Enjoy!
-Gerard.
On Sat, Jun 7, 2014 at 10:24 AM, rapelly kartheek <ka...@gmail.com>
wrote:
> Hi,
> *I am new to Spark framework. I understood Spark framework to some
> extent. I have some experience with Hadoop as well. The concepts of
> in-memory computation and RDD's *are extremely fascinating.
>
> I am trying to understand the scheduler of Spark framework. Can someone
> help me out where to look for "Spark Scheduler code".
>
> Thank you!!
>