You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "WangTaoTheTonic (JIRA)" <ji...@apache.org> on 2014/09/05 07:45:29 UTC

[jira] [Created] (SPARK-3411) Optimize the schedule procedure in Master

WangTaoTheTonic created SPARK-3411:
--------------------------------------

             Summary: Optimize the schedule procedure in Master
                 Key: SPARK-3411
                 URL: https://issues.apache.org/jira/browse/SPARK-3411
             Project: Spark
          Issue Type: Improvement
          Components: Deploy
            Reporter: WangTaoTheTonic
            Priority: Minor


If the waiting driver array is too big, the drivers in it will be dispatched to the first worker we get(if it has enough resources), with or without the Randomization.

We should do randomization every time we dispatch a driver, in order to better balance drivers.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org