You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sebastien Rainville (JIRA)" <ji...@apache.org> on 2014/06/19 22:55:24 UTC

[jira] [Created] (SPARK-2204) Scheduler for Mesos in fine-grained mode launches tasks on random executors

Sebastien Rainville created SPARK-2204:
------------------------------------------

             Summary: Scheduler for Mesos in fine-grained mode launches tasks on random executors
                 Key: SPARK-2204
                 URL: https://issues.apache.org/jira/browse/SPARK-2204
             Project: Spark
          Issue Type: Bug
          Components: Mesos
    Affects Versions: 1.0.0
            Reporter: Sebastien Rainville
            Priority: Blocker
             Fix For: 1.0.1


MesosSchedulerBackend.resourceOffers(SchedulerDriver, List[Offer]) is assuming that TaskSchedulerImpl.resourceOffers(Seq[WorkerOffer]) is returning task lists in the same order as the offers it was passed, but in the current implementation TaskSchedulerImpl.resourceOffers shuffles the offers to avoid assigning the tasks always to the same executors. The result is that the tasks are launched on random executors.6



--
This message was sent by Atlassian JIRA
(v6.2#6252)