You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:02:24 UTC

[jira] [Updated] (SPARK-19703) Add Suppress/Revive support to the Mesos Spark Driver

     [ https://issues.apache.org/jira/browse/SPARK-19703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon updated SPARK-19703:
---------------------------------
    Labels: bulk-closed  (was: )

> Add Suppress/Revive support to the Mesos Spark Driver
> -----------------------------------------------------
>
>                 Key: SPARK-19703
>                 URL: https://issues.apache.org/jira/browse/SPARK-19703
>             Project: Spark
>          Issue Type: New Feature
>          Components: Mesos
>    Affects Versions: 2.1.0
>            Reporter: Michael Gummelt
>            Priority: Major
>              Labels: bulk-closed
>
> Due to the problem described here: https://issues.apache.org/jira/browse/MESOS-6112, Running > 5 Mesos frameworks concurrently can result in starvation.  For example, running 10 jobs could result in 5 of them getting all the offers, even after they've launched all their executors.  This leads to starvation of the other jobs.  We must implement explicit SUPPRESS and REVIVE calls in the Spark Dispatcher to solve this problem.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org