You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:14:21 UTC

[jira] [Resolved] (SPARK-20447) spark mesos scheduler suppress call

     [ https://issues.apache.org/jira/browse/SPARK-20447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-20447.
----------------------------------
    Resolution: Incomplete

> spark mesos scheduler suppress call
> -----------------------------------
>
>                 Key: SPARK-20447
>                 URL: https://issues.apache.org/jira/browse/SPARK-20447
>             Project: Spark
>          Issue Type: Wish
>          Components: Mesos
>    Affects Versions: 2.1.0
>            Reporter: Pavel Plotnikov
>            Priority: Minor
>              Labels: bulk-closed
>
>  The spark mesos scheduler never sends the suppress call to mesos to exclude application from Mesos batch allocation process (HierarchicalDRF allocator) when spark application is idle and there are no tasks in the queue. As a result, the application receives 0% cluster share because of the dynamic resource allocation while other applications, that need additional resources, can’t receive an offer because they have bigger cluster share that is significantly more than 0%
> About suppress call: http://mesos.apache.org/documentation/latest/app-framework-development-guide/



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org