[jira] [Commented] (SPARK-6287) Add support for dynamic allocation in the Mesos coarse-grained scheduler

["Andrew Or (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621204#comment-14621204 ] 

Andrew Or commented on SPARK-6287:
----------------------------------

Note that this feature is not complete. The shuffle files are not currently cleaned up when using Spark on Mesos with the external shuffle service. This will be addressed separately in SPARK-8873.

> Add support for dynamic allocation in the Mesos coarse-grained scheduler
> ------------------------------------------------------------------------
>
>                 Key: SPARK-6287
>                 URL: https://issues.apache.org/jira/browse/SPARK-6287
>             Project: Spark
>          Issue Type: Improvement
>          Components: Mesos
>    Affects Versions: 1.2.0
>            Reporter: Iulian Dragos
>            Assignee: Iulian Dragos
>             Fix For: 1.5.0
>
>
> Add support inside the coarse-grained Mesos scheduler for dynamic allocation. It amounts to implementing two methods that allow scaling up and down the number of executors:
> {code}
> def doKillExecutors(executorIds: Seq[String])
> def doRequestTotalExecutors(requestedTotal: Int)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org