You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Andrew Or (JIRA)" <ji...@apache.org> on 2014/12/22 19:58:13 UTC

[jira] [Created] (SPARK-4922) Support dynamic allocation for coarse-grained Mesos

Andrew Or created SPARK-4922:
--------------------------------

             Summary: Support dynamic allocation for coarse-grained Mesos
                 Key: SPARK-4922
                 URL: https://issues.apache.org/jira/browse/SPARK-4922
             Project: Spark
          Issue Type: Bug
          Components: Mesos
    Affects Versions: 1.2.0
            Reporter: Andrew Or
            Priority: Critical


This brings SPARK-3174, which provided dynamic allocation of cluster resources to Spark on YARN applications, to Mesos coarse-grained mode. 

Note that the translation is not as trivial as adding a code path that exposes the request and kill mechanisms as we did for YARN is SPARK-3822. This is because Mesos coarse-grained mode schedules on the notion of setting the number of cores allowed for an application (as in standalone mode) instead of number of executors (as in YARN mode). For more detail, please see SPARK-4751.

If you intend to work on this, please provide a detailed design doc!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org