You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Charles Allen (JIRA)" <ji...@apache.org> on 2015/12/10 00:14:10 UTC

[jira] [Created] (SPARK-12248) Make Spark Coarse Mesos Scheduler obey limits on memory/cpu ratios

Charles Allen created SPARK-12248:
-------------------------------------

             Summary: Make Spark Coarse Mesos Scheduler obey limits on memory/cpu ratios
                 Key: SPARK-12248
                 URL: https://issues.apache.org/jira/browse/SPARK-12248
             Project: Spark
          Issue Type: Improvement
          Components: Mesos
            Reporter: Charles Allen


It is possible to have spark apps that work best with either more memory or more CPU.

In a multi-tenant environment (such as Mesos) it can be very beneficial to be able to limit the Coarse scheduler to guarantee an executor doesn't subscribe to too many cpus or too much memory.

This ask is to add functionality to the Coarse Mesos Scheduler to have basic limits to the ratio of memory to cpu, which default to the current behavior of soaking up whatever resources it can.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org