[jira] [Commented] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

["Apache Spark (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500676#comment-14500676 ] 

Apache Spark commented on SPARK-6707:
-------------------------------------

User 'ankurcha' has created a pull request for this issue:
https://github.com/apache/spark/pull/5563

> Mesos Scheduler should allow the user to specify constraints based on slave attributes
> --------------------------------------------------------------------------------------
>
>                 Key: SPARK-6707
>                 URL: https://issues.apache.org/jira/browse/SPARK-6707
>             Project: Spark
>          Issue Type: Improvement
>          Components: Mesos, Scheduler
>    Affects Versions: 1.3.0
>            Reporter: Ankur Chauhan
>              Labels: mesos, scheduler
>
> Currently, the mesos scheduler only looks at the 'cpu' and 'mem' resources when trying to determine the usablility of a resource offer from a mesos slave node. It may be preferable for the user to be able to ensure that the spark jobs are only started on a certain set of nodes (based on attributes). 
> For example, If the user sets a property, let's say {code}spark.mesos.constraints{code} is set to {code}tachyon=true;us-east-1=false{code}, then the resource offers will be checked to see if they meet both these constraints and only then will be accepted to start new executors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org