You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Clément Michaud (JIRA)" <ji...@apache.org> on 2019/02/10 15:42:00 UTC

[jira] [Comment Edited] (SPARK-17454) Use Mesos disk resources

    [ https://issues.apache.org/jira/browse/SPARK-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16764454#comment-16764454 ] 

Clément Michaud edited comment on SPARK-17454 at 2/10/19 3:41 PM:
------------------------------------------------------------------

Hello,

I've added a way for executors to reserve disk resources from Mesos.

The change is [https://github.com/apache/spark/pull/23758].

[~mgummelt], I'd really appreciate if you can review or help me find someone to review this change.


was (Author: clems4ever):
Hello,

I've added a way for executors to reserve disk resources from Mesos.

The change is https://github.com/apache/spark/pull/23758.

> Use Mesos disk resources
> ------------------------
>
>                 Key: SPARK-17454
>                 URL: https://issues.apache.org/jira/browse/SPARK-17454
>             Project: Spark
>          Issue Type: Improvement
>          Components: Mesos
>    Affects Versions: 2.0.0
>            Reporter: Chris Bannister
>            Priority: Major
>
> Currently the driver will accept offers from Mesos which have enough ram for the executor and until its max cores is reached. There is no way to control the required CPU's or disk for each executor, it would be very useful to be able to apply something similar to spark.mesos.constraints to resource offers instead of attributes on the offer.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org