[jira] [Commented] (SPARK-985) Support Job Cancellation on Mesos Scheduler

["Patrick Wendell (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14044079#comment-14044079 ] 

Patrick Wendell commented on SPARK-985:
---------------------------------------

Some more notes on this from a related thread:

Task killing is not supported in the fine-grained mode on mesos because, in that mode, we use Mesos's built in support for all of the control plane messages relating to tasks. So we'll have to figure out how to support killing tasks in that model. There are two questions, one is who actually sends the "kill" message to the executor and the other is how we tell Mesos that the cores are freed which were in use by the task. In the course of normal operation that's handled by using the Mesos launchTask and sendStatusUpdate interfaces.

> Support Job Cancellation on Mesos Scheduler
> -------------------------------------------
>
>                 Key: SPARK-985
>                 URL: https://issues.apache.org/jira/browse/SPARK-985
>             Project: Spark
>          Issue Type: Improvement
>          Components: Mesos
>    Affects Versions: 0.9.0
>            Reporter: Josh Rosen
>
> https://github.com/apache/incubator-spark/pull/29 added job cancellation but may still need support for Mesos scheduler backends:
> Quote: 
> {quote}
> This looks good except that MesosSchedulerBackend isn't yet calling Mesos's killTask. Do you want to add that too or are you planning to push it till later? I don't think it's a huge change.
> {quote}



--
This message was sent by Atlassian JIRA
(v6.2#6252)