You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2014/09/10 08:21:28 UTC

[jira] [Created] (SPARK-3469) Make sure TaskCompletionListeners are called in presence of failures

Reynold Xin created SPARK-3469:
----------------------------------

             Summary: Make sure TaskCompletionListeners are called in presence of failures
                 Key: SPARK-3469
                 URL: https://issues.apache.org/jira/browse/SPARK-3469
             Project: Spark
          Issue Type: Improvement
    Affects Versions: 1.1.0
            Reporter: Reynold Xin
            Assignee: Reynold Xin


If there are multiple TaskCompletionListeners, and any one of them misbehaves (e.g. throws an exception), then we will skip executing the rest of them.

As we are increasingly relying on TaskCompletionListener for cleaning up of resources, we should make sure they are always called, even if the previous ones fail. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org