You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/20 16:18:00 UTC

[jira] [Created] (SPARK-24877) Ignore the task completion event from a zombie barrier task

Jiang Xingbo created SPARK-24877:
------------------------------------

             Summary: Ignore the task completion event from a zombie barrier task
                 Key: SPARK-24877
                 URL: https://issues.apache.org/jira/browse/SPARK-24877
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.0.0
            Reporter: Jiang Xingbo


Currently we abort the barrier stage if a zombie barrier task can't get killed to prevent data correctness issue. We can improve the behavior to let zombie barrier task continue running but not able to interact with other barrier tasks (maybe from different stage attempt) and ignore the task completion event from a zombie barrier task.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org