You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Ankur Gupta (JIRA)" <ji...@apache.org> on 2019/03/25 18:15:00 UTC

[jira] [Created] (SPARK-27272) Enable blacklisting of node/executor on fetch failures by default

Ankur Gupta created SPARK-27272:
-----------------------------------

             Summary: Enable blacklisting of node/executor on fetch failures by default
                 Key: SPARK-27272
                 URL: https://issues.apache.org/jira/browse/SPARK-27272
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 2.3.0
            Reporter: Ankur Gupta


SPARK-20898 added a new configuration to blacklist a node/executor on fetch
failures. This config was deemed risky at the time and was disabled by default
until more data is collected.

This commit aims to enable that feature by default as we have seen couple of
instances where that feature was found to be useful. The failures occur because of issues with node manager and external shuffle service on that node.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org