[jira] [Created] (SPARK-43399) Add config to control threshold of unregister map output when fetch failed

["Zhongwei Zhu (Jira)" <ji...@apache.org>]

Zhongwei Zhu created SPARK-43399:
------------------------------------

             Summary: Add config to control threshold of unregister map output when fetch failed
                 Key: SPARK-43399
                 URL: https://issues.apache.org/jira/browse/SPARK-43399
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.4.0
            Reporter: Zhongwei Zhu


Spark will unregister map output on the executor when fetch failed from this executor. This might be too aggressive when fetch failed is temporary and recoverable. So adding the config to control the number of fetch failed failures needed to unregister map output and allow to disable unregister.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org