[jira] [Commented] (SPARK-39957) Delay onDisconnected to enable Driver receives ExecutorExitCode

["Apache Spark (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-39957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574947#comment-17574947 ] 

Apache Spark commented on SPARK-39957:
--------------------------------------

User 'kevin85421' has created a pull request for this issue:
https://github.com/apache/spark/pull/37400

> Delay onDisconnected to enable Driver receives ExecutorExitCode
> ---------------------------------------------------------------
>
>                 Key: SPARK-39957
>                 URL: https://issues.apache.org/jira/browse/SPARK-39957
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.4.0
>            Reporter: Kai-Hsun Chen
>            Priority: Major
>
> There are two methods to detect executor loss. First, when RPC fails, the function {{onDisconnected}} will be triggered. Second, when executor exits with ExecutorExitCode, the exit code will be passed from ExecutorRunner to Driver. These two methods may categorize same cases into different conclusions. We hope to categorize the ExecutorLossReason by ExecutorExitCode. This PR aims to make sure Driver receives ExecutorExitCode before onDisconnected is called.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org