You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2022/09/22 12:56:24 UTC

[GitHub] [spark] Ngone51 commented on pull request #37779: [wip][SPARK-40320][Core] Executor should exit when it failed to initialize for fatal error

Ngone51 commented on PR #37779:
URL: https://github.com/apache/spark/pull/37779#issuecomment-1254985148

   https://github.com/apache/spark/blob/39b65b414c4ba36ada478369149f54452d90dd7b/core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala#L169-L176
   
   
   The issue seems to be that `Executor` construction failed due to the fatal error thrown during plugin initialization. And the fatal error doesn't fail the executor process, which leaves the executor in idle and becomes unavailable to the driver since `LaunchedExecutor` is not sent. Correct me if I'm wrong.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org