[GitHub] [incubator-kyuubi] cxzl25 commented on pull request #2557: [KYUUBI #2522] Even the process exit code is zero, also check the application state from resource manager

[GitBox <gi...@apache.org>]

cxzl25 commented on PR #2557:
URL: https://github.com/apache/incubator-kyuubi/pull/2557#issuecomment-1118743687

   [SPARK-[36624](https://issues.apache.org/jira/browse/SPARK-36624)][YARN] In yarn client mode, when ApplicationMaster failed with KILLED/FAILED, driver should exit with code not 0
   `spark.yarn.am.clientModeExitOnError`
   >  In yarn-client mode, when this is true, if driver got application report with final status of KILLED or FAILED,
     driver will stop corresponding SparkContext and exit program with code 1.
     Note, if this is true and called from another application, it will terminate the parent application as well.
   
   Spark3.3 introduced a configuration that supports this behavior.
   
   Based on the released version of spark, it seems that currently only the app state of YARN can be checked regularly, similar to Spark Yarn MonitorThread.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org