You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/09/26 08:41:14 UTC

[GitHub] [kyuubi] cxzl25 commented on issue #5331: [Bug] Spark Engine should throw an exception to let K8s know when the engine fails to start.

cxzl25 commented on issue #5331:
URL: https://github.com/apache/kyuubi/issues/5331#issuecomment-1735090878

   > YARN seems to be able to know
   
   If the engine does not throw an exception, the status seen in YARN is also SUCCESS.
   
   org.apache.spark.deploy.yarn.ApplicationMaster
   ```scala
               mainMethod.invoke(null, userArgs.toArray)
               finish(FinalApplicationStatus.SUCCEEDED, ApplicationMaster.EXIT_SUCCESS)
   ```
   
    https://github.com/apache/spark/blob/9a44dc4f9ee005f8e82f15bd731c9c870cc4a606/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala#L738-L739
   
   For example, setting a non-existent catalog leads to the initialization failure of the spark yarn cluster mode.
   
   ```properties
   spark.sql.catalog.spark_catalog=NOT_EXIST_CATALOG
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org