You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/09/26 08:41:14 UTC
[GitHub] [kyuubi] cxzl25 commented on issue #5331: [Bug] Spark Engine should throw an exception to let K8s know when the engine fails to start.
cxzl25 commented on issue #5331:
URL: https://github.com/apache/kyuubi/issues/5331#issuecomment-1735090878
> YARN seems to be able to know
If the engine does not throw an exception, the status seen in YARN is also SUCCESS.
org.apache.spark.deploy.yarn.ApplicationMaster
```scala
mainMethod.invoke(null, userArgs.toArray)
finish(FinalApplicationStatus.SUCCEEDED, ApplicationMaster.EXIT_SUCCESS)
```
https://github.com/apache/spark/blob/9a44dc4f9ee005f8e82f15bd731c9c870cc4a606/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala#L738-L739
For example, setting a non-existent catalog leads to the initialization failure of the spark yarn cluster mode.
```properties
spark.sql.catalog.spark_catalog=NOT_EXIST_CATALOG
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org