You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by GitBox <gi...@apache.org> on 2022/03/09 13:54:45 UTC
[GitHub] [incubator-kyuubi] wForget opened a new issue #2078: [Bug] logCaptureThread does not catch sparksubmit exception
wForget opened a new issue #2078:
URL: https://github.com/apache/incubator-kyuubi/issues/2078
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-kyuubi/issues?q=is%3Aissue) and found no similar issues.
### Describe the bug
`logCaptureThread` does not catch sparksubmit exception.
### Affects Version(s)
1.4.0
### Kyuubi Server Log Output
```logtalk
Error: Error opening session for cloud_service client ip XXX, due to org.apache.kyuubi.KyuubiSQLException: Failed to detect the root cause, please check /data1/kyuubi/logs/work/hadoop/kyuubi-spark-sql-engine.log.79 at server side if necessary. The last 10 line(s) of log are:
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:951)
at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:165)
at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
... 6 more
22/03/09 21:35:57 INFO ShutdownHookManager: Shutdown hook called
22/03/09 21:35:57 INFO ShutdownHookManager: Deleting directory /tmp/spark-65291be7-09ef-4d0c-86bb-7083cb6aa29c
22/03/09 21:35:57 INFO ShutdownHookManager: Deleting directory /tmp/spark-efc481e6-148c-4912-8fe8-fdb0dec16e85 (state=,code=0)
```
### Kyuubi Engine Log Output
```logtalk
22/03/09 21:35:57 INFO Client: Deleted staging directory
hdfs://XXX/user/hadoop/.sparkStaging/application_1639106513453_3108760
Exception in thread "main" java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1780)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:163)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1030)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1039)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1639106513453_3108760 to YARN : Application application_1639106513453_3108760 submitted by user hadoop to unknown queue: root.test_001
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:327)
at org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:206)
at org.apache.spark.deploy.yarn.Client.run(Client.scala:1234)
at org.apache.spark.deploy.yarn.YarnClusterApplication.start(Client.scala:1641)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:951)
at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:165)
at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
... 6 more
22/03/09 21:35:57 INFO ShutdownHookManager: Shutdown hook called
22/03/09 21:35:57 INFO ShutdownHookManager: Deleting directory /tmp/spark-65291be7-09ef-4d0c-86bb-7083cb6aa29c
22/03/09 21:35:57 INFO ShutdownHookManager: Deleting directory /tmp/spark-efc481e6-148c-4912-8fe8-fdb0dec16e85
```
### Kyuubi Server Configurations
_No response_
### Kyuubi Engine Configurations
_No response_
### Additional context
Can we make this modification in `ProcBuilder`?
```
if (containsIgnoreCase(line, "Exception:") && !line.contains("at ") && !line.startsWith("Caused by:")) {
```
change to:
```
if ((line.startsWith("Exception ") || containsIgnoreCase(line, "Exception:")) && !line.contains("at ") && !line.startsWith("Caused by:")) {
```
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] yaooqinn closed issue #2078: [Bug] logCaptureThread does not catch sparksubmit exception
Posted by GitBox <gi...@apache.org>.
yaooqinn closed issue #2078:
URL: https://github.com/apache/incubator-kyuubi/issues/2078
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org