You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by GitBox <gi...@apache.org> on 2022/04/20 07:17:16 UTC

[GitHub] [incubator-kyuubi] deadwind4 opened a new issue, #2426: [Improvement] Return exception stack trace message.

deadwind4 opened a new issue, #2426:
URL: https://github.com/apache/incubator-kyuubi/issues/2426

   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I have searched in the [issues](https://github.com/apache/incubator-kyuubi/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### What would you like to be improved?
   
   When I use HiveSQLEngine, I find exception stack trace lose.
   Currently exception message.
   ```
   14:24:07.903 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing anonymous's query[165d7623-d702-42c1-a30b-740e003d5d82]: RUNNING_STATE -> ERROR_STATE, statement: INSERT INTO TABLE pokes VALUES (1, 'bar'), time taken: 0.07 seconds
   Error: Error while processing statement: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. org/apache/hadoop/yarn/exceptions/YarnException (state=,code=0)
   ```
   
   I expect the exception message.
   ```
   15:01:16.421 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing anonymous's query[fbca6793-91ad-4c7c-b03f-c93ab1d903e7]: RUNNING_STATE -> ERROR_STATE, statement: INSERT INTO TABLE pokes VALUES (1, 'bar'), time taken: 6.528 seconds
   Error: org.apache.kyuubi.KyuubiSQLException: org.apache.kyuubi.KyuubiSQLException: Error while processing statement: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. org/apache/hadoop/yarn/exceptions/YarnException
   	at org.apache.kyuubi.KyuubiSQLException$.apply(KyuubiSQLException.scala:69)
   	at org.apache.kyuubi.KyuubiSQLException$.apply(KyuubiSQLException.scala:73)
   	at org.apache.kyuubi.engine.hive.operation.HiveOperation.$anonfun$getStatus$1(HiveOperation.scala:88)
   	at scala.Option.map(Option.scala:230)
   	at org.apache.kyuubi.engine.hive.operation.HiveOperation.getStatus(HiveOperation.scala:88)
   	at org.apache.kyuubi.service.AbstractBackendService.getOperationStatus(AbstractBackendService.scala:168)
   	at org.apache.kyuubi.service.TFrontendService.GetOperationStatus(TFrontendService.scala:419)
   	at org.apache.hive.service.rpc.thrift.TCLIService$Processor$GetOperationStatus.getResult(TCLIService.java:1757)
   	at org.apache.hive.service.rpc.thrift.TCLIService$Processor$GetOperationStatus.getResult(TCLIService.java:1742)
   	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
   	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
   	at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36)
   	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   Caused by: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. org/apache/hadoop/yarn/exceptions/YarnException
   	at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:335)
   	at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:226)
   	at org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:87)
   	at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:316)
   	at java.security.AccessController.doPrivileged(Native Method)
   	at javax.security.auth.Subject.doAs(Subject.java:422)
   	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682)
   	at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:329)
   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   	... 3 more
   Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/exceptions/YarnException
   	at org.apache.hadoop.mapred.YarnClientProtocolProvider.create(YarnClientProtocolProvider.java:34)
   	at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:130)
   	at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:109)
   	at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:102)
   	at org.apache.hadoop.mapred.JobClient.init(JobClient.java:475)
   	at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:454)
   	at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:381)
   	at org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:149)
   	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205)
   	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97)
   	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2664)
   	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2335)
   	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2011)
   	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1709)
   	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1703)
   	at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157)
   	at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:224)
   	... 11 more
   Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.exceptions.YarnException
   	at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
   	at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
   	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:355)
   	at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
   	... 28 more
   
   	at org.apache.kyuubi.KyuubiSQLException$.apply(KyuubiSQLException.scala:69)
   	at org.apache.kyuubi.operation.ExecuteStatement.waitStatementComplete(ExecuteStatement.scala:116)
   	at org.apache.kyuubi.operation.ExecuteStatement.$anonfun$runInternal$1(ExecuteStatement.scala:151)
   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748) (state=,code=0)
   ```
   
   
   
   
   
   ### How should we improve?
   
   Could we change `e.getMessage` to `stringifyException(e)` for return all error message?
   https://github.com/apache/incubator-kyuubi/blob/5f04aa67ece63d3d51c26aa3c63905f8385b4118/kyuubi-common/src/main/scala/org/apache/kyuubi/service/TFrontendService.scala#L426
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org


[GitHub] [incubator-kyuubi] SteNicholas closed issue #2426: [Improvement] Return exception stack trace information.

Posted by GitBox <gi...@apache.org>.
SteNicholas closed issue #2426: [Improvement] Return exception stack trace information.
URL: https://github.com/apache/incubator-kyuubi/issues/2426


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org