You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kyuubi.apache.org by GitBox <gi...@apache.org> on 2021/10/08 03:36:54 UTC
[GitHub] [incubator-kyuubi] yaooqinn opened a new issue #1190: [Bug][TEST] Flaky test: SparkProcessBuilderSuite - engine log truncation
yaooqinn opened a new issue #1190:
URL: https://github.com/apache/incubator-kyuubi/issues/1190
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-kyuubi/issues?q=is%3Aissue) and found no similar issues.
### Describe the bug
SparkProcessBuilderSuite:
- spark process builder
- capture error from spark process builder
- engine log truncation *** FAILED ***
The code passed to eventually never returned normally. Attempted 165 times over 1.5013366728833333 minutes. Last failure message: "2021-10-08 02:49:19.844 ERROR spark.SparkSQLEngine: Failed to instantiate SparkSession: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient;
See more: /home/runner/work/incubator-kyuubi/incubator-kyuubi/kyuubi-server/target/work/kentyao/kyuubi-spark-sql-engine.log.3" did not contain "org.apache.spark.sql.hive.". (SparkProcessBuilderSuite.scala:79)
### Affects Version(s)
1.4.0
### Kyuubi Server Log Output
_No response_
### Kyuubi Engine Log Output
_No response_
### Kyuubi Server Configurations
_No response_
### Kyuubi Engine Configurations
_No response_
### Additional context
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] timothy65535 commented on issue #1190: [Bug][TEST] Flaky test: SparkProcessBuilderSuite - engine log truncation
Posted by GitBox <gi...@apache.org>.
timothy65535 commented on issue #1190:
URL: https://github.com/apache/incubator-kyuubi/issues/1190#issuecomment-938362670
+1, met same error before in tests, but forget how to replay it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] cxzl25 commented on issue #1190: [Bug][TEST] Flaky test: SparkProcessBuilderSuite - engine log truncation
Posted by GitBox <gi...@apache.org>.
cxzl25 commented on issue #1190:
URL: https://github.com/apache/incubator-kyuubi/issues/1190#issuecomment-938408758
`error` will be repeatedly assigned. At this time, the message of `getError` may not contain `at` and `caused by`, causing UT to fail.
https://github.com/apache/incubator-kyuubi/blob/6420a7eb049cb3e155f1088780b21e5b872a3a64/kyuubi-server/src/main/scala/org/apache/kyuubi/engine/ProcBuilder.scala#L120-L128
https://github.com/apache/incubator-kyuubi/blob/6420a7eb049cb3e155f1088780b21e5b872a3a64/kyuubi-server/src/main/scala/org/apache/kyuubi/engine/ProcBuilder.scala#L157-L165
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] pan3793 closed issue #1190: [Bug][TEST] Flaky test: SparkProcessBuilderSuite - engine log truncation
Posted by GitBox <gi...@apache.org>.
pan3793 closed issue #1190:
URL: https://github.com/apache/incubator-kyuubi/issues/1190
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] simon824 commented on issue #1190: [Bug][TEST] Flaky test: SparkProcessBuilderSuite - engine log truncation
Posted by GitBox <gi...@apache.org>.
simon824 commented on issue #1190:
URL: https://github.com/apache/incubator-kyuubi/issues/1190#issuecomment-939207618
When line2 is read, it does not contain `at` and `cause by`, so all of the following messages are discarded.
I will fix it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] simon824 commented on issue #1190: [Bug][TEST] Flaky test: SparkProcessBuilderSuite - engine log truncation
Posted by GitBox <gi...@apache.org>.
simon824 commented on issue #1190:
URL: https://github.com/apache/incubator-kyuubi/issues/1190#issuecomment-938576845
Meet the same error
https://github.com/apache/incubator-kyuubi/pull/1194/checks?check_run_id=3836891432
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] timothy65535 edited a comment on issue #1190: [Bug][TEST] Flaky test: SparkProcessBuilderSuite - engine log truncation
Posted by GitBox <gi...@apache.org>.
timothy65535 edited a comment on issue #1190:
URL: https://github.com/apache/incubator-kyuubi/issues/1190#issuecomment-938362670
+1, met same error before in tests, but forget how to replay it.
emm, one case caused by the socket timeout.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org