You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kyuubi.apache.org by GitBox <gi...@apache.org> on 2021/10/29 04:25:23 UTC
[GitHub] [incubator-kyuubi] yaooqinn opened a new pull request #1312: [KYUUBI #1300] Detecting critical errors
yaooqinn opened a new pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/develop_tools/testing.html#running-tests) locally before make a pull request
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on a change in pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on a change in pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#discussion_r738930977
##########
File path: kyuubi-server/src/main/scala/org/apache/kyuubi/operation/KyuubiOperation.scala
##########
@@ -86,27 +87,37 @@ abstract class KyuubiOperation(
}
}
- override def cancel(): Unit = {
- if (_remoteOpHandle != null && !isClosedOrCanceled) {
- try {
- client.cancelOperation(_remoteOpHandle)
- setState(OperationState.CANCELED)
- } catch onError("cancelling")
+ override def cancel(): Unit = state.synchronized {
+ if (!isClosedOrCanceled) {
+ setState(OperationState.CANCELED)
+ if (_remoteOpHandle != null) {
Review comment:
I prefer saving a unnecessary option creation
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] codecov-commenter edited a comment on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954430673
# [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#1312](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (2ed8bfb) into [master](https://codecov.io/gh/apache/incubator-kyuubi/commit/4c707d6ec92b487396610dad36a2a3bc86d6231c?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (4c707d6) will **increase** coverage by `0.72%`.
> The diff coverage is `77.61%`.
[](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #1312 +/- ##
============================================
+ Coverage 77.76% 78.49% +0.72%
Complexity 110 110
============================================
Files 178 178
Lines 7215 7240 +25
Branches 880 887 +7
============================================
+ Hits 5611 5683 +72
+ Misses 1119 1072 -47
Partials 485 485
```
| [Impacted Files](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...kyuubi/engine/spark/operation/SparkOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9vcGVyYXRpb24vU3BhcmtPcGVyYXRpb24uc2NhbGE=) | `79.68% <0.00%> (-1.27%)` | :arrow_down: |
| [.../org/apache/kyuubi/operation/KyuubiOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vS3l1dWJpT3BlcmF0aW9uLnNjYWxh) | `54.09% <50.00%> (-1.26%)` | :arrow_down: |
| [.../apache/kyuubi/client/KyuubiSyncThriftClient.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jbGllbnQvS3l1dWJpU3luY1RocmlmdENsaWVudC5zY2FsYQ==) | `81.55% <68.75%> (-2.49%)` | :arrow_down: |
| [...org/apache/kyuubi/operation/ExecuteStatement.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vRXhlY3V0ZVN0YXRlbWVudC5zY2FsYQ==) | `87.75% <95.65%> (+4.95%)` | :arrow_up: |
| [...ngine/spark/SparkThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9TcGFya1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `79.36% <100.00%> (+0.33%)` | :arrow_up: |
| [...in/scala/org/apache/kyuubi/config/KyuubiConf.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jb25maWcvS3l1dWJpQ29uZi5zY2FsYQ==) | `95.16% <100.00%> (+0.04%)` | :arrow_up: |
| [...e/kyuubi/service/ThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2aWNlL1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `97.26% <100.00%> (-0.02%)` | :arrow_down: |
| [...ubi/server/KyuubiThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2ZXIvS3l1dWJpVGhyaWZ0QmluYXJ5RnJvbnRlbmRTZXJ2aWNlLnNjYWxh) | `90.00% <100.00%> (+1.11%)` | :arrow_up: |
| [.../scala/org/apache/kyuubi/server/KyuubiServer.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2ZXIvS3l1dWJpU2VydmVyLnNjYWxh) | `53.48% <0.00%> (-2.33%)` | :arrow_down: |
| ... and [7 more](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [4c707d6...2ed8bfb](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] pan3793 closed pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
pan3793 closed pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] jiaoqingbo removed a comment on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
jiaoqingbo removed a comment on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954558254
0: jdbc:hive2://ocdp39:2181,vm01.asia.com:218> SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
. . . . . . . . . . . . . . . . . . . . . . .> FROM RANGE(30000000);
21/10/29 16:31:57 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: INITIALIZED_STATE -> PENDING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: PENDING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:32:02 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:31:57 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: INITIALIZED_STATE -> PENDING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: PENDING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO ExecuteStatement:
Spark application name: kyuubi_USER_ambari-qa_04de1528-113f-4754-a144-59a011a591d4
application ID: 1
application web UI: http://vm02.asia.com:8088/proxy/application_1635239556214_0034
master: yarn
deploy mode: cluster
version: 3.1.1
Start time: 2021-10-29T16:29:57.632
User: ambari-qa
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_hash replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_first_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_last_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_show_last_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_show_first_n replaced a previously registered function.
21/10/29 16:31:58 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: RUNNING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:58 INFO ExecuteStatement: Execute in full collect mode
21/10/29 16:31:58 INFO CodeGenerator: Code generated in 57.894901 ms
21/10/29 16:31:58 INFO SparkContext: Starting job: collect at ExecuteStatement.scala:104
21/10/29 16:31:58 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Job 0 started with 1 stages, 1 active jobs running
21/10/29 16:31:58 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Stage 0 started with 2 tasks, 1 active stages running
21/10/29 16:32:04 INFO SQLOperationListener: Finished stage: Stage(0, 0); Name: 'collect at ExecuteStatement.scala:104'; Status: succeeded; numTasks: 2; Took: 5987 msec
21/10/29 16:32:04 INFO DAGScheduler: Job 0 finished: collect at ExecuteStatement.scala:104, took 6.049114 s
21/10/29 16:32:04 INFO StatsReportListener: task runtime:(count: 2, mean: 5538.500000, stdev: 249.500000, max: 5788.000000, min: 5289.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 5.3 s 5.3 s 5.3 s 5.3 s 5.8 s 5.8 s 5.8 s 5.8 s 5.8 s
21/10/29 16:32:04 INFO StatsReportListener: shuffle bytes written:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
21/10/29 16:32:04 INFO StatsReportListener: fetch wait time:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms
21/10/29 16:32:04 INFO StatsReportListener: remote bytes read:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
21/10/29 16:32:04 INFO StatsReportListener: task result size:(count: 2, mean: 132877042.000000, stdev: 129321.000000, max: 133006363.000000, min: 132747721.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 126.6 MiB 126.6 MiB 126.6 MiB 126.6 MiB 126.8 MiB 126.8 MiB 126.8 MiB 126.8 MiB 126.8 MiB
21/10/29 16:32:04 INFO StatsReportListener: executor (non-fetch) time pct: (count: 2, mean: 52.057131, stdev: 1.677034, max: 53.734165, min: 50.380097)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 50 % 50 % 50 % 50 % 54 % 54 % 54 % 54 % 54 %
21/10/29 16:32:04 INFO StatsReportListener: fetch wait time pct: (count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0 % 0 % 0 % 0 % 0 % 0 % 0 % 0 % 0 %
21/10/29 16:32:04 INFO StatsReportListener: other time pct: (count: 2, mean: 47.942869, stdev: 1.677034, max: 49.619903, min: 46.265835)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 46 % 46 % 46 % 46 % 50 % 50 % 50 % 50 % 50 %
21/10/29 16:32:04 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Job 0 succeeded, 0 active jobs running
21/10/29 16:32:07 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:22 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:37 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (1 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more
21/10/29 16:32:42 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:57 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (2 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:00 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:33:15 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (3 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:23 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:33:38 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (4 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:45 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:34:00 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (5 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:34:15 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:34:30 ERROR operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status after 5 times, aborting
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more
21/10/29 16:34:30 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: RUNNING_STATE -> ERROR_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000), time taken: 152.457 seconds
Error: Error operating EXECUTE_STATEMENT: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more (state=,code=0)
0: jdbc:hive2://ocdp39:2181,vm01.asia.com:218>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] jiaoqingbo commented on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
jiaoqingbo commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954558589
`0: jdbc:hive2://ocdp39:2181,vm01.asia.com:218> SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
. . . . . . . . . . . . . . . . . . . . . . .> FROM RANGE(30000000);
21/10/29 16:31:57 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: INITIALIZED_STATE -> PENDING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: PENDING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:32:02 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:31:57 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: INITIALIZED_STATE -> PENDING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: PENDING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO ExecuteStatement:
Spark application name: kyuubi_USER_ambari-qa_04de1528-113f-4754-a144-59a011a591d4
application ID: 1
application web UI: http://vm02.asia.com:8088/proxy/application_1635239556214_0034
master: yarn
deploy mode: cluster
version: 3.1.1
Start time: 2021-10-29T16:29:57.632
User: ambari-qa
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_hash replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_first_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_last_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_show_last_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_show_first_n replaced a previously registered function.
21/10/29 16:31:58 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: RUNNING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:58 INFO ExecuteStatement: Execute in full collect mode
21/10/29 16:31:58 INFO CodeGenerator: Code generated in 57.894901 ms
21/10/29 16:31:58 INFO SparkContext: Starting job: collect at ExecuteStatement.scala:104
21/10/29 16:31:58 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Job 0 started with 1 stages, 1 active jobs running
21/10/29 16:31:58 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Stage 0 started with 2 tasks, 1 active stages running
21/10/29 16:32:04 INFO SQLOperationListener: Finished stage: Stage(0, 0); Name: 'collect at ExecuteStatement.scala:104'; Status: succeeded; numTasks: 2; Took: 5987 msec
21/10/29 16:32:04 INFO DAGScheduler: Job 0 finished: collect at ExecuteStatement.scala:104, took 6.049114 s
21/10/29 16:32:04 INFO StatsReportListener: task runtime:(count: 2, mean: 5538.500000, stdev: 249.500000, max: 5788.000000, min: 5289.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 5.3 s 5.3 s 5.3 s 5.3 s 5.8 s 5.8 s 5.8 s 5.8 s 5.8 s
21/10/29 16:32:04 INFO StatsReportListener: shuffle bytes written:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
21/10/29 16:32:04 INFO StatsReportListener: fetch wait time:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms
21/10/29 16:32:04 INFO StatsReportListener: remote bytes read:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
21/10/29 16:32:04 INFO StatsReportListener: task result size:(count: 2, mean: 132877042.000000, stdev: 129321.000000, max: 133006363.000000, min: 132747721.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 126.6 MiB 126.6 MiB 126.6 MiB 126.6 MiB 126.8 MiB 126.8 MiB 126.8 MiB 126.8 MiB 126.8 MiB
21/10/29 16:32:04 INFO StatsReportListener: executor (non-fetch) time pct: (count: 2, mean: 52.057131, stdev: 1.677034, max: 53.734165, min: 50.380097)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 50 % 50 % 50 % 50 % 54 % 54 % 54 % 54 % 54 %
21/10/29 16:32:04 INFO StatsReportListener: fetch wait time pct: (count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0 % 0 % 0 % 0 % 0 % 0 % 0 % 0 % 0 %
21/10/29 16:32:04 INFO StatsReportListener: other time pct: (count: 2, mean: 47.942869, stdev: 1.677034, max: 49.619903, min: 46.265835)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 46 % 46 % 46 % 46 % 50 % 50 % 50 % 50 % 50 %
21/10/29 16:32:04 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Job 0 succeeded, 0 active jobs running
21/10/29 16:32:07 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:22 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:37 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (1 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more
21/10/29 16:32:42 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:57 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (2 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:00 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:33:15 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (3 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:23 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:33:38 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (4 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:45 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:34:00 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (5 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:34:15 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:34:30 ERROR operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status after 5 times, aborting
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more
21/10/29 16:34:30 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: RUNNING_STATE -> ERROR_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000), time taken: 152.457 seconds
Error: Error operating EXECUTE_STATEMENT: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more (state=,code=0)
0: jdbc:hive2://ocdp39:2181,vm01.asia.com:218> `
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] codecov-commenter edited a comment on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954430673
# [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#1312](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (a715ecc) into [master](https://codecov.io/gh/apache/incubator-kyuubi/commit/4c707d6ec92b487396610dad36a2a3bc86d6231c?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (4c707d6) will **increase** coverage by `0.73%`.
> The diff coverage is `77.27%`.
[](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #1312 +/- ##
============================================
+ Coverage 77.76% 78.50% +0.73%
Complexity 110 110
============================================
Files 178 178
Lines 7215 7240 +25
Branches 880 887 +7
============================================
+ Hits 5611 5684 +73
+ Misses 1119 1071 -48
Partials 485 485
```
| [Impacted Files](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...kyuubi/engine/spark/operation/SparkOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9vcGVyYXRpb24vU3BhcmtPcGVyYXRpb24uc2NhbGE=) | `79.68% <0.00%> (-1.27%)` | :arrow_down: |
| [.../org/apache/kyuubi/operation/KyuubiOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vS3l1dWJpT3BlcmF0aW9uLnNjYWxh) | `54.09% <50.00%> (-1.26%)` | :arrow_down: |
| [.../apache/kyuubi/client/KyuubiSyncThriftClient.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jbGllbnQvS3l1dWJpU3luY1RocmlmdENsaWVudC5zY2FsYQ==) | `81.55% <68.75%> (-2.49%)` | :arrow_down: |
| [...org/apache/kyuubi/operation/ExecuteStatement.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vRXhlY3V0ZVN0YXRlbWVudC5zY2FsYQ==) | `87.75% <95.45%> (+4.95%)` | :arrow_up: |
| [...ngine/spark/SparkThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9TcGFya1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `79.36% <100.00%> (+0.33%)` | :arrow_up: |
| [...in/scala/org/apache/kyuubi/config/KyuubiConf.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jb25maWcvS3l1dWJpQ29uZi5zY2FsYQ==) | `95.16% <100.00%> (+0.04%)` | :arrow_up: |
| [...e/kyuubi/service/ThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2aWNlL1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `97.26% <100.00%> (-0.02%)` | :arrow_down: |
| [...ubi/server/KyuubiThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2ZXIvS3l1dWJpVGhyaWZ0QmluYXJ5RnJvbnRlbmRTZXJ2aWNlLnNjYWxh) | `90.00% <100.00%> (+1.11%)` | :arrow_up: |
| [...n/scala/org/apache/spark/kyuubi/ui/EngineTab.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUvc3Bhcmsva3l1dWJpL3VpL0VuZ2luZVRhYi5zY2FsYQ==) | `78.57% <0.00%> (ø)` | |
| ... and [6 more](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [4c707d6...a715ecc](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] pan3793 closed pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
pan3793 closed pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954424232
@jiaoqingbo can you help verify this PR for #1300 on you environment to see what happens
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954534283
```
0: jdbc:hive2://10.219.184.36:2181/> SELECT id AS i_item_id,
. . . . . . . . . . . . . . . . . .> CAST(rand() * 1000 AS INT) AS i_price
. . . . . . . . . . . . . . . . . .> FROM RANGE(30000000);
2021-10-29 15:59:44.940 INFO operation.ExecuteStatement: Processing kentyao's query[b3b82f33-10d4-4279-9253-81554f76f8b1]: INITIALIZED_STATE -> PENDING_STATE, statement: SELECT id AS i_item_id,
CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
2021-10-29 15:59:44.942 INFO operation.ExecuteStatement: Processing kentyao's query[b3b82f33-10d4-4279-9253-81554f76f8b1]: PENDING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id,
CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
2021-10-29 15:59:50.150 INFO operation.ExecuteStatement: Query[b3b82f33-10d4-4279-9253-81554f76f8b1] in RUNNING_STATE
2021-10-29 16:00:05.153 WARN operation.ExecuteStatement: Failed to get kentyao's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: b3b82f33-10d4-4279-9253-81554f76f8b1]] status (1 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.getOperationStatusWithRetry$1(ExecuteStatement.scala:97)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:123)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:177)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 24 more
2021-10-29 16:00:20.159 INFO operation.ExecuteStatement: Query[b3b82f33-10d4-4279-9253-81554f76f8b1] in RUNNING_STATE
2021-10-29 16:00:31.571 WARN operation.ExecuteStatement: Failed to get kentyao's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: b3b82f33-10d4-4279-9253-81554f76f8b1]] status (2 / 5)
org.apache.thrift.TApplicationException: GetOperationStatus failed: out of sequence response
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:84)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.getOperationStatusWithRetry$1(ExecuteStatement.scala:97)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:123)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:177)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2021-10-29 16:00:46.672 INFO operation.ExecuteStatement: Query[b3b82f33-10d4-4279-9253-81554f76f8b1] in RUNNING_STATE
2021-10-29 16:00:52.673 WARN operation.ExecuteStatement: Failed to get kentyao's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: b3b82f33-10d4-4279-9253-81554f76f8b1]] status (3 / 5)
org.apache.thrift.TApplicationException: GetOperationStatus failed: out of sequence response
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:84)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.getOperationStatusWithRetry$1(ExecuteStatement.scala:97)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:123)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:177)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2021-10-29 16:01:20.361 INFO operation.ExecuteStatement: Query[b3b82f33-10d4-4279-9253-81554f76f8b1] in RUNNING_STATE
2021-10-29 16:01:20.363 INFO operation.ExecuteStatement: Query[b3b82f33-10d4-4279-9253-81554f76f8b1] in ERROR_STATE
2021-10-29 16:01:20.368 INFO operation.ExecuteStatement: Processing kentyao's query[b3b82f33-10d4-4279-9253-81554f76f8b1]: RUNNING_STATE -> ERROR_STATE, statement: SELECT id AS i_item_id,
CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000), time taken: 95.426 seconds
Error: Error operating EXECUTE_STATEMENT: java.lang.OutOfMemoryError: GC overhead limit exceeded
at org.apache.spark.sql.execution.SparkPlan$$anon$1.next(SparkPlan.scala:375)
at org.apache.spark.sql.execution.SparkPlan$$anon$1.next(SparkPlan.scala:369)
at scala.collection.Iterator.foreach(Iterator.scala:941)
at scala.collection.Iterator.foreach$(Iterator.scala:941)
at org.apache.spark.sql.execution.SparkPlan$$anon$1.foreach(SparkPlan.scala:369)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$executeCollect$1(SparkPlan.scala:391)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$executeCollect$1$adapted(SparkPlan.scala:390)
at org.apache.spark.sql.execution.SparkPlan$$Lambda$2418/1921313186.apply(Unknown Source)
at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36)
at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:198)
at org.apache.spark.sql.execution.SparkPlan.executeCollect(SparkPlan.scala:390)
at org.apache.spark.sql.Dataset.collectFromPlan(Dataset.scala:3696)
at org.apache.spark.sql.Dataset.$anonfun$collect$1(Dataset.scala:2965)
at org.apache.spark.sql.Dataset$$Lambda$1935/532641542.apply(Unknown Source)
at org.apache.spark.sql.Dataset.$anonfun$withAction$1(Dataset.scala:3687)
at org.apache.spark.sql.Dataset$$Lambda$1317/756222660.apply(Unknown Source)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:103)
at org.apache.spark.sql.execution.SQLExecution$$$Lambda$1325/1607745112.apply(Unknown Source)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:90)
at org.apache.spark.sql.execution.SQLExecution$$$Lambda$1318/423629474.apply(Unknown Source)
at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:775)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
at org.apache.spark.sql.Dataset.withAction(Dataset.scala:3685)
at org.apache.spark.sql.Dataset.collect(Dataset.scala:2965)
at org.apache.kyuubi.engine.spark.operation.ExecuteStatement.$anonfun$executeStatement$1(ExecuteStatement.scala:104)
at org.apache.kyuubi.engine.spark.operation.ExecuteStatement$$Lambda$1775/426555594.apply$mcV$sp(Unknown Source)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at org.apache.kyuubi.engine.spark.operation.ExecuteStatement.withLocalProperties(ExecuteStatement.scala:152)
at org.apache.kyuubi.engine.spark.operation.ExecuteStatement.org$apache$kyuubi$engine$spark$operation$ExecuteStatement$$executeStatement(ExecuteStatement.scala:88)
at org.apache.kyuubi.engine.spark.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:120) (state=,code=0)
0: jdbc:hive2://10.219.184.36:2181/> select 1;
2021-10-29 16:08:05.257 INFO operation.ExecuteStatement: Processing kentyao's query[ddfe4d6f-e2f2-465a-9f1e-fddc8c9a4046]: INITIALIZED_STATE -> PENDING_STATE, statement: select 1
2021-10-29 16:08:05.259 INFO operation.ExecuteStatement: Processing kentyao's query[ddfe4d6f-e2f2-465a-9f1e-fddc8c9a4046]: PENDING_STATE -> RUNNING_STATE, statement: select 1
2021-10-29 16:08:05.329 INFO operation.ExecuteStatement: Query[ddfe4d6f-e2f2-465a-9f1e-fddc8c9a4046] in FINISHED_STATE
2021-10-29 16:08:05.329 INFO operation.ExecuteStatement: Processing kentyao's query[ddfe4d6f-e2f2-465a-9f1e-fddc8c9a4046]: RUNNING_STATE -> FINISHED_STATE, statement: select 1, time taken: 0.07 seconds
2021-10-29 16:08:05.258 INFO operation.ExecuteStatement: Processing kentyao's query[fc013153-9e9d-42ea-b1c7-40a6306d3445]: INITIALIZED_STATE -> PENDING_STATE, statement: select 1
2021-10-29 16:08:05.259 INFO operation.ExecuteStatement: Processing kentyao's query[fc013153-9e9d-42ea-b1c7-40a6306d3445]: PENDING_STATE -> RUNNING_STATE, statement: select 1
2021-10-29 16:08:05.260 INFO operation.ExecuteStatement:
Spark application name: kyuubi_USER_kentyao_4fff09f3-16cf-4d43-9735-31da2995fe19
application ID: local-1635494272625
application web UI: http://10.219.184.36:56152
master: local[*]
deploy mode: client
version: 3.1.2
Start time: 2021-10-29T15:57:51.958
User: kentyao
2021-10-29 16:08:05.273 INFO operation.ExecuteStatement: Processing kentyao's query[fc013153-9e9d-42ea-b1c7-40a6306d3445]: RUNNING_STATE -> RUNNING_STATE, statement: select 1
2021-10-29 16:08:05.273 INFO operation.ExecuteStatement: Execute in full collect mode
2021-10-29 16:08:05.307 INFO spark.SparkContext: Starting job: collect at ExecuteStatement.scala:104
2021-10-29 16:08:05.308 INFO kyuubi.SQLOperationListener: Query [fc013153-9e9d-42ea-b1c7-40a6306d3445]: Job 2 started with 1 stages, 1 active jobs running
2021-10-29 16:08:05.309 INFO kyuubi.SQLOperationListener: Query [fc013153-9e9d-42ea-b1c7-40a6306d3445]: Stage 2 started with 1 tasks, 1 active stages running
2021-10-29 16:08:05.327 INFO kyuubi.SQLOperationListener: Finished stage: Stage(2, 0); Name: 'collect at ExecuteStatement.scala:104'; Status: succeeded; numTasks: 1; Took: 17 msec
2021-10-29 16:08:05.327 INFO scheduler.DAGScheduler: Job 2 finished: collect at ExecuteStatement.scala:104, took 0.019803 s
2021-10-29 16:08:05.327 INFO scheduler.StatsReportListener: task runtime:(count: 1, mean: 10.000000, stdev: 0.000000, max: 10.000000, min: 10.000000)
2021-10-29 16:08:05.327 INFO scheduler.StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.327 INFO scheduler.StatsReportListener: 10.0 ms 10.0 ms 10.0 ms 10.0 ms 10.0 ms 10.0 ms 10.0 ms 10.0 ms 10.0 ms
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: shuffle bytes written:(count: 1, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: fetch wait time:(count: 1, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.328 INFO scheduler.StatsReportListener: 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms
2021-10-29 16:08:05.328 INFO operation.ExecuteStatement: Processing kentyao's query[fc013153-9e9d-42ea-b1c7-40a6306d3445]: RUNNING_STATE -> FINISHED_STATE, statement: select 1, time taken: 0.069 seconds
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: remote bytes read:(count: 1, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: task result size:(count: 1, mean: 1360.000000, stdev: 0.000000, max: 1360.000000, min: 1360.000000)
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.329 INFO scheduler.StatsReportListener: 1360.0 B 1360.0 B 1360.0 B 1360.0 B 1360.0 B 1360.0 B 1360.0 B 1360.0 B 1360.0 B
2021-10-29 16:08:05.330 INFO scheduler.StatsReportListener: executor (non-fetch) time pct: (count: 1, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
2021-10-29 16:08:05.330 INFO scheduler.StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
2021-10-29 16:08:05.330 INFO scheduler.StatsReportListener: 0 % 0 % 0 % 0 % 0 % 0 % 0 % 0 % 0 %
2021-10-29 16:08:05.330 INFO scheduler.StatsReportListener: fetch wait time pct: (count: 1, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
2021-10-29 16:08:05.330 INFO scheduler.StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
+----+
| 1 |
+----+
| 1 |
+----+
1 row selected (0.08 seconds)
0: jdbc:hive2://10.219.184.36:2181/>
```
For a local env, I could populate the final error to the client side.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on a change in pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on a change in pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#discussion_r739973585
##########
File path: kyuubi-server/src/main/scala/org/apache/kyuubi/operation/ExecuteStatement.scala
##########
@@ -83,18 +83,39 @@ class ExecuteStatement(
private def waitStatementComplete(): Unit = try {
setState(OperationState.RUNNING)
- var statusResp = client.GetOperationStatus(statusReq)
+ var statusResp: TGetOperationStatusResp = null
+ var currentAttempts = 0
+
+ def getOperationStatusWithRetry: Unit = {
+ try {
+ statusResp = client.getOperationStatus(_remoteOpHandle)
+ currentAttempts = 0 // reset attempts whenever get touch with engine again
+ } catch {
+ case e: TException if currentAttempts >= maxStatusPollOnFailure =>
+ error(s"Failed to get ${session.user}'s query[$getHandle] status after" +
+ s" $maxStatusPollOnFailure times, aborting", e)
+ throw e
+ case e: TException =>
+ currentAttempts += 1
+ warn(s"Failed to get ${session.user}'s query[$getHandle] status" +
+ s" ($currentAttempts / $maxStatusPollOnFailure)", e)
+ Thread.sleep(500)
Review comment:
Look fine to me to be hardcoded. As users already have operation.status.polling.timeout
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] codecov-commenter edited a comment on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954430673
# [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#1312](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (a816b0f) into [master](https://codecov.io/gh/apache/incubator-kyuubi/commit/4c707d6ec92b487396610dad36a2a3bc86d6231c?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (4c707d6) will **increase** coverage by `0.73%`.
> The diff coverage is `77.27%`.
> :exclamation: Current head a816b0f differs from pull request most recent head a715ecc. Consider uploading reports for the commit a715ecc to get more accurate results
[](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #1312 +/- ##
============================================
+ Coverage 77.76% 78.50% +0.73%
Complexity 110 110
============================================
Files 178 178
Lines 7215 7240 +25
Branches 880 887 +7
============================================
+ Hits 5611 5684 +73
+ Misses 1119 1071 -48
Partials 485 485
```
| [Impacted Files](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...kyuubi/engine/spark/operation/SparkOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9vcGVyYXRpb24vU3BhcmtPcGVyYXRpb24uc2NhbGE=) | `79.68% <0.00%> (-1.27%)` | :arrow_down: |
| [.../org/apache/kyuubi/operation/KyuubiOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vS3l1dWJpT3BlcmF0aW9uLnNjYWxh) | `54.09% <50.00%> (-1.26%)` | :arrow_down: |
| [.../apache/kyuubi/client/KyuubiSyncThriftClient.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jbGllbnQvS3l1dWJpU3luY1RocmlmdENsaWVudC5zY2FsYQ==) | `81.55% <68.75%> (-2.49%)` | :arrow_down: |
| [...org/apache/kyuubi/operation/ExecuteStatement.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vRXhlY3V0ZVN0YXRlbWVudC5zY2FsYQ==) | `87.75% <95.45%> (+4.95%)` | :arrow_up: |
| [...ngine/spark/SparkThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9TcGFya1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `79.36% <100.00%> (+0.33%)` | :arrow_up: |
| [...in/scala/org/apache/kyuubi/config/KyuubiConf.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jb25maWcvS3l1dWJpQ29uZi5zY2FsYQ==) | `95.16% <100.00%> (+0.04%)` | :arrow_up: |
| [...e/kyuubi/service/ThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2aWNlL1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `97.26% <100.00%> (-0.02%)` | :arrow_down: |
| [...ubi/server/KyuubiThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2ZXIvS3l1dWJpVGhyaWZ0QmluYXJ5RnJvbnRlbmRTZXJ2aWNlLnNjYWxh) | `90.00% <100.00%> (+1.11%)` | :arrow_up: |
| [...n/scala/org/apache/spark/kyuubi/ui/EngineTab.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUvc3Bhcmsva3l1dWJpL3VpL0VuZ2luZVRhYi5zY2FsYQ==) | `78.57% <0.00%> (ø)` | |
| ... and [6 more](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [4c707d6...a715ecc](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] pan3793 commented on a change in pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
pan3793 commented on a change in pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#discussion_r739938514
##########
File path: kyuubi-server/src/main/scala/org/apache/kyuubi/operation/ExecuteStatement.scala
##########
@@ -83,18 +83,39 @@ class ExecuteStatement(
private def waitStatementComplete(): Unit = try {
setState(OperationState.RUNNING)
- var statusResp = client.GetOperationStatus(statusReq)
+ var statusResp: TGetOperationStatusResp = null
+ var currentAttempts = 0
+
+ def getOperationStatusWithRetry: Unit = {
+ try {
+ statusResp = client.getOperationStatus(_remoteOpHandle)
+ currentAttempts = 0 // reset attempts whenever get touch with engine again
+ } catch {
+ case e: TException if currentAttempts >= maxStatusPollOnFailure =>
+ error(s"Failed to get ${session.user}'s query[$getHandle] status after" +
+ s" $maxStatusPollOnFailure times, aborting", e)
+ throw e
+ case e: TException =>
+ currentAttempts += 1
+ warn(s"Failed to get ${session.user}'s query[$getHandle] status" +
+ s" ($currentAttempts / $maxStatusPollOnFailure)", e)
+ Thread.sleep(500)
Review comment:
Configurable?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] pan3793 commented on a change in pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
pan3793 commented on a change in pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#discussion_r738928938
##########
File path: kyuubi-server/src/main/scala/org/apache/kyuubi/operation/KyuubiOperation.scala
##########
@@ -86,27 +87,37 @@ abstract class KyuubiOperation(
}
}
- override def cancel(): Unit = {
- if (_remoteOpHandle != null && !isClosedOrCanceled) {
- try {
- client.cancelOperation(_remoteOpHandle)
- setState(OperationState.CANCELED)
- } catch onError("cancelling")
+ override def cancel(): Unit = state.synchronized {
+ if (!isClosedOrCanceled) {
+ setState(OperationState.CANCELED)
+ if (_remoteOpHandle != null) {
Review comment:
As `remoteOpHanlde` is optional, can we use `Option` to represent it instead of testing whether being `null`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] jiaoqingbo commented on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
jiaoqingbo commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954455387
> @jiaoqingbo can you help verify this PR for #1300 on you environment to see what happens
OK，I will verify on my environment @yaooqinn
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] codecov-commenter commented on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
codecov-commenter commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954430673
# [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#1312](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (aefd2a7) into [master](https://codecov.io/gh/apache/incubator-kyuubi/commit/4c707d6ec92b487396610dad36a2a3bc86d6231c?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (4c707d6) will **increase** coverage by `0.73%`.
> The diff coverage is `75.00%`.
[](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #1312 +/- ##
============================================
+ Coverage 77.76% 78.50% +0.73%
Complexity 110 110
============================================
Files 178 178
Lines 7215 7238 +23
Branches 880 885 +5
============================================
+ Hits 5611 5682 +71
+ Misses 1119 1070 -49
- Partials 485 486 +1
```
| [Impacted Files](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../org/apache/kyuubi/operation/KyuubiOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vS3l1dWJpT3BlcmF0aW9uLnNjYWxh) | `54.09% <50.00%> (-1.26%)` | :arrow_down: |
| [.../apache/kyuubi/client/KyuubiSyncThriftClient.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jbGllbnQvS3l1dWJpU3luY1RocmlmdENsaWVudC5zY2FsYQ==) | `81.81% <55.55%> (-2.23%)` | :arrow_down: |
| [...org/apache/kyuubi/operation/ExecuteStatement.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vRXhlY3V0ZVN0YXRlbWVudC5zY2FsYQ==) | `86.13% <93.75%> (+3.34%)` | :arrow_up: |
| [...ngine/spark/SparkThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9TcGFya1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `79.36% <100.00%> (+0.33%)` | :arrow_up: |
| [...in/scala/org/apache/kyuubi/config/KyuubiConf.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jb25maWcvS3l1dWJpQ29uZi5zY2FsYQ==) | `95.16% <100.00%> (+0.04%)` | :arrow_up: |
| [...e/kyuubi/service/ThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2aWNlL1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `97.26% <100.00%> (-0.02%)` | :arrow_down: |
| [...ubi/server/KyuubiThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2ZXIvS3l1dWJpVGhyaWZ0QmluYXJ5RnJvbnRlbmRTZXJ2aWNlLnNjYWxh) | `90.00% <100.00%> (+1.11%)` | :arrow_up: |
| [...rg/apache/kyuubi/sql/zorder/ZorderBytesUtils.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZGV2L2t5dXViaS1leHRlbnNpb24tc3BhcmstY29tbW9uL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL3NxbC96b3JkZXIvWm9yZGVyQnl0ZXNVdGlscy5zY2FsYQ==) | `92.66% <0.00%> (+1.83%)` | :arrow_up: |
| [.../main/scala/org/apache/kyuubi/server/api/api.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2ZXIvYXBpL2FwaS5zY2FsYQ==) | `100.00% <0.00%> (+10.00%)` | :arrow_up: |
| ... and [4 more](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [4c707d6...aefd2a7](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] zhouyifan279 commented on a change in pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
zhouyifan279 commented on a change in pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#discussion_r739973940
##########
File path: externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkThriftBinaryFrontendService.scala
##########
@@ -147,6 +147,15 @@ class SparkThriftBinaryFrontendService(
s"${serverAddr.getHostAddress}:$portNum"
}
}
+
+ // When a OOM occurs, here we de-register the engine by stop its discoveryService.
+ // Then the current engine will not be connected by new client anymore but keep the existing ones
+ // alive. In this case we can reduce the engine's overhead and make it possible recover from that.
+ // We shall not tear down the whole engine by serverable.stop to make the engine unreachable for
+ // the exising clients which are still get statuses and report the end-users.
Review comment:
1. `exising` -> `existing`
2. `report the end-users` -> `report to the end-users`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954561974
anything useful from engine side log?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] zhouyifan279 commented on a change in pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
zhouyifan279 commented on a change in pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#discussion_r739046300
##########
File path: externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkThriftBinaryFrontendService.scala
##########
@@ -147,6 +147,10 @@ class SparkThriftBinaryFrontendService(
s"${serverAddr.getHostAddress}:$portNum"
}
}
+
+ override protected def oomHook: Runnable = {
+ () => discoveryService.foreach(_.stop())
Review comment:
Why call `discoveryService.stop()` instead of `serverable.stop()` ?
Maybe we should leave some comment here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] pan3793 closed pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
pan3793 closed pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] zhouyifan279 commented on a change in pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
zhouyifan279 commented on a change in pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#discussion_r739973940
##########
File path: externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkThriftBinaryFrontendService.scala
##########
@@ -147,6 +147,15 @@ class SparkThriftBinaryFrontendService(
s"${serverAddr.getHostAddress}:$portNum"
}
}
+
+ // When a OOM occurs, here we de-register the engine by stop its discoveryService.
+ // Then the current engine will not be connected by new client anymore but keep the existing ones
+ // alive. In this case we can reduce the engine's overhead and make it possible recover from that.
+ // We shall not tear down the whole engine by serverable.stop to make the engine unreachable for
+ // the exising clients which are still get statuses and report the end-users.
Review comment:
LGTM except these 2 minor typing error:
1. `exising` -> `existing`
2. `report the end-users` -> `report to the end-users`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] jiaoqingbo commented on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
jiaoqingbo commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954558254
0: jdbc:hive2://ocdp39:2181,vm01.asia.com:218> SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
. . . . . . . . . . . . . . . . . . . . . . .> FROM RANGE(30000000);
21/10/29 16:31:57 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: INITIALIZED_STATE -> PENDING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: PENDING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:32:02 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:31:57 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: INITIALIZED_STATE -> PENDING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: PENDING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO ExecuteStatement:
Spark application name: kyuubi_USER_ambari-qa_04de1528-113f-4754-a144-59a011a591d4
application ID: 1
application web UI: http://vm02.asia.com:8088/proxy/application_1635239556214_0034
master: yarn
deploy mode: cluster
version: 3.1.1
Start time: 2021-10-29T16:29:57.632
User: ambari-qa
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_hash replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_first_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_last_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_show_last_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_show_first_n replaced a previously registered function.
21/10/29 16:31:58 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: RUNNING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:58 INFO ExecuteStatement: Execute in full collect mode
21/10/29 16:31:58 INFO CodeGenerator: Code generated in 57.894901 ms
21/10/29 16:31:58 INFO SparkContext: Starting job: collect at ExecuteStatement.scala:104
21/10/29 16:31:58 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Job 0 started with 1 stages, 1 active jobs running
21/10/29 16:31:58 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Stage 0 started with 2 tasks, 1 active stages running
21/10/29 16:32:04 INFO SQLOperationListener: Finished stage: Stage(0, 0); Name: 'collect at ExecuteStatement.scala:104'; Status: succeeded; numTasks: 2; Took: 5987 msec
21/10/29 16:32:04 INFO DAGScheduler: Job 0 finished: collect at ExecuteStatement.scala:104, took 6.049114 s
21/10/29 16:32:04 INFO StatsReportListener: task runtime:(count: 2, mean: 5538.500000, stdev: 249.500000, max: 5788.000000, min: 5289.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 5.3 s 5.3 s 5.3 s 5.3 s 5.8 s 5.8 s 5.8 s 5.8 s 5.8 s
21/10/29 16:32:04 INFO StatsReportListener: shuffle bytes written:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
21/10/29 16:32:04 INFO StatsReportListener: fetch wait time:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms
21/10/29 16:32:04 INFO StatsReportListener: remote bytes read:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
21/10/29 16:32:04 INFO StatsReportListener: task result size:(count: 2, mean: 132877042.000000, stdev: 129321.000000, max: 133006363.000000, min: 132747721.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 126.6 MiB 126.6 MiB 126.6 MiB 126.6 MiB 126.8 MiB 126.8 MiB 126.8 MiB 126.8 MiB 126.8 MiB
21/10/29 16:32:04 INFO StatsReportListener: executor (non-fetch) time pct: (count: 2, mean: 52.057131, stdev: 1.677034, max: 53.734165, min: 50.380097)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 50 % 50 % 50 % 50 % 54 % 54 % 54 % 54 % 54 %
21/10/29 16:32:04 INFO StatsReportListener: fetch wait time pct: (count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0 % 0 % 0 % 0 % 0 % 0 % 0 % 0 % 0 %
21/10/29 16:32:04 INFO StatsReportListener: other time pct: (count: 2, mean: 47.942869, stdev: 1.677034, max: 49.619903, min: 46.265835)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 46 % 46 % 46 % 46 % 50 % 50 % 50 % 50 % 50 %
21/10/29 16:32:04 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Job 0 succeeded, 0 active jobs running
21/10/29 16:32:07 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:22 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:37 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (1 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more
21/10/29 16:32:42 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:57 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (2 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:00 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:33:15 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (3 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:23 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:33:38 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (4 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:45 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:34:00 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (5 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:34:15 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:34:30 ERROR operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status after 5 times, aborting
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more
21/10/29 16:34:30 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: RUNNING_STATE -> ERROR_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000), time taken: 152.457 seconds
Error: Error operating EXECUTE_STATEMENT: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more (state=,code=0)
0: jdbc:hive2://ocdp39:2181,vm01.asia.com:218>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] codecov-commenter edited a comment on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954430673
# [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#1312](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (aefd2a7) into [master](https://codecov.io/gh/apache/incubator-kyuubi/commit/4c707d6ec92b487396610dad36a2a3bc86d6231c?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (4c707d6) will **increase** coverage by `0.73%`.
> The diff coverage is `75.00%`.
> :exclamation: Current head aefd2a7 differs from pull request most recent head 2ed8bfb. Consider uploading reports for the commit 2ed8bfb to get more accurate results
[](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #1312 +/- ##
============================================
+ Coverage 77.76% 78.50% +0.73%
Complexity 110 110
============================================
Files 178 178
Lines 7215 7238 +23
Branches 880 885 +5
============================================
+ Hits 5611 5682 +71
+ Misses 1119 1070 -49
- Partials 485 486 +1
```
| [Impacted Files](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../org/apache/kyuubi/operation/KyuubiOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vS3l1dWJpT3BlcmF0aW9uLnNjYWxh) | `54.09% <50.00%> (-1.26%)` | :arrow_down: |
| [.../apache/kyuubi/client/KyuubiSyncThriftClient.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jbGllbnQvS3l1dWJpU3luY1RocmlmdENsaWVudC5zY2FsYQ==) | `81.81% <55.55%> (-2.23%)` | :arrow_down: |
| [...org/apache/kyuubi/operation/ExecuteStatement.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vRXhlY3V0ZVN0YXRlbWVudC5zY2FsYQ==) | `86.13% <93.75%> (+3.34%)` | :arrow_up: |
| [...ngine/spark/SparkThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9TcGFya1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `79.36% <100.00%> (+0.33%)` | :arrow_up: |
| [...in/scala/org/apache/kyuubi/config/KyuubiConf.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jb25maWcvS3l1dWJpQ29uZi5zY2FsYQ==) | `95.16% <100.00%> (+0.04%)` | :arrow_up: |
| [...e/kyuubi/service/ThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2aWNlL1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `97.26% <100.00%> (-0.02%)` | :arrow_down: |
| [...ubi/server/KyuubiThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2ZXIvS3l1dWJpVGhyaWZ0QmluYXJ5RnJvbnRlbmRTZXJ2aWNlLnNjYWxh) | `90.00% <100.00%> (+1.11%)` | :arrow_up: |
| [...rg/apache/kyuubi/sql/zorder/ZorderBytesUtils.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZGV2L2t5dXViaS1leHRlbnNpb24tc3BhcmstY29tbW9uL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL3NxbC96b3JkZXIvWm9yZGVyQnl0ZXNVdGlscy5zY2FsYQ==) | `92.66% <0.00%> (+1.83%)` | :arrow_up: |
| [.../main/scala/org/apache/kyuubi/server/api/api.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2ZXIvYXBpL2FwaS5zY2FsYQ==) | `100.00% <0.00%> (+10.00%)` | :arrow_up: |
| ... and [4 more](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [4c707d6...2ed8bfb](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] pan3793 commented on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
pan3793 commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-957075608
Thanks, merging to master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] pan3793 commented on a change in pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
pan3793 commented on a change in pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#discussion_r738930449
##########
File path: kyuubi-server/src/main/scala/org/apache/kyuubi/operation/KyuubiOperation.scala
##########
@@ -86,27 +87,37 @@ abstract class KyuubiOperation(
}
}
- override def cancel(): Unit = {
- if (_remoteOpHandle != null && !isClosedOrCanceled) {
- try {
- client.cancelOperation(_remoteOpHandle)
- setState(OperationState.CANCELED)
- } catch onError("cancelling")
+ override def cancel(): Unit = state.synchronized {
+ if (!isClosedOrCanceled) {
+ setState(OperationState.CANCELED)
+ if (_remoteOpHandle != null) {
Review comment:
`null` testing is used rarely in Kyuubi's codebase, I prefer to switch `Option` for consistency.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on a change in pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on a change in pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#discussion_r738929684
##########
File path: kyuubi-server/src/main/scala/org/apache/kyuubi/operation/KyuubiOperation.scala
##########
@@ -86,27 +87,37 @@ abstract class KyuubiOperation(
}
}
- override def cancel(): Unit = {
- if (_remoteOpHandle != null && !isClosedOrCanceled) {
- try {
- client.cancelOperation(_remoteOpHandle)
- setState(OperationState.CANCELED)
- } catch onError("cancelling")
+ override def cancel(): Unit = state.synchronized {
+ if (!isClosedOrCanceled) {
+ setState(OperationState.CANCELED)
+ if (_remoteOpHandle != null) {
Review comment:
I have no strong option of that, null testing looks fine to me
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] codecov-commenter edited a comment on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954430673
# [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#1312](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (3557c92) into [master](https://codecov.io/gh/apache/incubator-kyuubi/commit/4c707d6ec92b487396610dad36a2a3bc86d6231c?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (4c707d6) will **increase** coverage by `0.73%`.
> The diff coverage is `77.61%`.
> :exclamation: Current head 3557c92 differs from pull request most recent head a816b0f. Consider uploading reports for the commit a816b0f to get more accurate results
[](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #1312 +/- ##
============================================
+ Coverage 77.76% 78.50% +0.73%
Complexity 110 110
============================================
Files 178 178
Lines 7215 7240 +25
Branches 880 887 +7
============================================
+ Hits 5611 5684 +73
+ Misses 1119 1071 -48
Partials 485 485
```
| [Impacted Files](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...kyuubi/engine/spark/operation/SparkOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9vcGVyYXRpb24vU3BhcmtPcGVyYXRpb24uc2NhbGE=) | `79.68% <0.00%> (-1.27%)` | :arrow_down: |
| [.../org/apache/kyuubi/operation/KyuubiOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vS3l1dWJpT3BlcmF0aW9uLnNjYWxh) | `54.09% <50.00%> (-1.26%)` | :arrow_down: |
| [.../apache/kyuubi/client/KyuubiSyncThriftClient.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jbGllbnQvS3l1dWJpU3luY1RocmlmdENsaWVudC5zY2FsYQ==) | `81.55% <68.75%> (-2.49%)` | :arrow_down: |
| [...org/apache/kyuubi/operation/ExecuteStatement.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vRXhlY3V0ZVN0YXRlbWVudC5zY2FsYQ==) | `87.75% <95.65%> (+4.95%)` | :arrow_up: |
| [...ngine/spark/SparkThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9TcGFya1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `79.36% <100.00%> (+0.33%)` | :arrow_up: |
| [...in/scala/org/apache/kyuubi/config/KyuubiConf.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jb25maWcvS3l1dWJpQ29uZi5zY2FsYQ==) | `95.16% <100.00%> (+0.04%)` | :arrow_up: |
| [...e/kyuubi/service/ThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2aWNlL1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `97.26% <100.00%> (-0.02%)` | :arrow_down: |
| [...ubi/server/KyuubiThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2ZXIvS3l1dWJpVGhyaWZ0QmluYXJ5RnJvbnRlbmRTZXJ2aWNlLnNjYWxh) | `90.00% <100.00%> (+1.11%)` | :arrow_up: |
| [...n/scala/org/apache/spark/kyuubi/ui/EngineTab.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUvc3Bhcmsva3l1dWJpL3VpL0VuZ2luZVRhYi5zY2FsYQ==) | `78.57% <0.00%> (ø)` | |
| ... and [6 more](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [4c707d6...a816b0f](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] pan3793 commented on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
pan3793 commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-957075608
Thanks, merging to master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] pan3793 commented on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
pan3793 commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-957075608
Thanks, merging to master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-955893259
cc @turboFei @pan3793 @zhouyifan279
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] codecov-commenter edited a comment on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954430673
# [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#1312](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (a816b0f) into [master](https://codecov.io/gh/apache/incubator-kyuubi/commit/4c707d6ec92b487396610dad36a2a3bc86d6231c?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (4c707d6) will **increase** coverage by `0.73%`.
> The diff coverage is `77.27%`.
[](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #1312 +/- ##
============================================
+ Coverage 77.76% 78.50% +0.73%
Complexity 110 110
============================================
Files 178 178
Lines 7215 7240 +25
Branches 880 887 +7
============================================
+ Hits 5611 5684 +73
+ Misses 1119 1071 -48
Partials 485 485
```
| [Impacted Files](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...kyuubi/engine/spark/operation/SparkOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9vcGVyYXRpb24vU3BhcmtPcGVyYXRpb24uc2NhbGE=) | `79.68% <0.00%> (-1.27%)` | :arrow_down: |
| [.../org/apache/kyuubi/operation/KyuubiOperation.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vS3l1dWJpT3BlcmF0aW9uLnNjYWxh) | `54.09% <50.00%> (-1.26%)` | :arrow_down: |
| [.../apache/kyuubi/client/KyuubiSyncThriftClient.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jbGllbnQvS3l1dWJpU3luY1RocmlmdENsaWVudC5zY2FsYQ==) | `81.55% <68.75%> (-2.49%)` | :arrow_down: |
| [...org/apache/kyuubi/operation/ExecuteStatement.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9vcGVyYXRpb24vRXhlY3V0ZVN0YXRlbWVudC5zY2FsYQ==) | `87.75% <95.45%> (+4.95%)` | :arrow_up: |
| [...ngine/spark/SparkThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUva3l1dWJpL2VuZ2luZS9zcGFyay9TcGFya1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `79.36% <100.00%> (+0.33%)` | :arrow_up: |
| [...in/scala/org/apache/kyuubi/config/KyuubiConf.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9jb25maWcvS3l1dWJpQ29uZi5zY2FsYQ==) | `95.16% <100.00%> (+0.04%)` | :arrow_up: |
| [...e/kyuubi/service/ThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLWNvbW1vbi9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2aWNlL1RocmlmdEJpbmFyeUZyb250ZW5kU2VydmljZS5zY2FsYQ==) | `97.26% <100.00%> (-0.02%)` | :arrow_down: |
| [...ubi/server/KyuubiThriftBinaryFrontendService.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-a3l1dWJpLXNlcnZlci9zcmMvbWFpbi9zY2FsYS9vcmcvYXBhY2hlL2t5dXViaS9zZXJ2ZXIvS3l1dWJpVGhyaWZ0QmluYXJ5RnJvbnRlbmRTZXJ2aWNlLnNjYWxh) | `90.00% <100.00%> (+1.11%)` | :arrow_up: |
| [...n/scala/org/apache/spark/kyuubi/ui/EngineTab.scala](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-ZXh0ZXJuYWxzL2t5dXViaS1zcGFyay1zcWwtZW5naW5lL3NyYy9tYWluL3NjYWxhL29yZy9hcGFjaGUvc3Bhcmsva3l1dWJpL3VpL0VuZ2luZVRhYi5zY2FsYQ==) | `78.57% <0.00%> (ø)` | |
| ... and [6 more](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [4c707d6...a816b0f](https://codecov.io/gh/apache/incubator-kyuubi/pull/1312?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] jiaoqingbo edited a comment on pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
jiaoqingbo edited a comment on pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#issuecomment-954558589
```java
0: jdbc:hive2://ocdp39:2181,vm01.asia.com:218> SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
. . . . . . . . . . . . . . . . . . . . . . .> FROM RANGE(30000000);
21/10/29 16:31:57 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: INITIALIZED_STATE -> PENDING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: PENDING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:32:02 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:31:57 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: INITIALIZED_STATE -> PENDING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: PENDING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:57 INFO ExecuteStatement:
Spark application name: kyuubi_USER_ambari-qa_04de1528-113f-4754-a144-59a011a591d4
application ID: 1
application web UI: http://vm02.asia.com:8088/proxy/application_1635239556214_0034
master: yarn
deploy mode: cluster
version: 3.1.1
Start time: 2021-10-29T16:29:57.632
User: ambari-qa
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_hash replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_first_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_last_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_show_last_n replaced a previously registered function.
21/10/29 16:31:58 WARN SimpleFunctionRegistry: The function mask_show_first_n replaced a previously registered function.
21/10/29 16:31:58 INFO ExecuteStatement: Processing ambari-qa's query[77a435f6-58fa-4621-afd9-c1c4e6818643]: RUNNING_STATE -> RUNNING_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000)
21/10/29 16:31:58 INFO ExecuteStatement: Execute in full collect mode
21/10/29 16:31:58 INFO CodeGenerator: Code generated in 57.894901 ms
21/10/29 16:31:58 INFO SparkContext: Starting job: collect at ExecuteStatement.scala:104
21/10/29 16:31:58 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Job 0 started with 1 stages, 1 active jobs running
21/10/29 16:31:58 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Stage 0 started with 2 tasks, 1 active stages running
21/10/29 16:32:04 INFO SQLOperationListener: Finished stage: Stage(0, 0); Name: 'collect at ExecuteStatement.scala:104'; Status: succeeded; numTasks: 2; Took: 5987 msec
21/10/29 16:32:04 INFO DAGScheduler: Job 0 finished: collect at ExecuteStatement.scala:104, took 6.049114 s
21/10/29 16:32:04 INFO StatsReportListener: task runtime:(count: 2, mean: 5538.500000, stdev: 249.500000, max: 5788.000000, min: 5289.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 5.3 s 5.3 s 5.3 s 5.3 s 5.8 s 5.8 s 5.8 s 5.8 s 5.8 s
21/10/29 16:32:04 INFO StatsReportListener: shuffle bytes written:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
21/10/29 16:32:04 INFO StatsReportListener: fetch wait time:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms 0.0 ms
21/10/29 16:32:04 INFO StatsReportListener: remote bytes read:(count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B 0.0 B
21/10/29 16:32:04 INFO StatsReportListener: task result size:(count: 2, mean: 132877042.000000, stdev: 129321.000000, max: 133006363.000000, min: 132747721.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 126.6 MiB 126.6 MiB 126.6 MiB 126.6 MiB 126.8 MiB 126.8 MiB 126.8 MiB 126.8 MiB 126.8 MiB
21/10/29 16:32:04 INFO StatsReportListener: executor (non-fetch) time pct: (count: 2, mean: 52.057131, stdev: 1.677034, max: 53.734165, min: 50.380097)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 50 % 50 % 50 % 50 % 54 % 54 % 54 % 54 % 54 %
21/10/29 16:32:04 INFO StatsReportListener: fetch wait time pct: (count: 2, mean: 0.000000, stdev: 0.000000, max: 0.000000, min: 0.000000)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 0 % 0 % 0 % 0 % 0 % 0 % 0 % 0 % 0 %
21/10/29 16:32:04 INFO StatsReportListener: other time pct: (count: 2, mean: 47.942869, stdev: 1.677034, max: 49.619903, min: 46.265835)
21/10/29 16:32:04 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%
21/10/29 16:32:04 INFO StatsReportListener: 46 % 46 % 46 % 46 % 50 % 50 % 50 % 50 % 50 %
21/10/29 16:32:04 INFO SQLOperationListener: Query [77a435f6-58fa-4621-afd9-c1c4e6818643]: Job 0 succeeded, 0 active jobs running
21/10/29 16:32:07 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:22 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:37 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (1 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more
21/10/29 16:32:42 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:32:57 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (2 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:00 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:33:15 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (3 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:23 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:33:38 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (4 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:33:45 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:34:00 WARN operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status (5 / 5)
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 22 more
21/10/29 16:34:15 INFO operation.ExecuteStatement: Query[09f026f9-6fa5-4a2d-abe8-8f82987514ab] in RUNNING_STATE
21/10/29 16:34:30 ERROR operation.ExecuteStatement: Failed to get ambari-qa's query[OperationHandle [type=EXECUTE_STATEMENT, identifier: 09f026f9-6fa5-4a2d-abe8-8f82987514ab]] status after 5 times, aborting
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more
21/10/29 16:34:30 INFO operation.ExecuteStatement: Processing ambari-qa's query[09f026f9-6fa5-4a2d-abe8-8f82987514ab]: RUNNING_STATE -> ERROR_STATE, statement: SELECT id AS i_item_id, CAST(rand() * 1000 AS INT) AS i_price
FROM RANGE(30000000), time taken: 152.457 seconds
Error: Error operating EXECUTE_STATEMENT: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_GetOperationStatus(TCLIService.java:467)
at org.apache.hive.service.rpc.thrift.TCLIService$Client.GetOperationStatus(TCLIService.java:454)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.super$GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.$anonfun$GetOperationStatus$1(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.withLockAcquired(KyuubiSyncThriftClient.scala:49)
at org.apache.kyuubi.client.KyuubiSyncThriftClient.GetOperationStatus(KyuubiSyncThriftClient.scala:167)
at org.apache.kyuubi.operation.ExecuteStatement.org$apache$kyuubi$operation$ExecuteStatement$$waitStatementComplete(ExecuteStatement.scala:104)
at org.apache.kyuubi.operation.ExecuteStatement$$anon$1.run(ExecuteStatement.scala:169)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 23 more (state=,code=0)
0: jdbc:hive2://ocdp39:2181,vm01.asia.com:218>
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] pan3793 commented on a change in pull request #1312: [KYUUBI #1300] Detecting critical errors
Posted by GitBox <gi...@apache.org>.
pan3793 commented on a change in pull request #1312:
URL: https://github.com/apache/incubator-kyuubi/pull/1312#discussion_r738928938
##########
File path: kyuubi-server/src/main/scala/org/apache/kyuubi/operation/KyuubiOperation.scala
##########
@@ -86,27 +87,37 @@ abstract class KyuubiOperation(
}
}
- override def cancel(): Unit = {
- if (_remoteOpHandle != null && !isClosedOrCanceled) {
- try {
- client.cancelOperation(_remoteOpHandle)
- setState(OperationState.CANCELED)
- } catch onError("cancelling")
+ override def cancel(): Unit = state.synchronized {
+ if (!isClosedOrCanceled) {
+ setState(OperationState.CANCELED)
+ if (_remoteOpHandle != null) {
Review comment:
As `remoteOpHanlde` is optional, can we use `Option` to represent it instead of `null` testing?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org