You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by "imperio-wxm (via GitHub)" <gi...@apache.org> on 2023/11/09 11:58:50 UTC
[I] [Bug] OperationLog is closed before fetching result is completed. [kyuubi]
imperio-wxm opened a new issue, #5661:
URL: https://github.com/apache/kyuubi/issues/5661
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/kyuubi/issues?q=is%3Aissue) and found no similar issues.
### Describe the bug
OperationLog is closed before fetching result is completed.
```java
content: 2023-11-09 18:05:00.305 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing 138502236's query[b899c336-34bb-409a-bd74-f48b6f48e9f0]: RUNNING_STATE -> FINISHED_STATE, time taken: 2.134 seconds
content: 2023-11-09 18:05:00.315 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing 138502236's query[b899c336-34bb-409a-bd74-f48b6f48e9f0]: FINISHED_STATE -> CLOSED_STATE, time taken: 2.144 seconds
content: 2023-11-09 18:05:00.318 INFO org.apache.kyuubi.client.KyuubiSyncThriftClient: TCloseOperationReq(operationHandle:TOperationHandle(operationId:THandleIdentifier(guid:1D 28 8D D7 04 B6 43 19 A0 64 1D 8E 9A E0 0A 7C, secret:C2 EE 5B 97 3E A0 41 FC AC 16 9B D7 08 ED 8F 38), operationType:EXECUTE_STATEMENT, hasResultSet:true)) succeed on engine side
content: 2023-11-09 18:05:00.318 INFO org.apache.kyuubi.operation.log.OperationLog: Entry operationLog close.
content: 2023-11-09 18:05:00.318 INFO org.apache.kyuubi.operation.log.OperationLog: Delete operationLog path=/opt/kyuubi/work/server_operation_logs/b99c4569-bf6f-49e0-8eb7-b5ea86d1d623/b899c336-34bb-409a-bd74-f48b6f48e9f0
content: 2023-11-09 18:05:00.320 ERROR org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Error fetching results:
content: org.apache.kyuubi.KyuubiSQLException: Invalid OperationHandle [b899c336-34bb-409a-bd74-f48b6f48e9f0]
content: at org.apache.kyuubi.KyuubiSQLException$.apply(KyuubiSQLException.scala:69) ~[kyuubi-common_2.12-1.7.1-SNAPSHOT.jar:1.7.1-SNAPSHOT]
content: at org.apache.kyuubi.operation.OperationManager.getOperation(OperationManager.scala:103) ~[kyuubi-common_2.12-1.7.1-SNAPSHOT.jar:1.7.1-SNAPSHOT]
content: at org.apache.kyuubi.service.AbstractBackendService.fetchResults(AbstractBackendService.scala:205) ~[kyuubi-common_2.12-1.7.1-SNAPSHOT.jar:1.7.1-SNAPSHOT]
content: at org.apache.kyuubi.server.KyuubiServer$$anon$1.org$apache$kyuubi$server$BackendServiceMetric$$super$fetchResults(KyuubiServer.scala:147) ~[kyuubi-server_2.12-1.7.1-SNAPSHOT.jar:1.7.1-SNAPSHOT]
content: at org.apache.kyuubi.server.BackendServiceMetric.$anonfun$fetchResults$1(BackendServiceMetric.scala:188) ~[kyuubi-server_2.12-1.7.1-SNAPSHOT.jar:1.7.1-SNAPSHOT]
content: at org.apache.kyuubi.metrics.MetricsSystem$.timerTracing(MetricsSystem.scala:111) ~[kyuubi-metrics_2.12-1.7.1-SNAPSHOT.jar:1.7.1-SNAPSHOT]
content: at org.apache.kyuubi.server.BackendServiceMetric.fetchResults(BackendServiceMetric.scala:187) ~[kyuubi-server_2.12-1.7.1-SNAPSHOT.jar:1.7.1-SNAPSHOT]
content: at org.apache.kyuubi.server.BackendServiceMetric.fetchResults$(BackendServiceMetric.scala:182) ~[kyuubi-server_2.12-1.7.1-SNAPSHOT.jar:1.7.1-SNAPSHOT]
content: at org.apache.kyuubi.server.KyuubiServer$$anon$1.fetchResults(KyuubiServer.scala:147) ~[kyuubi-server_2.12-1.7.1-SNAPSHOT.jar:1.7.1-SNAPSHOT]
content: at org.apache.kyuubi.service.TFrontendService.FetchResults(TFrontendService.scala:530) ~[kyuubi-common_2.12-1.7.1-SNAPSHOT.jar:1.7.1-SNAPSHOT]
content: at org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1837) ~[hive-service-rpc-3.1.3.jar:3.1.3]
content: at org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1822) ~[hive-service-rpc-3.1.3.jar:3.1.3]
content: at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) ~[libthrift-0.9.3.jar:0.9.3]
content: at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) ~[libthrift-0.9.3.jar:0.9.3]
content: at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36) ~[kyuubi-common_2.12-1.7.1-SNAPSHOT.jar:1.7.1-SNAPSHOT]
content: at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) ~[libthrift-0.9.3.jar:0.9.3]
content: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_362]
content: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_362]
content: at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_362]
```
### Affects Version(s)
branch-1.7
### Kyuubi Server Log Output
_No response_
### Kyuubi Engine Log Output
_No response_
### Kyuubi Server Configurations
_No response_
### Kyuubi Engine Configurations
_No response_
### Additional context
_No response_
### Are you willing to submit PR?
- [ ] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to fix.
- [ ] No. I cannot submit a PR at this time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [Bug] OperationLog is closed before fetching result is completed. [kyuubi]
Posted by "yaooqinn (via GitHub)" <gi...@apache.org>.
yaooqinn commented on issue #5661:
URL: https://github.com/apache/kyuubi/issues/5661#issuecomment-1823749043
we can lower the log level of this fetch log message
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [Bug] OperationLog is closed before fetching result is completed. [kyuubi]
Posted by "imperio-wxm (via GitHub)" <gi...@apache.org>.
imperio-wxm commented on issue #5661:
URL: https://github.com/apache/kyuubi/issues/5661#issuecomment-1822763017
Is there any progress on this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [Bug] OperationLog is closed before fetching result is completed. [kyuubi]
Posted by "yaooqinn (via GitHub)" <gi...@apache.org>.
yaooqinn commented on issue #5661:
URL: https://github.com/apache/kyuubi/issues/5661#issuecomment-1825683766
I guess the client side fetches the log and closes the operation async, it might keep fetching the log after closing, we can dismiss the other requests coming later than close-request.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [Bug] OperationLog is closed before fetching result is completed. [kyuubi]
Posted by "imperio-wxm (via GitHub)" <gi...@apache.org>.
imperio-wxm commented on issue #5661:
URL: https://github.com/apache/kyuubi/issues/5661#issuecomment-1824636839
> we can lower the log level of this fetch log message
I don’t quite understand what you mean. The file was deleted before fetch data ended, causing the jdbc client to report an error.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org