You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2021/09/02 10:49:05 UTC

[GitHub] [incubator-doris] xinyiZzz opened a new issue #6555: [Bug] sendFragment timeout, after high concurrency stress test

xinyiZzz opened a new issue #6555:
URL: https://github.com/apache/incubator-doris/issues/6555


   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Version
   
   0.14.12
   
   ### What's Wrong?
   
   Start 4 jmeter processes, each jmeter process has 200 threads, and an error sendFragment timeout is reported after a period of stress testing.
   
   After closing all jmeter processes and starting a jmeter process and there is only one thread, the sendFragment timeout error is still reported.
   
   It is suspected that the client somewhere is not released:
   ![image](https://user-images.githubusercontent.com/13197424/131830743-774a3d0e-f40a-4de1-b4f3-38fa2ff208ce.png)
   
   Detailed:
   ```
   2021-09-02 18:31:42,112 WARN (doris-mysql-nio-pool-361|642) [Coordinator.sendFragment():571] exec plan fragment failed, errmsg=Waited 5000 milliseconds (plus 89075 nanoseconds delay) for io.grpc.stub.ClientCalls$GrpcFuture@1e14cbd9[status=PENDING, info=[GrpcFuture{clientCall=ClientCallImpl{method=MethodDescriptor{fullMethodName=doris.PBackendService/exec_plan_fragment, type=UNARY, idempotent=false, safe=false, sampledToLocalTracing=true, requestMarshaller=io.grpc.protobuf.lite.ProtoLiteUtils$MessageMarshaller@68db04c6, responseMarshaller=io.grpc.protobuf.lite.ProtoLiteUtils$MessageMarshaller@53f9d004, schemaDescriptor=org.apache.doris.proto.PBackendServiceGrpc$PBackendServiceMethodDescriptorSupplier@683faf26}}}]], code: TIMEOUT, fragmentId=F00, backend=192.168.32.10:29060
   2021-09-02 18:31:42,112 WARN (doris-mysql-nio-pool-361|642) [StmtExecutor.execute():406] execute Exception. {}
   org.apache.doris.common.UserException: errCode = 2, detailMessage = query timeout. backend id: 10004
           at org.apache.doris.qe.Coordinator.sendFragment(Coordinator.java:577) ~[palo-fe.jar:3.4.0]
           at org.apache.doris.qe.Coordinator.exec(Coordinator.java:469) ~[palo-fe.jar:3.4.0]
           at org.apache.doris.qe.StmtExecutor.handleQueryStmt(StmtExecutor.java:863) ~[palo-fe.jar:3.4.0]
           at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:343) ~[palo-fe.jar:3.4.0]
           at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:288) ~[palo-fe.jar:3.4.0]
           at org.apache.doris.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:206) ~[palo-fe.jar:3.4.0]
           at org.apache.doris.qe.ConnectProcessor.dispatch(ConnectProcessor.java:344) ~[palo-fe.jar:3.4.0]
           at org.apache.doris.qe.ConnectProcessor.processOnce(ConnectProcessor.java:545) ~[palo-fe.jar:3.4.0]
           at org.apache.doris.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:50) ~[palo-fe.jar:3.4.0]
           at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_292]
           at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_292]
           at java.lang.Thread.run(Thread.java:748) [?:1.8.0_292]
   ```
   
   ### What You Expected?
   
   win
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org