You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/10/06 15:09:29 UTC

[GitHub] [incubator-doris] morningman opened a new pull request #4702: [Enhance][Log] Make RPC error log more clear

morningman opened a new pull request #4702:
URL: https://github.com/apache/incubator-doris/pull/4702


   ## Proposed changes
   
   At present, when some rpc errors occur, the client cannot obtain the error information well.
   
   And this CL change the RPC error returned to client like this:
   
   ```
   ERROR 1064 (HY000): errCode = 2, detailMessage = there is no scanNode Backend. [10002: in black list(A error occurred: errorCode=2001 errorMessage:Channel inactive error!)]
   
   ERROR 1064 (HY000): failed to send brpc batch, error=The server is overcrowded, error_text=[E1011]The server is overcrowded @xx.xx.xx.xx:8060 [R1][E1011]The server is overcrowded @xx.xx.xx.xx:8060 [R2][E1011]The server is overcrowded @xx.xx.xx.xx:8060 [R3][E1011]The server is overcrowded @xx.xx.xx.xx:8060, client: yy.yy.yy.yy
   ```
   
   ## Types of changes
   
   - [x] Code refactor (Modify the code structure, format the code, etc...)
   
   ## Checklist
   
   - [x] I have create an issue on (Fix #4701), and have described the bug/feature there in detail
   - [x] Compiling and unit tests pass locally with my changes
   - [x] I have added tests that prove my fix is effective or that my feature works


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] WindyGao commented on pull request #4702: [Enhance][Log] Make RPC error log more clear

Posted by GitBox <gi...@apache.org>.
WindyGao commented on pull request #4702:
URL: https://github.com/apache/incubator-doris/pull/4702#issuecomment-911485561


   > `2021-08-24 17:18:24,477 WARN (doris-mysql-nio-pool-32867|95614) [StmtExecutor.execute():406] execute Exception. {} org.apache.doris.common.UserException: errCode = 2, detailMessage = there is no scanNode Backend. [409768988: in black list(Waited 10000 microseconds (plus 55 microseconds delay) for io.grpc.stub.ClientCalls$GrpcFuture@4b59b6d0[status=PENDING, info=[GrpcFuture{clientCall=ClientCallImpl{method=MethodDescriptor{fullMethodName=doris.PBackendService/update_cache, type=UNARY, idempotent=false, safe=false, sampledToLocalTracing=true, requestMarshaller=io.grpc.protobuf.lite.ProtoLiteUtils$MessageMarshaller@509b75a2, responseMarshaller=io.grpc.protobuf.lite.ProtoLiteUtils$MessageMarshaller@6bb04bd8, schemaDescriptor=org.apache.doris.proto.PBackendServiceGrpc$PBackendServiceMethodDescriptorSupplier@428ecf20}}}]])] at org.apache.doris.qe.SimpleScheduler.getLocation(SimpleScheduler.java:123) ~[palo-fe.jar:3.4.0] at org.apache.doris.qe.Coordinator.selectBackendsByRoundRobin(Co
 ordinator.java:1378) ~[palo-fe.jar:3.4.0] at org.apache.doris.qe.Coordinator.computeScanRangeAssignmentByScheduler(Coordinator.java:1395) ~[palo-fe.jar:3.4.0] at org.apache.doris.qe.Coordinator.computeScanRangeAssignment(Coordinator.java:1316) ~[palo-fe.jar:3.4.0] at org.apache.doris.qe.Coordinator.exec(Coordinator.java:422) ~[palo-fe.jar:3.4.0] at org.apache.doris.qe.StmtExecutor.handleCacheStmt(StmtExecutor.java:782) ~[palo-fe.jar:3.4.0] at org.apache.doris.qe.StmtExecutor.handleQueryStmt(StmtExecutor.java:846) ~[palo-fe.jar:3.4.0] at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:343) ~[palo-fe.jar:3.4.0] at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:288) ~[palo-fe.jar:3.4.0] at org.apache.doris.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:206) ~[palo-fe.jar:3.4.0] at org.apache.doris.qe.ConnectProcessor.dispatch(ConnectProcessor.java:344) ~[palo-fe.jar:3.4.0] at org.apache.doris.qe.ConnectProcessor.processOnce(ConnectProcessor.java:545) ~[pal
 o-fe.jar:3.4.0] at org.apache.doris.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:50) ~[palo-fe.jar:3.4.0] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]`
   > 
   > there is the similar problem in v0.14
   > this be node is not crashed but fe.warn has this messge
   > query is also failed
   
   Has anyone else encountered this problem?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] WindyGao commented on pull request #4702: [Enhance][Log] Make RPC error log more clear

Posted by GitBox <gi...@apache.org>.
WindyGao commented on pull request #4702:
URL: https://github.com/apache/incubator-doris/pull/4702#issuecomment-905212931


   `2021-08-24 17:18:24,477 WARN (doris-mysql-nio-pool-32867|95614) [StmtExecutor.execute():406] execute Exception. {}
   org.apache.doris.common.UserException: errCode = 2, detailMessage = there is no scanNode Backend. [409768988: in black list(Waited 10000 microseconds (plus 55 microseconds delay) for io.grpc.stub.ClientCalls$GrpcFuture@4b59b6d0[status=PENDING, info=[GrpcFuture{clientCall=ClientCallImpl{method=MethodDescriptor{fullMethodName=doris.PBackendService/update_cache, type=UNARY, idempotent=false, safe=false, sampledToLocalTracing=true, requestMarshaller=io.grpc.protobuf.lite.ProtoLiteUtils$MessageMarshaller@509b75a2, responseMarshaller=io.grpc.protobuf.lite.ProtoLiteUtils$MessageMarshaller@6bb04bd8, schemaDescriptor=org.apache.doris.proto.PBackendServiceGrpc$PBackendServiceMethodDescriptorSupplier@428ecf20}}}]])]
   	at org.apache.doris.qe.SimpleScheduler.getLocation(SimpleScheduler.java:123) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.qe.Coordinator.selectBackendsByRoundRobin(Coordinator.java:1378) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.qe.Coordinator.computeScanRangeAssignmentByScheduler(Coordinator.java:1395) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.qe.Coordinator.computeScanRangeAssignment(Coordinator.java:1316) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.qe.Coordinator.exec(Coordinator.java:422) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.qe.StmtExecutor.handleCacheStmt(StmtExecutor.java:782) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.qe.StmtExecutor.handleQueryStmt(StmtExecutor.java:846) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:343) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:288) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:206) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.qe.ConnectProcessor.dispatch(ConnectProcessor.java:344) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.qe.ConnectProcessor.processOnce(ConnectProcessor.java:545) ~[palo-fe.jar:3.4.0]
   	at org.apache.doris.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:50) ~[palo-fe.jar:3.4.0]
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
   	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]`
   
   
   there is the similar problem in v0.14
   this be node is not crashed but fe.warn has this messge 
   query is also failed 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] morningman merged pull request #4702: [Enhance][Log] Make RPC error log more clear

Posted by GitBox <gi...@apache.org>.
morningman merged pull request #4702:
URL: https://github.com/apache/incubator-doris/pull/4702


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org