[GitHub] [skywalking] toffentoffen opened a new issue, #9840: [Bug] io.tetrate.spm.user.receiver.envoy.AccessLogServiceGRPCHandler io.grpc.StatusRuntimeException: CANCELLED: client cancelled

[GitBox <gi...@apache.org>]

toffentoffen opened a new issue, #9840:
URL: https://github.com/apache/skywalking/issues/9840

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Apache SkyWalking Component
   
   OAP server (apache/skywalking)
   
   ### What happened
   
   When AccessLogServiceGRPC is used as a receiver, and a pod is terminated (either killed, or because of a rolling update), the sidecar that generates the ALS entries and sends them to OAP cancels the client-side grpc stream.
   On the server side, when it receives the client cancelled status, `AccessLogServiceGRPC` handles the Throwable and logs it at ERROR level:
   https://github.com/apache/skywalking/blob/9d3982db74dbe7ba9c028aef674ace13fb74cc18/oap-server/server-receiver-plugin/envoy-metrics-receiver-plugin/src/main/java/org/apache/skywalking/oap/server/receiver/envoy/AccessLogServiceGRPCHandler.java#L173
   
   In environments with Continuous deployment and high commit rate, starting new pods and terminating other can be quite frequent causing very noise logs with error messages  than can be cause confusions. 
   
   ### What you expected to happen
   
   When the client cancelled the stream, log is a debug.
   When any other error happens, log is as an error as before.
   
   ### How to reproduce
   
   Use the skywalking  showcase with mesh enable. Kill a pod and you will see this error message.
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [skywalking] kezhenxu94 closed issue #9840: [Bug] io.grpc.StatusRuntimeException: CANCELLED: client cancelled

[GitBox <gi...@apache.org>]

kezhenxu94 closed issue #9840: [Bug] io.grpc.StatusRuntimeException: CANCELLED: client cancelled
URL: https://github.com/apache/skywalking/issues/9840


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org