You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@dubbo.apache.org by GitBox <gi...@apache.org> on 2022/09/28 09:31:52 UTC
[GitHub] [dubbo] neverlaughtingboy opened a new issue, #10694: when run shutdown hook ，still can receive some new request from consumer
neverlaughtingboy opened a new issue, #10694:
URL: https://github.com/apache/dubbo/issues/10694
<!-- If you need to report a security issue please visit https://github.com/apache/dubbo/security/policy -->
- [✅ ] I have searched the [issues](https://github.com/apache/dubbo/issues) of this repository and believe that this is not a duplicate.
when run shutdown hook ，still have some new request from comsumer，my application is deploy on Kubernetes
here is my log：
2022-09-27 21:44:37.965 [RID:] [traceId:] [DubboShutdownHook] INFO o.a.dubbo.config.DubboShutdownHook [DubboShutdownHook.java:59] [DUBBO] Run shutdown hook now., dubbo version: 3.0.8, current host: xxxx
2022-09-27 21:44:37.965 [RID:] [traceId:] [Thread-25] WARN c.a.n.c.http.HttpClientBeanHolder [HttpClientBeanHolder.java:108] [HttpClientBeanHolder] Start destroying common HttpClient
2022-09-27 21:44:37.965 [RID:] [traceId:] [DubboShutdownHook] INFO o.a.dubbo.rpc.model.FrameworkModel [FrameworkModel.java:294] [DUBBO] Reset global default application from Dubbo Application[1.1](xxx) to null, dubbo version: 3.0.8, current host: xxxx
2022-09-27 21:44:37.965 [RID:] [traceId:] [DubboShutdownHook] INFO o.a.d.c.d.DefaultApplicationDeployer [DefaultApplicationDeployer.java:981] [DUBBO] Dubbo Application[1.1](xxx) is stopping., dubbo version: 3.0.8, current host: xxxxx
2022-09-27 21:44:37.966 [RID:] [traceId:] [Thread-28] WARN c.a.nacos.common.notify.NotifyCenter [NotifyCenter.java:136] [NotifyCenter] Start destroying Publisher
2022-09-27 21:44:38.220 [RID:] [traceId:] [Thread-28] WARN c.a.nacos.common.notify.NotifyCenter [NotifyCenter.java:153] [NotifyCenter] Destruction of the end
2022-09-27 21:44:38.220 [RID:] [traceId:] [DubboShutdownHook] INFO o.a.d.r.support.RegistryManager [RegistryManager.java:98] [DUBBO] Close all registries [xxxx], dubbo version: 3.0.8, current host: xxx.xxx.xx.xx
2022-09-27 21:44:38.220 [RID:] [traceId:] [Thread-25] WARN c.a.n.c.http.HttpClientBeanHolder [HttpClientBeanHolder.java:114] [HttpClientBeanHolder] Destruction of the end
2022-09-27 21:44:38.221 [RID:ee105389-4bf6-4cd7-a2ae-289067769217] [traceId:] [Dubbo-global-shared-handler-thread-6] INFO there is new request log
2022-09-27 21:44:38.223 [RID:] [traceId:] [SpringApplicationShutdownHook] INFO o.a.d.c.deploy.DefaultModuleDeployer [DefaultModuleDeployer.java:288] [DUBBO] Dubbo Module[1.1.1] is stopping., dubbo version: 3.0.8, current host: xxx.xxx.xx.xx
2022-09-27 21:44:38.256 [RID:] [traceId:] [SpringApplicationShutdownHook] WARN o.a.d.r.support.RegistryManager [RegistryManager.java:127] [DUBBO] All registry instances have been destroyed, failed to fetch any instance. Usually, this means no need to try to do unnecessary redundant resource clearance, all registries has been taken care of., dubbo version: 3.0.8, current host: xxx.xxx.xx.xx
2022-09-27 21:44:38.307 [RID:] [traceId:] [SpringApplicationShutdownHook] WARN o.a.d.r.support.RegistryManager [RegistryManager.java:127] [DUBBO] All registry instances have been destroyed, failed to fetch any instance. Usually, this means no need to try to do unnecessary redundant resource clearance, all registries has been taken care of., dubbo version: 3.0.8, current host: xxx.xxx.xx.xx
2022-09-27 21:44:38.307 [RID:ee105389-4bf6-4cd7-a2ae-289067769217] [traceId:] [Dubbo-global-shared-handler-thread-6] INFO there is a response
2022-09-27 21:44:38.342 [RID:] [traceId:] [SpringApplicationShutdownHook] WARN o.a.d.r.support.RegistryManager [RegistryManager.java:127] [DUBBO] All registry instances have been destroyed, failed to fetch any instance. Usually, this means no need to try to do unnecessary redundant resource clearance, all registries has been taken care of., dubbo version: 3.0.8, current host: xxxxx
2022-09-27 21:44:38.367 [RID:] [traceId:] [Dubbo-global-shared-handler-thread-10] WARN o.a.d.r.p.d.DecodeableRpcInvocation [DecodeableRpcInvocation.java:96] [DUBBO] Decode rpc invocation failed: Service xxxxx with version 0.0.0 not found, invocation rejected., dubbo version: 3.0.8, current host: xxx.xxx.xx.xx
java.io.IOException: Service xxxxx with version 0.0.0 not found, invocation rejected.
at org.apache.dubbo.remoting.transport.CodecSupport.checkSerialization(CodecSupport.java:166)
at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:138)
at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:93)
at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
2022-09-27 21:44:38.375 [RID:] [traceId:] [SpringApplicationShutdownHook] INFO o.a.d.registry.nacos.NacosRegistry [AbstractRegistry.java:371] [DUBBO] Unsubscribe: consumer://xxxx/xxxxx?application=xxxx&background=false&category=providers,configurators,routers&check=false&dubbo=2.0.2&group=xxxxx&interface=xxxxx&methods=xxx,xxx,xxx,xxx&pid=1&qos.enable=false&release=3.0.8&retries=0&side=consumer&sticky=false&timeout=10000×tamp=1664172675707, dubbo version: 3.0.8, current host: xxx.xxx.xx.xx
2022-09-27 21:44:38.655 [RID:] [traceId:] [Dubbo-global-shared-handler-thread-11] WARN o.a.d.r.p.d.DecodeableRpcInvocation [DecodeableRpcInvocation.java:96] [DUBBO] Decode rpc invocation failed: Service xxxxx with version 0.0.0 not found, invocation rejected., dubbo version: 3.0.8, current host: xxx.xxx.xx.xx
java.io.IOException: Service xxxxx with version 0.0.0 not found, invocation rejected.
at org.apache.dubbo.remoting.transport.CodecSupport.checkSerialization(CodecSupport.java:166)
at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:138)
at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:93)
at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
2022-09-27 21:44:38.666 [RID:] [traceId:] [SpringApplicationShutdownHook] INFO o.a.d.registry.nacos.NacosRegistry [AbstractRegistry.java:371] [DUBBO] Unsubscribe: consumer://xxxx/xxxxx?application=xxxx&background=false&category=providers,configurators,routers&check=false&dubbo=2.0.2&group=xxxxx&interface=xxxxx&methods=xxx,xxxx&pid=1&qos.enable=false&release=3.0.8&retries=0&side=consumer&sticky=false&timeout=10000×tamp=1664172676045, dubbo version: 3.0.8, current host: xxx.xxx.xx.xx
2022-09-27 21:44:38.676 [RID:] [traceId:] [Dubbo-global-shared-handler-thread-7] WARN o.a.d.r.p.d.DecodeableRpcInvocation [DecodeableRpcInvocation.java:96] [DUBBO] Decode rpc invocation failed: Service xxxxx with version 0.0.0 not found, invocation rejected., dubbo version: 3.0.8, current host: xxx.xxx.xx.xx
java.io.IOException: Service xxxxx with version 0.0.0 not found, invocation rejected.
at org.apache.dubbo.remoting.transport.CodecSupport.checkSerialization(CodecSupport.java:166)
at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:138)
at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:93)
at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
2022-09-27 21:44:38.676 [RID:] [traceId:] [SpringApplicationShutdownHook] INFO o.a.d.registry.nacos.NacosRegistry [AbstractRegistry.java:371] [DUBBO] Unsubscribe: consumer://xxxxx/xxxxxx?application=xxxx&background=false&category=providers,configurators,routers&check=false&dubbo=2.0.2&group=xxxxx&interface=xxxxx&methods=xxxx,xxxx,xxxx&pid=1&qos.enable=false&release=3.0.8&retries=0&side=consumer&sticky=false&timeout=10000×tamp=1664172676295, dubbo version: 3.0.8, current host: xxx.xxx.xx.xx
2022-09-27 21:44:38.678 [RID:] [traceId:] [SpringApplicationShutdownHook] INFO o.a.d.r.t.netty4.NettyChannel [NettyChannel.java:201] [DUBBO] Close netty channel [id: 0x19fddddb, L:/xxx.xxx.xx.xx:46910 - R:/xxx.xxx.xx.xx:20880], dubbo version: 3.0.8, current host: xxx.xxx.xx.xx
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] neverlaughtingboy commented on issue #10694: when run shutdown hook ，still can receive some new request from consumer
Posted by GitBox <gi...@apache.org>.
neverlaughtingboy commented on issue #10694:
URL: https://github.com/apache/dubbo/issues/10694#issuecomment-1272248497
>
这种场景下是不是最好还是用 -Ddubbo.shutdownHook.listenIgnore=true 禁用下自带的 DubboShutdownHook ，我看有的 issue 里提到 Spring Boot 环境下的停机和 DubboShutdownHook 监听 JVM 的 shutdownHook 的停机会有冲突
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] AlbumenJ commented on issue #10694: when run shutdown hook ，still can receive some new request from consumer
Posted by GitBox <gi...@apache.org>.
AlbumenJ commented on issue #10694:
URL: https://github.com/apache/dubbo/issues/10694#issuecomment-1272426724
那就先 qos offline 摘掉 dubbo 流量，然后通过 -Ddubbo.shutdownHook.listenIgnore=true 实现 Spring web 的优雅下线。
后面的 shutdown hook 的 dubbo 在接下来的版本优化下
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] neverlaughtingboy closed issue #10694: when run shutdown hook ，still can receive some new request from consumer
Posted by GitBox <gi...@apache.org>.
neverlaughtingboy closed issue #10694: when run shutdown hook ，still can receive some new request from consumer
URL: https://github.com/apache/dubbo/issues/10694
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] AlbumenJ commented on issue #10694: when run shutdown hook ，still can receive some new request from consumer
Posted by GitBox <gi...@apache.org>.
AlbumenJ commented on issue #10694:
URL: https://github.com/apache/dubbo/issues/10694#issuecomment-1272425986
> > k8s 基于 post 脚本先调用 dubbo qos 的 offline 推送下线信息，等待一段时间后再关闭进程
>
> 这种场景下是不是最好还是用 -Ddubbo.shutdownHook.listenIgnore=true 禁用下自带的 DubboShutdownHook ，我看有的 issue 里提到 Spring Boot 环境下的停机和 DubboShutdownHook 监听 JVM 的 shutdownHook 的停机会有冲突
这个看你是 dubbo 接口作为流量入口还是 Spring web 作为流量入口，如果是 dubbo 入口的话通过 qos offline 可以先下线流量，如果通过 Spring web 入口的话就需要独立处理 shutdown hook
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] neverlaughtingboy commented on issue #10694: when run shutdown hook ，still can receive some new request from consumer
Posted by GitBox <gi...@apache.org>.
neverlaughtingboy commented on issue #10694:
URL: https://github.com/apache/dubbo/issues/10694#issuecomment-1272426221
> > > k8s 基于 post 脚本先调用 dubbo qos 的 offline 推送下线信息，等待一段时间后再关闭进程
> >
> >
> > 这种场景下是不是最好还是用 -Ddubbo.shutdownHook.listenIgnore=true 禁用下自带的 DubboShutdownHook ，我看有的 issue 里提到 Spring Boot 环境下的停机和 DubboShutdownHook 监听 JVM 的 shutdownHook 的停机会有冲突
>
> 这个看你是 dubbo 接口作为流量入口还是 Spring web 作为流量入口，如果是 dubbo 入口的话通过 qos offline 可以先下线流量，如果通过 Spring web 入口的话就需要独立处理 shutdown hook
实际上我们两种流量入口都同时存在
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] AlbumenJ commented on issue #10694: when run shutdown hook ，still can receive some new request from consumer
Posted by GitBox <gi...@apache.org>.
AlbumenJ commented on issue #10694:
URL: https://github.com/apache/dubbo/issues/10694#issuecomment-1263159166
注册中心推送是有时延的，在注册中心推送完成前还会有调用
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] neverlaughtingboy commented on issue #10694: when run shutdown hook ，still can receive some new request from consumer
Posted by GitBox <gi...@apache.org>.
neverlaughtingboy commented on issue #10694:
URL: https://github.com/apache/dubbo/issues/10694#issuecomment-1272204483
> 注册中心推送是有时延的，在注册中心推送完成前还会有调用
那这方面有基于 k8s 部署场景下的 dubbo 服务优雅退出的最佳实践吗
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] AlbumenJ commented on issue #10694: when run shutdown hook ，still can receive some new request from consumer
Posted by GitBox <gi...@apache.org>.
AlbumenJ commented on issue #10694:
URL: https://github.com/apache/dubbo/issues/10694#issuecomment-1272204849
k8s 基于 post 脚本先调用 dubbo qos 的 offline 推送下线信息，等待一段时间后再关闭进程
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] neverlaughtingboy commented on issue #10694: when run shutdown hook ，still can receive some new request from consumer
Posted by GitBox <gi...@apache.org>.
neverlaughtingboy commented on issue #10694:
URL: https://github.com/apache/dubbo/issues/10694#issuecomment-1272248544
> k8s 基于 post 脚本先调用 dubbo qos 的 offline 推送下线信息，等待一段时间后再关闭进程
这种场景下是不是最好还是用 -Ddubbo.shutdownHook.listenIgnore=true 禁用下自带的 DubboShutdownHook ，我看有的 issue 里提到 Spring Boot 环境下的停机和 DubboShutdownHook 监听 JVM 的 shutdownHook 的停机会有冲突
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org