You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@dubbo.apache.org by GitBox <gi...@apache.org> on 2021/08/05 13:48:07 UTC

[GitHub] [dubbo] startjava opened a new issue #8431: cluster = ClusterRules.FAIL_BACK出现java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常。

startjava opened a new issue #8431:
URL: https://github.com/apache/dubbo/issues/8431


   提供者代码:
   @DubboService
   public class HelloService1 implements IService1 {
       @Value("${server.port}")
       private int portValue;
   
       @Override
       public String getHello(String username) {
           System.out.println("HelloService1 portValue=" + portValue);
           try {
               if (portValue == 8085) {
                   Thread.sleep(10000);
               }
           } catch (InterruptedException e) {
               e.printStackTrace();
           }
           return "hello1 " + username + " port=" + portValue;
       }
   }
   
   消费者代码:
   @RestController
   public class TestCcontroller {
       @DubboReference(cluster = ClusterRules.FAIL_BACK)
       private IService1 service1;
   
       @RequestMapping("Test1")
       public String test1() {
           String helloString = service1.getHello("中国人1");
           System.out.println("public String test1() " + helloString);
           return "返回信息:" + helloString;
       }
   }
   
   
   ----------------------------------------------------------------------------------
   消费者执行后出现如下异常:
   2021-08-05 21:39:20.298 ERROR 25224 --- [nio-8088-exec-3] o.a.d.r.c.s.FailbackClusterInvoker       :  [DUBBO] Failback to invoke method getHello, wait for retry in background. Ignored exception: Invoke remote method timeout. method: getHello, provider: DefaultServiceInstance{, serviceName='my-fault-tolerant-provider-8085', host='192.168.56.1', port=20880, enabled=true, healthy=true, metadata={side=provider, methods=getHello, release=3.0.1, deprecated=false, dubbo=2.0.2, dubbo.metadata.revision=b90aba7582ee3530cdc429b656e47e26, pid=26292, dubbo.metadata.storage-type=local, interface=com.ghy.www.api.IService1, generic=false, dubbo.metadata-service.url-params={"version":"1.0.0","dubbo":"2.0.2","release":"3.0.1","port":"20880","protocol":"dubbo"}, metadata-type=remote, application=my-fault-tolerant-provider-8085, dubbo.endpoints=[{"port":20880,"protocol":"dubbo"}], dynamic=true, anyhost=true, timestamp=1628170651656}}, service{name='com.ghy.www.api.IService1',group='null',version='nul
 l',protocol='dubbo',params={side=provider, release=3.0.1, methods=getHello, deprecated=false, dubbo=2.0.2, pid=26292, interface=com.ghy.www.api.IService1, generic=false, metadata-type=remote, application=my-fault-tolerant-provider-8085, dynamic=true, anyhost=true, timestamp=1628170651656},consumerParams={cluster=failback, side=consumer, register.ip=192.168.56.1, release=3.0.1, methods=getHello, dubbo=2.0.2, pid=25224, interface=com.ghy.www.api.IService1, qos.enable=false, metadata-type=remote, application=my-fault-tolerant-consumer-failback, sticky=false, timestamp=1628170693311}}, cause: org.apache.dubbo.remoting.TimeoutException: Waiting server-side response timeout by scan timer. start time: 2021-08-05 21:39:19.273, end time: 2021-08-05 21:39:20.292, client elapsed: 1 ms, server elapsed: 1018 ms, timeout: 1000 ms, request: Request [id=6, version=2.0.2, twoway=true, event=false, broken=false, data=null], channel: /192.168.56.1:10780 -> /192.168.56.1:20880, , dubbo version: 3.0.1, 
 current host: 192.168.56.1
   
   org.apache.dubbo.rpc.RpcException: Invoke remote method timeout. method: getHello, provider: DefaultServiceInstance{, serviceName='my-fault-tolerant-provider-8085', host='192.168.56.1', port=20880, enabled=true, healthy=true, metadata={side=provider, methods=getHello, release=3.0.1, deprecated=false, dubbo=2.0.2, dubbo.metadata.revision=b90aba7582ee3530cdc429b656e47e26, pid=26292, dubbo.metadata.storage-type=local, interface=com.ghy.www.api.IService1, generic=false, dubbo.metadata-service.url-params={"version":"1.0.0","dubbo":"2.0.2","release":"3.0.1","port":"20880","protocol":"dubbo"}, metadata-type=remote, application=my-fault-tolerant-provider-8085, dubbo.endpoints=[{"port":20880,"protocol":"dubbo"}], dynamic=true, anyhost=true, timestamp=1628170651656}}, service{name='com.ghy.www.api.IService1',group='null',version='null',protocol='dubbo',params={side=provider, release=3.0.1, methods=getHello, deprecated=false, dubbo=2.0.2, pid=26292, interface=com.ghy.www.api.IService1, gener
 ic=false, metadata-type=remote, application=my-fault-tolerant-provider-8085, dynamic=true, anyhost=true, timestamp=1628170651656},consumerParams={cluster=failback, side=consumer, register.ip=192.168.56.1, release=3.0.1, methods=getHello, dubbo=2.0.2, pid=25224, interface=com.ghy.www.api.IService1, qos.enable=false, metadata-type=remote, application=my-fault-tolerant-consumer-failback, sticky=false, timestamp=1628170693311}}, cause: org.apache.dubbo.remoting.TimeoutException: Waiting server-side response timeout by scan timer. start time: 2021-08-05 21:39:19.273, end time: 2021-08-05 21:39:20.292, client elapsed: 1 ms, server elapsed: 1018 ms, timeout: 1000 ms, request: Request [id=6, version=2.0.2, twoway=true, event=false, broken=false, data=null], channel: /192.168.56.1:10780 -> /192.168.56.1:20880
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.waitForResultIfSync(AbstractInvoker.java:280) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.invoke(AbstractInvoker.java:181) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.listener.ListenerInvokerWrapper.invoke(ListenerInvokerWrapper.java:78) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.support.AbstractClusterInvoker.invokeWithContext(AbstractClusterInvoker.java:297) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.support.FailbackClusterInvoker.doInvoke(FailbackClusterInvoker.java:101) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.support.AbstractClusterInvoker.invoke(AbstractClusterInvoker.java:265) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.monitor.support.MonitorFilter.invoke(MonitorFilter.java:89) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.filter.FilterChainBuilder$FilterChainNode.invoke(FilterChainBuilder.java:82) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.protocol.dubbo.filter.FutureFilter.invoke(FutureFilter.java:51) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.filter.FilterChainBuilder$FilterChainNode.invoke(FilterChainBuilder.java:82) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.filter.support.ConsumerContextFilter.invoke(ConsumerContextFilter.java:101) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.filter.FilterChainBuilder$FilterChainNode.invoke(FilterChainBuilder.java:82) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.support.wrapper.AbstractCluster$ClusterFilterInvoker.invoke(AbstractCluster.java:93) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.support.wrapper.MockClusterInvoker.invoke(MockClusterInvoker.java:93) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.registry.client.migration.MigrationInvoker.invoke(MigrationInvoker.java:276) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.proxy.InvokerInvocationHandler.invoke(InvokerInvocationHandler.java:95) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.bytecode.proxy1.getHello(proxy1.java) ~[dubbo-3.0.1.jar:3.0.1]
   	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:na]
   	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:na]
   	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:na]
   	at java.base/java.lang.reflect.Method.invoke(Method.java:564) ~[na:na]
   	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) ~[spring-aop-5.3.9.jar:5.3.9]
   	at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:208) ~[spring-aop-5.3.9.jar:5.3.9]
   	at com.sun.proxy.$Proxy62.getHello(Unknown Source) ~[na:na]
   	at com.ghy.www.controller.TestCcontroller.test1(TestCcontroller.java:16) ~[classes/:na]
   	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:na]
   	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:na]
   	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:na]
   	at java.base/java.lang.reflect.Method.invoke(Method.java:564) ~[na:na]
   	at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:197) ~[spring-web-5.3.9.jar:5.3.9]
   	at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:141) ~[spring-web-5.3.9.jar:5.3.9]
   	at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:106) ~[spring-webmvc-5.3.9.jar:5.3.9]
   	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) ~[spring-webmvc-5.3.9.jar:5.3.9]
   	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) ~[spring-webmvc-5.3.9.jar:5.3.9]
   	at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) ~[spring-webmvc-5.3.9.jar:5.3.9]
   	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1064) ~[spring-webmvc-5.3.9.jar:5.3.9]
   	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963) ~[spring-webmvc-5.3.9.jar:5.3.9]
   	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) ~[spring-webmvc-5.3.9.jar:5.3.9]
   	at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898) ~[spring-webmvc-5.3.9.jar:5.3.9]
   	at javax.servlet.http.HttpServlet.service(HttpServlet.java:655) ~[tomcat-embed-core-9.0.50.jar:4.0.FR]
   	at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) ~[spring-webmvc-5.3.9.jar:5.3.9]
   	at javax.servlet.http.HttpServlet.service(HttpServlet.java:764) ~[tomcat-embed-core-9.0.50.jar:4.0.FR]
   	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:228) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) ~[tomcat-embed-websocket-9.0.50.jar:9.0.50]
   	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:190) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) ~[spring-web-5.3.9.jar:5.3.9]
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.3.9.jar:5.3.9]
   	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:190) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) ~[spring-web-5.3.9.jar:5.3.9]
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.3.9.jar:5.3.9]
   	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:190) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) ~[spring-web-5.3.9.jar:5.3.9]
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.3.9.jar:5.3.9]
   	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:190) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:163) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:542) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:143) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:357) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:382) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:893) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1723) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) ~[na:na]
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) ~[na:na]
   	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) ~[tomcat-embed-core-9.0.50.jar:9.0.50]
   	at java.base/java.lang.Thread.run(Thread.java:832) ~[na:na]
   Caused by: java.util.concurrent.ExecutionException: org.apache.dubbo.remoting.TimeoutException: Waiting server-side response timeout by scan timer. start time: 2021-08-05 21:39:19.273, end time: 2021-08-05 21:39:20.292, client elapsed: 1 ms, server elapsed: 1018 ms, timeout: 1000 ms, request: Request [id=6, version=2.0.2, twoway=true, event=false, broken=false, data=null], channel: /192.168.56.1:10780 -> /192.168.56.1:20880
   	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395) ~[na:na]
   	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2086) ~[na:na]
   	at org.apache.dubbo.rpc.AsyncRpcResult.get(AsyncRpcResult.java:181) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.waitForResultIfSync(AbstractInvoker.java:272) ~[dubbo-3.0.1.jar:3.0.1]
   	... 74 common frames omitted
   Caused by: org.apache.dubbo.remoting.TimeoutException: Waiting server-side response timeout by scan timer. start time: 2021-08-05 21:39:19.273, end time: 2021-08-05 21:39:20.292, client elapsed: 1 ms, server elapsed: 1018 ms, timeout: 1000 ms, request: Request [id=6, version=2.0.2, twoway=true, event=false, broken=false, data=null], channel: /192.168.56.1:10780 -> /192.168.56.1:20880
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture.doReceived(DefaultFuture.java:210) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture.received(DefaultFuture.java:175) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture$TimeoutCheckTask.notifyTimeout(DefaultFuture.java:298) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture$TimeoutCheckTask.lambda$run$0(DefaultFuture.java:285) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.threadpool.ThreadlessExecutor$RunnableWrapper.run(ThreadlessExecutor.java:196) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.threadpool.ThreadlessExecutor.waitAndDrain(ThreadlessExecutor.java:99) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.AsyncRpcResult.get(AsyncRpcResult.java:179) ~[dubbo-3.0.1.jar:3.0.1]
   	... 75 common frames omitted
   
   public String test1() null
   2021-08-05 21:39:26.304 ERROR 25224 --- [-timer-thread-1] o.a.d.r.c.s.FailbackClusterInvoker       :  [DUBBO] Failed retry to invoke method getHello, waiting again., dubbo version: 3.0.1, current host: 192.168.56.1
   
   org.apache.dubbo.rpc.RpcException: Failed to invoke remote method: getHello, provider: DefaultServiceInstance{, serviceName='my-fault-tolerant-provider-8086', host='192.168.56.1', port=20881, enabled=true, healthy=true, metadata={side=provider, methods=getHello, release=3.0.1, deprecated=false, dubbo=2.0.2, dubbo.metadata.revision=5d116ec4c7f71ebeec3cc2b81ce491a6, pid=29536, dubbo.metadata.storage-type=local, interface=com.ghy.www.api.IService1, generic=false, dubbo.metadata-service.url-params={"version":"1.0.0","dubbo":"2.0.2","release":"3.0.1","port":"20881","protocol":"dubbo"}, metadata-type=remote, application=my-fault-tolerant-provider-8086, dubbo.endpoints=[{"port":20881,"protocol":"dubbo"}], dynamic=true, anyhost=true, timestamp=1628170657112}}, cause: org.apache.dubbo.remoting.RemotingException: Fail to decode request due to: java.lang.NullPointerException
   java.lang.NullPointerException
   	at java.base/java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
   	at org.apache.dubbo.rpc.support.GroupServiceKeyCache.getServiceKey(GroupServiceKeyCache.java:37)
   	at org.apache.dubbo.rpc.support.ProtocolUtils.serviceKey(ProtocolUtils.java:51)
   	at org.apache.dubbo.rpc.protocol.AbstractProtocol.serviceKey(AbstractProtocol.java:62)
   	at org.apache.dubbo.rpc.protocol.dubbo.DubboProtocol.getInvoker(DubboProtocol.java:256)
   	at org.apache.dubbo.rpc.protocol.dubbo.CallbackServiceCodec.decodeInvocationArgument(CallbackServiceCodec.java:292)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:177)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:83)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
   	at org.apache.dubbo.common.threadlocal.InternalRunnable.run(InternalRunnable.java:41)
   	at java.base/java.lang.Thread.run(Thread.java:832)
   
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.waitForResultIfSync(AbstractInvoker.java:283) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.invoke(AbstractInvoker.java:181) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.listener.ListenerInvokerWrapper.invoke(ListenerInvokerWrapper.java:78) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.support.AbstractClusterInvoker.invokeWithContext(AbstractClusterInvoker.java:297) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.support.FailbackClusterInvoker$RetryTimerTask.run(FailbackClusterInvoker.java:144) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.timer.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:648) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.timer.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:727) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.timer.HashedWheelTimer$Worker.run(HashedWheelTimer.java:449) ~[dubbo-3.0.1.jar:3.0.1]
   	at java.base/java.lang.Thread.run(Thread.java:832) ~[na:na]
   Caused by: java.util.concurrent.ExecutionException: org.apache.dubbo.remoting.RemotingException: Fail to decode request due to: java.lang.NullPointerException
   java.lang.NullPointerException
   	at java.base/java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
   	at org.apache.dubbo.rpc.support.GroupServiceKeyCache.getServiceKey(GroupServiceKeyCache.java:37)
   	at org.apache.dubbo.rpc.support.ProtocolUtils.serviceKey(ProtocolUtils.java:51)
   	at org.apache.dubbo.rpc.protocol.AbstractProtocol.serviceKey(AbstractProtocol.java:62)
   	at org.apache.dubbo.rpc.protocol.dubbo.DubboProtocol.getInvoker(DubboProtocol.java:256)
   	at org.apache.dubbo.rpc.protocol.dubbo.CallbackServiceCodec.decodeInvocationArgument(CallbackServiceCodec.java:292)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:177)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:83)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
   	at org.apache.dubbo.common.threadlocal.InternalRunnable.run(InternalRunnable.java:41)
   	at java.base/java.lang.Thread.run(Thread.java:832)
   
   	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395) ~[na:na]
   	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2086) ~[na:na]
   	at org.apache.dubbo.rpc.AsyncRpcResult.get(AsyncRpcResult.java:181) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.waitForResultIfSync(AbstractInvoker.java:272) ~[dubbo-3.0.1.jar:3.0.1]
   	... 8 common frames omitted
   Caused by: org.apache.dubbo.remoting.RemotingException: Fail to decode request due to: java.lang.NullPointerException
   java.lang.NullPointerException
   	at java.base/java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
   	at org.apache.dubbo.rpc.support.GroupServiceKeyCache.getServiceKey(GroupServiceKeyCache.java:37)
   	at org.apache.dubbo.rpc.support.ProtocolUtils.serviceKey(ProtocolUtils.java:51)
   	at org.apache.dubbo.rpc.protocol.AbstractProtocol.serviceKey(AbstractProtocol.java:62)
   	at org.apache.dubbo.rpc.protocol.dubbo.DubboProtocol.getInvoker(DubboProtocol.java:256)
   	at org.apache.dubbo.rpc.protocol.dubbo.CallbackServiceCodec.decodeInvocationArgument(CallbackServiceCodec.java:292)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:177)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:83)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
   	at org.apache.dubbo.common.threadlocal.InternalRunnable.run(InternalRunnable.java:41)
   	at java.base/java.lang.Thread.run(Thread.java:832)
   
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture.doReceived(DefaultFuture.java:212) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture.received(DefaultFuture.java:175) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture.received(DefaultFuture.java:163) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.header.HeaderExchangeHandler.handleResponse(HeaderExchangeHandler.java:60) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.header.HeaderExchangeHandler.received(HeaderExchangeHandler.java:181) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:51) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.threadpool.ThreadlessExecutor$RunnableWrapper.run(ThreadlessExecutor.java:196) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.threadpool.ThreadlessExecutor.waitAndDrain(ThreadlessExecutor.java:99) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.AsyncRpcResult.get(AsyncRpcResult.java:179) ~[dubbo-3.0.1.jar:3.0.1]
   	... 9 common frames omitted
   
   2021-08-05 21:39:29.277  WARN 25224 --- [andler-thread-2] o.a.d.r.p.dubbo.DecodeableRpcResult      :  [DUBBO] Decode rpc result failed: null, dubbo version: 3.0.1, current host: 192.168.56.1
   
   java.lang.NullPointerException: null
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcResult.decode(DecodeableRpcResult.java:122) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:48) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57) ~[dubbo-3.0.1.jar:3.0.1]
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) ~[na:na]
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) ~[na:na]
   	at org.apache.dubbo.common.threadlocal.InternalRunnable.run(InternalRunnable.java:41) ~[dubbo-3.0.1.jar:3.0.1]
   	at java.base/java.lang.Thread.run(Thread.java:832) ~[na:na]
   
   2021-08-05 21:39:29.278  WARN 25224 --- [andler-thread-2] o.a.d.r.exchange.support.DefaultFuture   :  [DUBBO] The timeout response finally returned at 2021-08-05 21:39:29.278, response status is 90, channel: /192.168.56.1:10780 -> /192.168.56.1:20880, please check provider side for detailed result., dubbo version: 3.0.1, current host: 192.168.56.1
   2021-08-05 21:39:32.306 ERROR 25224 --- [-timer-thread-1] o.a.d.r.c.s.FailbackClusterInvoker       :  [DUBBO] Failed retry to invoke method getHello, waiting again., dubbo version: 3.0.1, current host: 192.168.56.1
   
   org.apache.dubbo.rpc.RpcException: Failed to invoke remote method: getHello, provider: DefaultServiceInstance{, serviceName='my-fault-tolerant-provider-8085', host='192.168.56.1', port=20880, enabled=true, healthy=true, metadata={side=provider, methods=getHello, release=3.0.1, deprecated=false, dubbo=2.0.2, dubbo.metadata.revision=b90aba7582ee3530cdc429b656e47e26, pid=26292, dubbo.metadata.storage-type=local, interface=com.ghy.www.api.IService1, generic=false, dubbo.metadata-service.url-params={"version":"1.0.0","dubbo":"2.0.2","release":"3.0.1","port":"20880","protocol":"dubbo"}, metadata-type=remote, application=my-fault-tolerant-provider-8085, dubbo.endpoints=[{"port":20880,"protocol":"dubbo"}], dynamic=true, anyhost=true, timestamp=1628170651656}}, cause: org.apache.dubbo.remoting.RemotingException: Fail to decode request due to: java.lang.NullPointerException
   java.lang.NullPointerException
   	at java.base/java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
   	at org.apache.dubbo.rpc.support.GroupServiceKeyCache.getServiceKey(GroupServiceKeyCache.java:37)
   	at org.apache.dubbo.rpc.support.ProtocolUtils.serviceKey(ProtocolUtils.java:51)
   	at org.apache.dubbo.rpc.protocol.AbstractProtocol.serviceKey(AbstractProtocol.java:62)
   	at org.apache.dubbo.rpc.protocol.dubbo.DubboProtocol.getInvoker(DubboProtocol.java:256)
   	at org.apache.dubbo.rpc.protocol.dubbo.CallbackServiceCodec.decodeInvocationArgument(CallbackServiceCodec.java:292)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:177)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:83)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
   	at org.apache.dubbo.common.threadlocal.InternalRunnable.run(InternalRunnable.java:41)
   	at java.base/java.lang.Thread.run(Thread.java:832)
   
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.waitForResultIfSync(AbstractInvoker.java:283) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.invoke(AbstractInvoker.java:181) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.listener.ListenerInvokerWrapper.invoke(ListenerInvokerWrapper.java:78) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.support.AbstractClusterInvoker.invokeWithContext(AbstractClusterInvoker.java:297) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.support.FailbackClusterInvoker$RetryTimerTask.run(FailbackClusterInvoker.java:144) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.timer.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:648) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.timer.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:727) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.timer.HashedWheelTimer$Worker.run(HashedWheelTimer.java:449) ~[dubbo-3.0.1.jar:3.0.1]
   	at java.base/java.lang.Thread.run(Thread.java:832) ~[na:na]
   Caused by: java.util.concurrent.ExecutionException: org.apache.dubbo.remoting.RemotingException: Fail to decode request due to: java.lang.NullPointerException
   java.lang.NullPointerException
   	at java.base/java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
   	at org.apache.dubbo.rpc.support.GroupServiceKeyCache.getServiceKey(GroupServiceKeyCache.java:37)
   	at org.apache.dubbo.rpc.support.ProtocolUtils.serviceKey(ProtocolUtils.java:51)
   	at org.apache.dubbo.rpc.protocol.AbstractProtocol.serviceKey(AbstractProtocol.java:62)
   	at org.apache.dubbo.rpc.protocol.dubbo.DubboProtocol.getInvoker(DubboProtocol.java:256)
   	at org.apache.dubbo.rpc.protocol.dubbo.CallbackServiceCodec.decodeInvocationArgument(CallbackServiceCodec.java:292)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:177)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:83)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
   	at org.apache.dubbo.common.threadlocal.InternalRunnable.run(InternalRunnable.java:41)
   	at java.base/java.lang.Thread.run(Thread.java:832)
   
   	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395) ~[na:na]
   	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2086) ~[na:na]
   	at org.apache.dubbo.rpc.AsyncRpcResult.get(AsyncRpcResult.java:181) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.waitForResultIfSync(AbstractInvoker.java:272) ~[dubbo-3.0.1.jar:3.0.1]
   	... 8 common frames omitted
   Caused by: org.apache.dubbo.remoting.RemotingException: Fail to decode request due to: java.lang.NullPointerException
   java.lang.NullPointerException
   	at java.base/java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
   	at org.apache.dubbo.rpc.support.GroupServiceKeyCache.getServiceKey(GroupServiceKeyCache.java:37)
   	at org.apache.dubbo.rpc.support.ProtocolUtils.serviceKey(ProtocolUtils.java:51)
   	at org.apache.dubbo.rpc.protocol.AbstractProtocol.serviceKey(AbstractProtocol.java:62)
   	at org.apache.dubbo.rpc.protocol.dubbo.DubboProtocol.getInvoker(DubboProtocol.java:256)
   	at org.apache.dubbo.rpc.protocol.dubbo.CallbackServiceCodec.decodeInvocationArgument(CallbackServiceCodec.java:292)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:177)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:83)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
   	at org.apache.dubbo.common.threadlocal.InternalRunnable.run(InternalRunnable.java:41)
   	at java.base/java.lang.Thread.run(Thread.java:832)
   
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture.doReceived(DefaultFuture.java:212) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture.received(DefaultFuture.java:175) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture.received(DefaultFuture.java:163) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.header.HeaderExchangeHandler.handleResponse(HeaderExchangeHandler.java:60) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.header.HeaderExchangeHandler.received(HeaderExchangeHandler.java:181) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:51) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.threadpool.ThreadlessExecutor$RunnableWrapper.run(ThreadlessExecutor.java:196) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.threadpool.ThreadlessExecutor.waitAndDrain(ThreadlessExecutor.java:99) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.AsyncRpcResult.get(AsyncRpcResult.java:179) ~[dubbo-3.0.1.jar:3.0.1]
   	... 9 common frames omitted
   
   2021-08-05 21:39:38.304 ERROR 25224 --- [-timer-thread-1] o.a.d.r.c.s.FailbackClusterInvoker       :  [DUBBO] Failed retry to invoke method getHello, waiting again., dubbo version: 3.0.1, current host: 192.168.56.1
   
   org.apache.dubbo.rpc.RpcException: Failed to invoke remote method: getHello, provider: DefaultServiceInstance{, serviceName='my-fault-tolerant-provider-8086', host='192.168.56.1', port=20881, enabled=true, healthy=true, metadata={side=provider, methods=getHello, release=3.0.1, deprecated=false, dubbo=2.0.2, dubbo.metadata.revision=5d116ec4c7f71ebeec3cc2b81ce491a6, pid=29536, dubbo.metadata.storage-type=local, interface=com.ghy.www.api.IService1, generic=false, dubbo.metadata-service.url-params={"version":"1.0.0","dubbo":"2.0.2","release":"3.0.1","port":"20881","protocol":"dubbo"}, metadata-type=remote, application=my-fault-tolerant-provider-8086, dubbo.endpoints=[{"port":20881,"protocol":"dubbo"}], dynamic=true, anyhost=true, timestamp=1628170657112}}, cause: org.apache.dubbo.remoting.RemotingException: Fail to decode request due to: java.lang.NullPointerException
   java.lang.NullPointerException
   	at java.base/java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
   	at org.apache.dubbo.rpc.support.GroupServiceKeyCache.getServiceKey(GroupServiceKeyCache.java:37)
   	at org.apache.dubbo.rpc.support.ProtocolUtils.serviceKey(ProtocolUtils.java:51)
   	at org.apache.dubbo.rpc.protocol.AbstractProtocol.serviceKey(AbstractProtocol.java:62)
   	at org.apache.dubbo.rpc.protocol.dubbo.DubboProtocol.getInvoker(DubboProtocol.java:256)
   	at org.apache.dubbo.rpc.protocol.dubbo.CallbackServiceCodec.decodeInvocationArgument(CallbackServiceCodec.java:292)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:177)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:83)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
   	at org.apache.dubbo.common.threadlocal.InternalRunnable.run(InternalRunnable.java:41)
   	at java.base/java.lang.Thread.run(Thread.java:832)
   
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.waitForResultIfSync(AbstractInvoker.java:283) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.invoke(AbstractInvoker.java:181) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.listener.ListenerInvokerWrapper.invoke(ListenerInvokerWrapper.java:78) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.support.AbstractClusterInvoker.invokeWithContext(AbstractClusterInvoker.java:297) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.cluster.support.FailbackClusterInvoker$RetryTimerTask.run(FailbackClusterInvoker.java:144) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.timer.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:648) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.timer.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:727) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.timer.HashedWheelTimer$Worker.run(HashedWheelTimer.java:449) ~[dubbo-3.0.1.jar:3.0.1]
   	at java.base/java.lang.Thread.run(Thread.java:832) ~[na:na]
   Caused by: java.util.concurrent.ExecutionException: org.apache.dubbo.remoting.RemotingException: Fail to decode request due to: java.lang.NullPointerException
   java.lang.NullPointerException
   	at java.base/java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
   	at org.apache.dubbo.rpc.support.GroupServiceKeyCache.getServiceKey(GroupServiceKeyCache.java:37)
   	at org.apache.dubbo.rpc.support.ProtocolUtils.serviceKey(ProtocolUtils.java:51)
   	at org.apache.dubbo.rpc.protocol.AbstractProtocol.serviceKey(AbstractProtocol.java:62)
   	at org.apache.dubbo.rpc.protocol.dubbo.DubboProtocol.getInvoker(DubboProtocol.java:256)
   	at org.apache.dubbo.rpc.protocol.dubbo.CallbackServiceCodec.decodeInvocationArgument(CallbackServiceCodec.java:292)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:177)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:83)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
   	at org.apache.dubbo.common.threadlocal.InternalRunnable.run(InternalRunnable.java:41)
   	at java.base/java.lang.Thread.run(Thread.java:832)
   
   	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395) ~[na:na]
   	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2086) ~[na:na]
   	at org.apache.dubbo.rpc.AsyncRpcResult.get(AsyncRpcResult.java:181) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.protocol.AbstractInvoker.waitForResultIfSync(AbstractInvoker.java:272) ~[dubbo-3.0.1.jar:3.0.1]
   	... 8 common frames omitted
   Caused by: org.apache.dubbo.remoting.RemotingException: Fail to decode request due to: java.lang.NullPointerException
   java.lang.NullPointerException
   	at java.base/java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
   	at org.apache.dubbo.rpc.support.GroupServiceKeyCache.getServiceKey(GroupServiceKeyCache.java:37)
   	at org.apache.dubbo.rpc.support.ProtocolUtils.serviceKey(ProtocolUtils.java:51)
   	at org.apache.dubbo.rpc.protocol.AbstractProtocol.serviceKey(AbstractProtocol.java:62)
   	at org.apache.dubbo.rpc.protocol.dubbo.DubboProtocol.getInvoker(DubboProtocol.java:256)
   	at org.apache.dubbo.rpc.protocol.dubbo.CallbackServiceCodec.decodeInvocationArgument(CallbackServiceCodec.java:292)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:177)
   	at org.apache.dubbo.rpc.protocol.dubbo.DecodeableRpcInvocation.decode(DecodeableRpcInvocation.java:83)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.decode(DecodeHandler.java:57)
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:44)
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
   	at org.apache.dubbo.common.threadlocal.InternalRunnable.run(InternalRunnable.java:41)
   	at java.base/java.lang.Thread.run(Thread.java:832)
   
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture.doReceived(DefaultFuture.java:212) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture.received(DefaultFuture.java:175) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.DefaultFuture.received(DefaultFuture.java:163) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.header.HeaderExchangeHandler.handleResponse(HeaderExchangeHandler.java:60) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.exchange.support.header.HeaderExchangeHandler.received(HeaderExchangeHandler.java:181) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.transport.DecodeHandler.received(DecodeHandler.java:51) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.remoting.transport.dispatcher.ChannelEventRunnable.run(ChannelEventRunnable.java:57) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.threadpool.ThreadlessExecutor$RunnableWrapper.run(ThreadlessExecutor.java:196) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.common.threadpool.ThreadlessExecutor.waitAndDrain(ThreadlessExecutor.java:99) ~[dubbo-3.0.1.jar:3.0.1]
   	at org.apache.dubbo.rpc.AsyncRpcResult.get(AsyncRpcResult.java:179) ~[dubbo-3.0.1.jar:3.0.1]
   	... 9 common frames omitted
   
   2021-08-05 21:39:38.304 ERROR 25224 --- [-timer-thread-1] o.a.d.r.c.s.FailbackClusterInvoker       :  [DUBBO] Failed retry times exceed threshold (3), We have to abandon, invocation->RpcInvocation [methodName=getHello, parameterTypes=[class java.lang.String], arguments=[中国人1], attachments={remote.application=my-fault-tolerant-consumer-failback, interface=com.ghy.www.api.IService1, path=null, version=0.0.0}], dubbo version: 3.0.1, current host: 192.168.56.1
   
   
   ----------------------------------------------------------------------
   
   不知道是不是bug,,总感觉不应该出现这样的问题。


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo] startjava commented on issue #8431: cluster = ClusterRules.FAIL_BACK出现java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常。

Posted by GitBox <gi...@apache.org>.
startjava commented on issue #8431:
URL: https://github.com/apache/dubbo/issues/8431#issuecomment-893980489


   今天测试,又不出java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常了,close了。


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo] startjava commented on issue #8431: cluster = ClusterRules.FAIL_BACK出现java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常。

Posted by GitBox <gi...@apache.org>.
startjava commented on issue #8431:
URL: https://github.com/apache/dubbo/issues/8431#issuecomment-893971712


   出错提示说从Map中取得结果是空指定异常,,这样的异常估计是dubbo内部源代码的逻辑bug造成的,
   奇怪的是在idea中在getServiceKey()方法设置断点却断不下来。!
   
   
   
   
   ------------------&nbsp;原始邮件&nbsp;------------------
   发件人:                                                                                                                        "一直以来"                                                                                    ***@***.***&gt;;
   发送时间:&nbsp;2021年8月6日(星期五) 中午11:09
   ***@***.******@***.***&gt;;
   ***@***.***&gt;;
   主题:&nbsp;回复:[apache/dubbo] cluster = ClusterRules.FAIL_BACK出现java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常。 (#8431)
   
   
   
   故意测试超时啊 &nbsp;网络上很容易超时 &nbsp;但是出现的错误却不应该这样 &nbsp; 我感觉是bug &nbsp;
   
   
   
   发自我的iPhone
   
   
   ------------------ 原始邮件 ------------------
   发件人: 灼华 ***@***.***&gt;
   发送时间: 2021年8月6日 10:55
   收件人: apache/dubbo ***@***.***&gt;
   抄送: startjava ***@***.***&gt;, Author ***@***.***&gt;
   主题: 回复:[apache/dubbo] cluster = ClusterRules.FAIL_BACK出现java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常。 (#8431)
   
   
   
   
   
    
   你这是调用超时了吧,默认超时时间1s,你服务端睡了10s
    
   —
   You are receiving this because you authored the thread.
   Reply to this email directly, view it on GitHub, or unsubscribe.
   Triage notifications on the go with GitHub Mobile for iOS or Android.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo] BurningCN commented on issue #8431: cluster = ClusterRules.FAIL_BACK出现java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常。

Posted by GitBox <gi...@apache.org>.
BurningCN commented on issue #8431:
URL: https://github.com/apache/dubbo/issues/8431#issuecomment-893964021


   你这是调用超时了吧,默认超时时间1s,你服务端睡了10s


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo] startjava commented on issue #8431: cluster = ClusterRules.FAIL_BACK出现java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常。

Posted by GitBox <gi...@apache.org>.
startjava commented on issue #8431:
URL: https://github.com/apache/dubbo/issues/8431#issuecomment-893975212






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo] startjava commented on issue #8431: cluster = ClusterRules.FAIL_BACK出现java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常。

Posted by GitBox <gi...@apache.org>.
startjava commented on issue #8431:
URL: https://github.com/apache/dubbo/issues/8431#issuecomment-893975385


   Dubbo 3.0.1 version 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo] startjava commented on issue #8431: cluster = ClusterRules.FAIL_BACK出现java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常。

Posted by GitBox <gi...@apache.org>.
startjava commented on issue #8431:
URL: https://github.com/apache/dubbo/issues/8431#issuecomment-893968622


   故意测试超时啊 &nbsp;网络上很容易超时 &nbsp;但是出现的错误却不应该这样 &nbsp; 我感觉是bug &nbsp;
   
   
   
   发自我的iPhone
   
   
   ------------------ 原始邮件 ------------------
   发件人: 灼华 ***@***.***&gt;
   发送时间: 2021年8月6日 10:55
   收件人: apache/dubbo ***@***.***&gt;
   抄送: startjava ***@***.***&gt;, Author ***@***.***&gt;
   主题: 回复:[apache/dubbo] cluster = ClusterRules.FAIL_BACK出现java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常。 (#8431)
   
   
   
   
   
    
   你这是调用超时了吧,默认超时时间1s,你服务端睡了10s
    
   —
   You are receiving this because you authored the thread.
   Reply to this email directly, view it on GitHub, or unsubscribe.
   Triage notifications on the go with GitHub Mobile for iOS or Android.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo] startjava closed issue #8431: cluster = ClusterRules.FAIL_BACK出现java.lang.NullPointerException .GroupServiceKeyCache.getServiceKey()异常。

Posted by GitBox <gi...@apache.org>.
startjava closed issue #8431:
URL: https://github.com/apache/dubbo/issues/8431


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org