You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rocketmq.apache.org by GitBox <gi...@apache.org> on 2020/11/26 07:53:11 UTC

[GitHub] [rocketmq] CodingOX opened a new issue #2456: 2m-2s-sync producer sendStatus always is SLAVE_NOT_AVAILABLE

CodingOX opened a new issue #2456:
URL: https://github.com/apache/rocketmq/issues/2456


   **BUG REPORT**
   
   I have 4 server。
   
   | name         | ip               |
   | ------------ | ---------------- |
   | broker\-a    | 192\.168\.0\.151 |
   | broker\-a\-s | 192\.168\.0\.152 |
   | broker\-b    | 192\.168\.0\.153 |
   | broker\-b\-s | 192\.168\.0\.154 |
   
   `broker-a` config
   
   ```properties
   namesrvAddr=192.168.0.151:9876;192.168.0.153:9876
   brokerClusterName=MX-Cluster
   brokerName=broker-a
   brokerId=0
   deleteWhen=04
   fileReservedTime=48
   brokerRole=SYNC_MASTER
   flushDiskType=ASYNC_FLUSH
   brokerIP1=192.168.0.151
   ```
   
   `broker-a-s` config
   
   ```properties
   namesrvAddr=192.168.0.151:9876;192.168.0.153:9876
   brokerClusterName=MX-Cluster
   brokerName=broker-a
   brokerId=1
   deleteWhen=04
   fileReservedTime=48
   brokerRole=SLAVE
   flushDiskType=ASYNC_FLUSH
   brokerIP1=192.168.0.152
   ```
   
   `broker-b` config
   
   ```properties
   namesrvAddr=192.168.0.151:9876;192.168.0.153:9876
   brokerClusterName=MX-Cluster
   brokerName=broker-b
   brokerId=0
   deleteWhen=04
   fileReservedTime=48
   brokerRole=SYNC_MASTER
   flushDiskType=ASYNC_FLUSH
   brokerIP1=192.168.0.153
   ```
   
   `broker-b-s` config
   
   ```properties
   namesrvAddr=192.168.0.151:9876;192.168.0.153:9876
   brokerClusterName=MX-Cluster
   brokerName=broker-b
   brokerId=1
   deleteWhen=04
   fileReservedTime=48
   brokerRole=SLAVE
   flushDiskType=ASYNC_FLUSH
   brokerIP1=192.168.0.154
   ```
   
   In `RockeMQ-Console` show message
   
   | Broker    | NO\.        | Address                | Version  | Produce Massage TPS | Consumer Massage TPS | Yesterday Produce Count | Yesterday Consume Count | Today Produce Count | Today Consume Count | Operation |
   | --------- | ----------- | ---------------------- | -------- | ------------------- | -------------------- | ----------------------- | ----------------------- | ------------------- | ------------------- | --------- |
   | broker\-b | 0\(master\) | 192\.168\.0\.153:10911 | V4\_7\_1 | 0\.00               | 0\.00                | 0                       | 0                       | 0                   | 0                   |           |
   | broker\-b | 1\(slave\)  | 192\.168\.0\.154:10911 | V4\_7\_1 | 0\.00               | 0\.00                | 0                       | 0                       | 0                   | 0                   |           |
   | broker\-a | 0\(master\) | 192\.168\.0\.151:10911 | V4\_7\_1 | 0\.00               | 0\.00                | 0                       | 0                       | 200                 | 4                   |           |
   | broker\-a | 1\(slave\)  | 192\.168\.0\.152:10911 | V4\_7\_1 | 0\.00               | 0\.00                | 0                       | 0                       | 0                   | 0                   |           |
   
   1. Please tell us about your environment:
   
   Broker server is `centos8`
   
   My computer is `Mac 10.15.7` , ip is `192.168.0.46`,jdk is `1.8.201`
   
   My producer code
   
   ```java
   public class SyncProducer {
   
       public static void main(String[] args) throws UnsupportedEncodingException, MQClientException, RemotingException, InterruptedException, MQBrokerException {
           //Instantiate with a producer group name.
           DefaultMQProducer producer = new DefaultMQProducer("producer-wdf-3");
           // Specify name server addresses.
           producer.setNamesrvAddr("192.168.0.151:9876;192.168.0.153:9876;");
           //Launch the instance.
           producer.start();
           for (int i = 0; i < 100; i++) {
               //Create a message instance, specifying topic, tag and message body.
               Message msg = new Message("LcfTopic3" /* Topic */,
                       "TagB" /* Tag */,
                       ("Hello RocketMQ " +
                               i).getBytes(RemotingHelper.DEFAULT_CHARSET) /* Message body */
               );
               //Call send message to deliver message to one of brokers.
               SendResult sendResult = producer.send(msg);
               System.out.printf("%s%n", sendResult);
           }
           //Shut down once the producer instance is not longer in use.
           producer.shutdown();
       }
   }
   ```
   
   And Console show result 
   
   ```
   SendResult [sendStatus=SLAVE_NOT_AVAILABLE, msgId=0A2581021C3D2C13DA1584242F8C0000, offsetMsgId=C0A8009700002A9F000000000005AC3A, messageQueue=MessageQueue [topic=LcfTopic3, brokerName=broker-a, queueId=1], queueOffset=75]
   SendResult [sendStatus=SLAVE_NOT_AVAILABLE, msgId=0A2581021C3D2C13DA1584242FB20001, offsetMsgId=C0A8009700002A9F000000000005ACFF, messageQueue=MessageQueue [topic=LcfTopic3, brokerName=broker-a, queueId=2], queueOffset=75]
   SendResult [sendStatus=SLAVE_NOT_AVAILABLE, msgId=0A2581021C3D2C13DA1584242FB40002, offsetMsgId=C0A8009700002A9F000000000005ADC4, messageQueue=MessageQueue [topic=LcfTopic3, brokerName=broker-a, queueId=3], queueOffset=75]
   SendResult [sendStatus=SLAVE_NOT_AVAILABLE, msgId=0A2581021C3D2C13DA1584242FB50003, offsetMsgId=C0A8009700002A9F000000000005AE89, messageQueue=MessageQueue [topic=LcfTopic3, brokerName=broker-a, queueId=0], queueOffset=75]
   SendResult [sendStatus=SLAVE_NOT_AVAILABLE, msgId=0A2581021C3D2C13DA1584242FB60004, offsetMsgId=C0A8009700002A9F000000000005AF4E, messageQueue=MessageQueue [topic=LcfTopic3, brokerName=broker-a, queueId=1], queueOffset=76]
   SendResult [sendStatus=SLAVE_NOT_AVAILABLE, msgId=0A2581021C3D2C13DA1584242FB80005, offsetMsgId=C0A8009700002A9F000000000005B013, messageQueue=MessageQueue [topic=LcfTopic3, brokerName=broker-a, queueId=2], queueOffset=76]
   SendResult [sendStatus=SLAVE_NOT_AVAILABLE, msgId=0A2581021C3D2C13DA1584242FBA0006, offsetMsgId=C0A8009700002A9F000000000005B0D8, messageQueue=MessageQueue [topic=LcfTopic3, brokerName=broker-a, queueId=3], queueOffset=76]
   SendResult [sendStatus=SLAVE_NOT_AVAILABLE, msgId=0A2581021C3D2C13DA1584242FBB0007, offsetMsgId=C0A8009700002A9F000000000005B19D, messageQueue=MessageQueue [topic=LcfTopic3, brokerName=broker-a, queueId=0], queueOffset=76]
   SendResult [sendStatus=SLAVE_NOT_AVAILABLE, msgId=0A2581021C3D2C13DA1584242FBC0008, offsetMsgId=C0A8009700002A9F000000000005B262, messageQueue=MessageQueue [topic=LcfTopic3, brokerName=broker-a, queueId=1], queueOffset=77]
   SendResult [sendStatus=SLAVE_NOT_AVAILABLE, msgId=0A2581021C3D2C13DA1584242FBE0009, offsetMsgId=C0A8009700002A9F000000000005B327, messageQueue=MessageQueue [topic=LcfTopic3, brokerName=broker-a, queueId=2], queueOffset=77]
   ```
   
   I can ping succeess between any two servers.
   
   All Firewall has closed.
   
   **There are other ways I can solve the problem**,Thanks...


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [rocketmq] CodingOX commented on issue #2456: 2m-2s-sync producer sendStatus always is SLAVE_NOT_AVAILABLE

Posted by GitBox <gi...@apache.org>.
CodingOX commented on issue #2456:
URL: https://github.com/apache/rocketmq/issues/2456#issuecomment-736449566


   > @CodingOX Could you provide more logs about the client(~/logs/rocketmqlogs/rocketmq_client.log)?
   
   Here is my client log
   ```log
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - name server address updated. NEW : [192.168.0.151:9876, 192.168.0.153:9876] , OLD: null
   2020-12-01 19:19:23,023 INFO RocketmqClient - user specified name server address: 192.168.0.151:9876;192.168.0.153:9876
   2020-12-01 19:19:23,023 INFO RocketmqClient - Created a new client Instance, InstanceIndex:0, ClientID:10.37.129.2@42503, ClientConfig:ClientConfig [namesrvAddr=192.168.0.151:9876;192.168.0.153:9876, clientIP=10.37.129.2, instanceName=42503, clientCallbackExecutorThreads=12, pollNameServerInterval=30000, heartbeatBrokerInterval=30000, persistConsumerOffsetInterval=5000, pullTimeDelayMillsWhenException=1000, unitMode=false, unitName=null, vipChannelEnabled=false, useTLS=false, language=JAVA, namespace=null], ClientVersion:V4_7_1, SerializerType:JSON
   2020-12-01 19:19:23,023 INFO RocketmqClient - Created new MQClientInstance for clientId:[10.37.129.2@42503]
   2020-12-01 19:19:23,023 INFO RocketmqCommon - Try to start service thread:PullMessageService started:false lastThread:null
   2020-12-01 19:19:23,023 INFO RocketmqClient - PullMessageService service started
   2020-12-01 19:19:23,023 INFO RocketmqCommon - Try to start service thread:RebalanceService started:false lastThread:null
   2020-12-01 19:19:23,023 INFO RocketmqClient - RebalanceService service started
   2020-12-01 19:19:23,023 INFO RocketmqClient - the producer [CLIENT_INNER_PRODUCER] start OK. sendMessageWithVIPChannel=false
   2020-12-01 19:19:23,023 INFO RocketmqClient - the client factory [10.37.129.2@42503] start OK
   2020-12-01 19:19:23,023 INFO RocketmqClient - the producer [producer-wdf-3] start OK. sendMessageWithVIPChannel=false
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - new name server is chosen. OLD: null , NEW: 192.168.0.151:9876. namesrvIndex = 610
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv4Stack: false
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv4Stack: false
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv4Stack: false
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv6Addresses: false
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv6Addresses: false
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv6Addresses: false
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtilInitializations - Loopback interface: lo0 (lo0, 0:0:0:0:0:0:0:1%lo0)
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtilInitializations - Loopback interface: lo0 (lo0, 0:0:0:0:0:0:0:1%lo0)
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtilInitializations - Loopback interface: lo0 (lo0, 0:0:0:0:0:0:0:1%lo0)
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtil - Failed to get SOMAXCONN from sysctl and file /proc/sys/net/core/somaxconn. Default: 128
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtil - Failed to get SOMAXCONN from sysctl and file /proc/sys/net/core/somaxconn. Default: 128
   2020-12-01 19:19:23,023 DEBUG io.netty.util.NetUtil - Failed to get SOMAXCONN from sysctl and file /proc/sys/net/core/somaxconn. Default: 128
   2020-12-01 19:19:23,023 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.allocator.type: pooled
   2020-12-01 19:19:23,023 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.allocator.type: pooled
   2020-12-01 19:19:23,023 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.allocator.type: pooled
   2020-12-01 19:19:23,023 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.threadLocalDirectBufferSize: 0
   2020-12-01 19:19:23,023 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.threadLocalDirectBufferSize: 0
   2020-12-01 19:19:23,023 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.threadLocalDirectBufferSize: 0
   2020-12-01 19:19:23,023 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.maxThreadLocalCharBufferSize: 16384
   2020-12-01 19:19:23,023 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.maxThreadLocalCharBufferSize: 16384
   2020-12-01 19:19:23,023 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.maxThreadLocalCharBufferSize: 16384
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - createChannel: begin to connect remote host[192.168.0.151:9876] asynchronously
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 192.168.0.151:9876
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - createChannel: connect remote host[192.168.0.151:9876] success, AbstractBootstrap$PendingRegistrationPromise@4d465b11(success)
   2020-12-01 19:19:23,023 DEBUG io.netty.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@75422cf9
   2020-12-01 19:19:23,023 DEBUG io.netty.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@75422cf9
   2020-12-01 19:19:23,023 DEBUG io.netty.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@75422cf9
   2020-12-01 19:19:23,023 INFO RocketmqClient - the topic[LcfTopic3] route info changed, old[null] ,new[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=broker-a, readQueueNums=4, writeQueueNums=4, perm=6, topicSynFlag=0], QueueData [brokerName=broker-b, readQueueNums=4, writeQueueNums=4, perm=6, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=broker-b, brokerAddrs={0=192.168.0.153:10911, 1=192.168.0.154:10911}], BrokerData [brokerName=broker-a, brokerAddrs={0=192.168.0.151:10911, 1=192.168.0.152:10911}]], filterServerTable={}]]
   2020-12-01 19:19:23,023 INFO RocketmqClient - updateTopicPublishInfo prev is not null, TopicPublishInfo [orderTopic=false, messageQueueList=[], sendWhichQueue=ThreadLocalIndex{threadLocalIndex=null}, haveTopicRouterInfo=false]
   2020-12-01 19:19:23,023 INFO RocketmqClient - topicRouteTable.put. Topic = LcfTopic3, TopicRouteData[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=broker-a, readQueueNums=4, writeQueueNums=4, perm=6, topicSynFlag=0], QueueData [brokerName=broker-b, readQueueNums=4, writeQueueNums=4, perm=6, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=broker-b, brokerAddrs={0=192.168.0.153:10911, 1=192.168.0.154:10911}], BrokerData [brokerName=broker-a, brokerAddrs={0=192.168.0.151:10911, 1=192.168.0.152:10911}]], filterServerTable={}]]
   2020-12-01 19:19:23,023 INFO RocketmqClient - the topic[TBW102] route info changed, old[null] ,new[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=broker-a, readQueueNums=8, writeQueueNums=8, perm=7, topicSynFlag=0], QueueData [brokerName=broker-b, readQueueNums=8, writeQueueNums=8, perm=7, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=broker-b, brokerAddrs={0=192.168.0.153:10911, 1=192.168.0.154:10911}], BrokerData [brokerName=broker-a, brokerAddrs={0=192.168.0.151:10911, 1=192.168.0.152:10911}]], filterServerTable={}]]
   2020-12-01 19:19:23,023 INFO RocketmqClient - updateTopicPublishInfo prev is not null, TopicPublishInfo [orderTopic=false, messageQueueList=[], sendWhichQueue=ThreadLocalIndex{threadLocalIndex=null}, haveTopicRouterInfo=false]
   2020-12-01 19:19:23,023 INFO RocketmqClient - updateTopicPublishInfo prev is not null, TopicPublishInfo [orderTopic=false, messageQueueList=[], sendWhichQueue=ThreadLocalIndex{threadLocalIndex=null}, haveTopicRouterInfo=false]
   2020-12-01 19:19:23,023 INFO RocketmqClient - topicRouteTable.put. Topic = TBW102, TopicRouteData[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=broker-a, readQueueNums=8, writeQueueNums=8, perm=7, topicSynFlag=0], QueueData [brokerName=broker-b, readQueueNums=8, writeQueueNums=8, perm=7, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=broker-b, brokerAddrs={0=192.168.0.153:10911, 1=192.168.0.154:10911}], BrokerData [brokerName=broker-a, brokerAddrs={0=192.168.0.151:10911, 1=192.168.0.152:10911}]], filterServerTable={}]]
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - createChannel: begin to connect remote host[192.168.0.151:10911] asynchronously
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 192.168.0.151:10911
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - createChannel: connect remote host[192.168.0.151:10911] success, AbstractBootstrap$PendingRegistrationPromise@1b11171f(success)
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - createChannel: begin to connect remote host[192.168.0.153:10911] asynchronously
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 192.168.0.153:10911
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - createChannel: connect remote host[192.168.0.153:10911] success, AbstractBootstrap$PendingRegistrationPromise@2d710f1a(success)
   2020-12-01 19:19:23,023 INFO RocketmqClient - unregister client[Producer: producer-wdf-3 Consumer: null] from broker[broker-b 0 192.168.0.153:10911] success
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - createChannel: begin to connect remote host[192.168.0.154:10911] asynchronously
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 192.168.0.154:10911
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - createChannel: connect remote host[192.168.0.154:10911] success, AbstractBootstrap$PendingRegistrationPromise@6bd61f98(success)
   2020-12-01 19:19:23,023 INFO RocketmqClient - unregister client[Producer: producer-wdf-3 Consumer: null] from broker[broker-b 1 192.168.0.154:10911] success
   2020-12-01 19:19:23,023 INFO RocketmqClient - unregister client[Producer: producer-wdf-3 Consumer: null] from broker[broker-a 0 192.168.0.151:10911] success
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - createChannel: begin to connect remote host[192.168.0.152:10911] asynchronously
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 192.168.0.152:10911
   2020-12-01 19:19:23,023 INFO RocketmqRemoting - createChannel: connect remote host[192.168.0.152:10911] success, AbstractBootstrap$PendingRegistrationPromise@48aca48b(success)
   2020-12-01 19:19:23,023 INFO RocketmqClient - unregister client[Producer: producer-wdf-3 Consumer: null] from broker[broker-a 1 192.168.0.152:10911] success
   2020-12-01 19:19:23,023 INFO RocketmqClient - unregister client[Producer: CLIENT_INNER_PRODUCER Consumer: null] from broker[broker-b 0 192.168.0.153:10911] success
   2020-12-01 19:19:24,024 INFO RocketmqClient - unregister client[Producer: CLIENT_INNER_PRODUCER Consumer: null] from broker[broker-b 1 192.168.0.154:10911] success
   2020-12-01 19:19:24,024 INFO RocketmqClient - unregister client[Producer: CLIENT_INNER_PRODUCER Consumer: null] from broker[broker-a 0 192.168.0.151:10911] success
   2020-12-01 19:19:24,024 INFO RocketmqClient - unregister client[Producer: CLIENT_INNER_PRODUCER Consumer: null] from broker[broker-a 1 192.168.0.152:10911] success
   2020-12-01 19:19:24,024 INFO RocketmqCommon - Try to shutdown service thread:PullMessageService started:true lastThread:Thread[PullMessageService,5,main]
   2020-12-01 19:19:24,024 INFO RocketmqClient - the producer [CLIENT_INNER_PRODUCER] shutdown OK
   2020-12-01 19:19:24,024 INFO RocketmqCommon - shutdown thread PullMessageService interrupt true
   2020-12-01 19:19:24,024 INFO RocketmqClient - PullMessageService service end
   2020-12-01 19:19:24,024 INFO RocketmqCommon - join thread PullMessageService elapsed time(ms) 0 90000
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - closeChannel: begin close the channel[192.168.0.153:10911] Found: true
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - closeChannel: the channel[192.168.0.153:10911] was removed from channel table
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CLOSE 192.168.0.153:10911
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - eventCloseChannel: the channel[null] has been removed from the channel table before
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - closeChannel: begin close the channel[192.168.0.151:10911] Found: true
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - closeChannel: the channel[192.168.0.151:10911] was removed from channel table
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - closeChannel: begin close the channel[192.168.0.151:9876] Found: true
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CLOSE 192.168.0.151:10911
   2020-12-01 19:19:24,024 INFO RocketmqCommon - Try to shutdown service thread:RebalanceService started:true lastThread:Thread[RebalanceService,5,main]
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - closeChannel: the channel[192.168.0.151:9876] was removed from channel table
   2020-12-01 19:19:24,024 INFO RocketmqCommon - shutdown thread RebalanceService interrupt false
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - closeChannel: begin close the channel[192.168.0.154:10911] Found: true
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - closeChannel: the channel[192.168.0.154:10911] was removed from channel table
   2020-12-01 19:19:24,024 INFO RocketmqClient - RebalanceService service end
   2020-12-01 19:19:24,024 INFO RocketmqCommon - join thread RebalanceService elapsed time(ms) 0 90000
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CLOSE 192.168.0.151:9876
   2020-12-01 19:19:24,024 INFO RocketmqClient - the client factory [10.37.129.2@42503] shutdown OK
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - closeChannel: begin close the channel[192.168.0.152:10911] Found: true
   2020-12-01 19:19:24,024 INFO RocketmqClient - the producer [producer-wdf-3] shutdown OK
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - closeChannel: the channel[192.168.0.152:10911] was removed from channel table
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - shutdown thread NettyEventExecutor interrupt false
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - join thread NettyEventExecutor elapsed time(ms) 0 90000
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - eventCloseChannel: the channel[null] has been removed from the channel table before
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CLOSE 192.168.0.154:10911
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - eventCloseChannel: the channel[null] has been removed from the channel table before
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - eventCloseChannel: the channel[null] has been removed from the channel table before
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CLOSE 192.168.0.152:10911
   2020-12-01 19:19:24,024 INFO RocketmqRemoting - eventCloseChannel: the channel[null] has been removed from the channel table before
   2020-12-01 19:19:33,033 INFO RocketmqClient - user specified name server address: 192.168.0.151:9876;192.168.0.153:9876
   2020-12-01 19:19:33,033 INFO RocketmqRemoting - name server address updated. NEW : [192.168.0.151:9876, 192.168.0.153:9876] , OLD: null
   2020-12-01 19:19:33,033 INFO RocketmqClient - Created a new client Instance, InstanceIndex:0, ClientID:10.37.129.2@42510, ClientConfig:ClientConfig [namesrvAddr=192.168.0.151:9876;192.168.0.153:9876, clientIP=10.37.129.2, instanceName=42510, clientCallbackExecutorThreads=12, pollNameServerInterval=30000, heartbeatBrokerInterval=30000, persistConsumerOffsetInterval=5000, pullTimeDelayMillsWhenException=1000, unitMode=false, unitName=null, vipChannelEnabled=false, useTLS=false, language=JAVA, namespace=null], ClientVersion:V4_7_1, SerializerType:JSON
   2020-12-01 19:19:33,033 INFO RocketmqClient - Created new MQClientInstance for clientId:[10.37.129.2@42510]
   2020-12-01 19:19:33,033 INFO RocketmqCommon - Try to start service thread:PullMessageService started:false lastThread:null
   2020-12-01 19:19:33,033 INFO RocketmqClient - PullMessageService service started
   2020-12-01 19:19:33,033 INFO RocketmqCommon - Try to start service thread:RebalanceService started:false lastThread:null
   2020-12-01 19:19:33,033 INFO RocketmqClient - RebalanceService service started
   2020-12-01 19:19:33,033 INFO RocketmqClient - the producer [CLIENT_INNER_PRODUCER] start OK. sendMessageWithVIPChannel=false
   2020-12-01 19:19:33,033 INFO RocketmqClient - the client factory [10.37.129.2@42510] start OK
   2020-12-01 19:19:33,033 INFO RocketmqClient - the producer [producer-wdf-3] start OK. sendMessageWithVIPChannel=false
   2020-12-01 19:19:33,033 INFO RocketmqRemoting - new name server is chosen. OLD: null , NEW: 192.168.0.151:9876. namesrvIndex = 438
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv4Stack: false
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv4Stack: false
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv4Stack: false
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv6Addresses: false
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv6Addresses: false
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtil - -Djava.net.preferIPv6Addresses: false
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtilInitializations - Loopback interface: lo0 (lo0, 0:0:0:0:0:0:0:1%lo0)
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtilInitializations - Loopback interface: lo0 (lo0, 0:0:0:0:0:0:0:1%lo0)
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtilInitializations - Loopback interface: lo0 (lo0, 0:0:0:0:0:0:0:1%lo0)
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtil - Failed to get SOMAXCONN from sysctl and file /proc/sys/net/core/somaxconn. Default: 128
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtil - Failed to get SOMAXCONN from sysctl and file /proc/sys/net/core/somaxconn. Default: 128
   2020-12-01 19:19:33,033 DEBUG io.netty.util.NetUtil - Failed to get SOMAXCONN from sysctl and file /proc/sys/net/core/somaxconn. Default: 128
   2020-12-01 19:19:33,033 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.allocator.type: pooled
   2020-12-01 19:19:33,033 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.allocator.type: pooled
   2020-12-01 19:19:33,033 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.allocator.type: pooled
   2020-12-01 19:19:33,033 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.threadLocalDirectBufferSize: 0
   2020-12-01 19:19:33,033 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.threadLocalDirectBufferSize: 0
   2020-12-01 19:19:33,033 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.threadLocalDirectBufferSize: 0
   2020-12-01 19:19:33,033 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.maxThreadLocalCharBufferSize: 16384
   2020-12-01 19:19:33,033 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.maxThreadLocalCharBufferSize: 16384
   2020-12-01 19:19:33,033 DEBUG io.netty.buffer.ByteBufUtil - -Dio.netty.maxThreadLocalCharBufferSize: 16384
   2020-12-01 19:19:33,033 INFO RocketmqRemoting - createChannel: begin to connect remote host[192.168.0.151:9876] asynchronously
   2020-12-01 19:19:33,033 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 192.168.0.151:9876
   2020-12-01 19:19:33,033 INFO RocketmqRemoting - createChannel: connect remote host[192.168.0.151:9876] success, AbstractBootstrap$PendingRegistrationPromise@4d465b11(success)
   2020-12-01 19:19:33,033 DEBUG io.netty.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@4546b4c1
   2020-12-01 19:19:33,033 DEBUG io.netty.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@4546b4c1
   2020-12-01 19:19:33,033 DEBUG io.netty.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@4546b4c1
   2020-12-01 19:19:33,033 INFO RocketmqClient - the topic[LcfTopic3] route info changed, old[null] ,new[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=broker-a, readQueueNums=4, writeQueueNums=4, perm=6, topicSynFlag=0], QueueData [brokerName=broker-b, readQueueNums=4, writeQueueNums=4, perm=6, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=broker-b, brokerAddrs={0=192.168.0.153:10911, 1=192.168.0.154:10911}], BrokerData [brokerName=broker-a, brokerAddrs={0=192.168.0.151:10911, 1=192.168.0.152:10911}]], filterServerTable={}]]
   2020-12-01 19:19:33,033 INFO RocketmqClient - updateTopicPublishInfo prev is not null, TopicPublishInfo [orderTopic=false, messageQueueList=[], sendWhichQueue=ThreadLocalIndex{threadLocalIndex=null}, haveTopicRouterInfo=false]
   2020-12-01 19:19:33,033 INFO RocketmqClient - topicRouteTable.put. Topic = LcfTopic3, TopicRouteData[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=broker-a, readQueueNums=4, writeQueueNums=4, perm=6, topicSynFlag=0], QueueData [brokerName=broker-b, readQueueNums=4, writeQueueNums=4, perm=6, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=broker-b, brokerAddrs={0=192.168.0.153:10911, 1=192.168.0.154:10911}], BrokerData [brokerName=broker-a, brokerAddrs={0=192.168.0.151:10911, 1=192.168.0.152:10911}]], filterServerTable={}]]
   2020-12-01 19:19:33,033 INFO RocketmqClient - the topic[TBW102] route info changed, old[null] ,new[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=broker-a, readQueueNums=8, writeQueueNums=8, perm=7, topicSynFlag=0], QueueData [brokerName=broker-b, readQueueNums=8, writeQueueNums=8, perm=7, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=broker-b, brokerAddrs={0=192.168.0.153:10911, 1=192.168.0.154:10911}], BrokerData [brokerName=broker-a, brokerAddrs={0=192.168.0.151:10911, 1=192.168.0.152:10911}]], filterServerTable={}]]
   2020-12-01 19:19:33,033 INFO RocketmqClient - updateTopicPublishInfo prev is not null, TopicPublishInfo [orderTopic=false, messageQueueList=[], sendWhichQueue=ThreadLocalIndex{threadLocalIndex=null}, haveTopicRouterInfo=false]
   2020-12-01 19:19:33,033 INFO RocketmqClient - updateTopicPublishInfo prev is not null, TopicPublishInfo [orderTopic=false, messageQueueList=[], sendWhichQueue=ThreadLocalIndex{threadLocalIndex=null}, haveTopicRouterInfo=false]
   2020-12-01 19:19:33,033 INFO RocketmqClient - topicRouteTable.put. Topic = TBW102, TopicRouteData[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=broker-a, readQueueNums=8, writeQueueNums=8, perm=7, topicSynFlag=0], QueueData [brokerName=broker-b, readQueueNums=8, writeQueueNums=8, perm=7, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=broker-b, brokerAddrs={0=192.168.0.153:10911, 1=192.168.0.154:10911}], BrokerData [brokerName=broker-a, brokerAddrs={0=192.168.0.151:10911, 1=192.168.0.152:10911}]], filterServerTable={}]]
   2020-12-01 19:19:33,033 INFO RocketmqRemoting - createChannel: begin to connect remote host[192.168.0.153:10911] asynchronously
   2020-12-01 19:19:33,033 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 192.168.0.153:10911
   2020-12-01 19:19:33,033 INFO RocketmqRemoting - createChannel: connect remote host[192.168.0.153:10911] success, AbstractBootstrap$PendingRegistrationPromise@1b11171f(success)
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - createChannel: begin to connect remote host[192.168.0.151:10911] asynchronously
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 192.168.0.151:10911
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - createChannel: connect remote host[192.168.0.151:10911] success, AbstractBootstrap$PendingRegistrationPromise@2d710f1a(success)
   2020-12-01 19:19:34,034 INFO RocketmqClient - unregister client[Producer: producer-wdf-3 Consumer: null] from broker[broker-b 0 192.168.0.153:10911] success
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - createChannel: begin to connect remote host[192.168.0.154:10911] asynchronously
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 192.168.0.154:10911
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - createChannel: connect remote host[192.168.0.154:10911] success, AbstractBootstrap$PendingRegistrationPromise@6bd61f98(success)
   2020-12-01 19:19:34,034 INFO RocketmqClient - unregister client[Producer: producer-wdf-3 Consumer: null] from broker[broker-b 1 192.168.0.154:10911] success
   2020-12-01 19:19:34,034 INFO RocketmqClient - unregister client[Producer: producer-wdf-3 Consumer: null] from broker[broker-a 0 192.168.0.151:10911] success
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - createChannel: begin to connect remote host[192.168.0.152:10911] asynchronously
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 192.168.0.152:10911
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - createChannel: connect remote host[192.168.0.152:10911] success, AbstractBootstrap$PendingRegistrationPromise@48aca48b(success)
   2020-12-01 19:19:34,034 INFO RocketmqClient - unregister client[Producer: producer-wdf-3 Consumer: null] from broker[broker-a 1 192.168.0.152:10911] success
   2020-12-01 19:19:34,034 INFO RocketmqClient - unregister client[Producer: CLIENT_INNER_PRODUCER Consumer: null] from broker[broker-b 0 192.168.0.153:10911] success
   2020-12-01 19:19:34,034 INFO RocketmqClient - unregister client[Producer: CLIENT_INNER_PRODUCER Consumer: null] from broker[broker-b 1 192.168.0.154:10911] success
   2020-12-01 19:19:34,034 INFO RocketmqClient - unregister client[Producer: CLIENT_INNER_PRODUCER Consumer: null] from broker[broker-a 0 192.168.0.151:10911] success
   2020-12-01 19:19:34,034 INFO RocketmqClient - unregister client[Producer: CLIENT_INNER_PRODUCER Consumer: null] from broker[broker-a 1 192.168.0.152:10911] success
   2020-12-01 19:19:34,034 INFO RocketmqCommon - Try to shutdown service thread:PullMessageService started:true lastThread:Thread[PullMessageService,5,main]
   2020-12-01 19:19:34,034 INFO RocketmqCommon - shutdown thread PullMessageService interrupt true
   2020-12-01 19:19:34,034 INFO RocketmqClient - the producer [CLIENT_INNER_PRODUCER] shutdown OK
   2020-12-01 19:19:34,034 INFO RocketmqClient - PullMessageService service end
   2020-12-01 19:19:34,034 INFO RocketmqCommon - join thread PullMessageService elapsed time(ms) 0 90000
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - closeChannel: begin close the channel[192.168.0.153:10911] Found: true
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - closeChannel: the channel[192.168.0.153:10911] was removed from channel table
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CLOSE 192.168.0.153:10911
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - eventCloseChannel: the channel[null] has been removed from the channel table before
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - closeChannel: begin close the channel[192.168.0.151:10911] Found: true
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - closeChannel: the channel[192.168.0.151:10911] was removed from channel table
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - closeChannel: begin close the channel[192.168.0.151:9876] Found: true
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CLOSE 192.168.0.151:10911
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - closeChannel: the channel[192.168.0.151:9876] was removed from channel table
   2020-12-01 19:19:34,034 INFO RocketmqCommon - Try to shutdown service thread:RebalanceService started:true lastThread:Thread[RebalanceService,5,main]
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - closeChannel: begin close the channel[192.168.0.154:10911] Found: true
   2020-12-01 19:19:34,034 INFO RocketmqClient - RebalanceService service end
   2020-12-01 19:19:34,034 INFO RocketmqCommon - shutdown thread RebalanceService interrupt false
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CLOSE 192.168.0.151:9876
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - closeChannel: the channel[192.168.0.154:10911] was removed from channel table
   2020-12-01 19:19:34,034 INFO RocketmqClient - the client factory [10.37.129.2@42510] shutdown OK
   2020-12-01 19:19:34,034 INFO RocketmqCommon - join thread RebalanceService elapsed time(ms) 0 90000
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - eventCloseChannel: the channel[null] has been removed from the channel table before
   2020-12-01 19:19:34,034 INFO RocketmqClient - the producer [producer-wdf-3] shutdown OK
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CLOSE 192.168.0.154:10911
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - eventCloseChannel: the channel[null] has been removed from the channel table before
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - closeChannel: begin close the channel[192.168.0.152:10911] Found: true
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - closeChannel: the channel[192.168.0.152:10911] was removed from channel table
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CLOSE 192.168.0.152:10911
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - eventCloseChannel: the channel[null] has been removed from the channel table before
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - eventCloseChannel: the channel[null] has been removed from the channel table before
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - shutdown thread NettyEventExecutor interrupt false
   2020-12-01 19:19:34,034 INFO RocketmqRemoting - join thread NettyEventExecutor elapsed time(ms) 0 90000
   ```
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [rocketmq] RongtongJin closed issue #2456: 2m-2s-sync producer sendStatus always is SLAVE_NOT_AVAILABLE

Posted by GitBox <gi...@apache.org>.
RongtongJin closed issue #2456:
URL: https://github.com/apache/rocketmq/issues/2456


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [rocketmq] CodingOX commented on issue #2456: 2m-2s-sync producer sendStatus always is SLAVE_NOT_AVAILABLE

Posted by GitBox <gi...@apache.org>.
CodingOX commented on issue #2456:
URL: https://github.com/apache/rocketmq/issues/2456#issuecomment-739635730


   > Is the commit log gap between the master and slave too large (256MB)? In this case, it will return SLAVE_ NOT_ AVAILABLE directly.
   
   I only use sample code to learn and test rocketmq ,so i think the log is so small.
   
   I find 3+ issues  about this closed but not solved... 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [rocketmq] duhenglucky commented on issue #2456: 2m-2s-sync producer sendStatus always is SLAVE_NOT_AVAILABLE

Posted by GitBox <gi...@apache.org>.
duhenglucky commented on issue #2456:
URL: https://github.com/apache/rocketmq/issues/2456#issuecomment-735887204


   @CodingOX Could you provide more logs about the client(~/logs/rocketmqlogs/rocketmq_client.log)?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [rocketmq] RongtongJin commented on issue #2456: 2m-2s-sync producer sendStatus always is SLAVE_NOT_AVAILABLE

Posted by GitBox <gi...@apache.org>.
RongtongJin commented on issue #2456:
URL: https://github.com/apache/rocketmq/issues/2456#issuecomment-739781486


   @CodingOX I tried with the latest code in my environment, but the issue did not reproduce.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [rocketmq] RongtongJin commented on issue #2456: 2m-2s-sync producer sendStatus always is SLAVE_NOT_AVAILABLE

Posted by GitBox <gi...@apache.org>.
RongtongJin commented on issue #2456:
URL: https://github.com/apache/rocketmq/issues/2456#issuecomment-738663932


   Is the commit log gap between the master and slave too large (256MB)? In this case, it will return SLAVE_ NOT_ AVAILABLE directly.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [rocketmq] CodingOX commented on issue #2456: 2m-2s-sync producer sendStatus always is SLAVE_NOT_AVAILABLE

Posted by GitBox <gi...@apache.org>.
CodingOX commented on issue #2456:
URL: https://github.com/apache/rocketmq/issues/2456#issuecomment-741498257


   > @CodingOX I tried with the latest code in my environment, but the issue did not reproduce.
   
   I know most people will be fine, but I want to know why I have this problem here, and how I can troubleshoot the source of the problem.
   I don't think it would be wise for you to close the issue just because you cannot reproduce this issue.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org