You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rocketmq.apache.org by GitBox <gi...@apache.org> on 2020/11/28 10:11:48 UTC
[GitHub] [rocketmq] dmbj opened a new issue #2460: 2m2s-async cluster consume message sometimes delay 10s or more
dmbj opened a new issue #2460:
URL: https://github.com/apache/rocketmq/issues/2460
rocketmq4.6 2m2s-async config，1 springboot rocket-client service
client service produce msg is ok，same service listen & consume msg. consume will work howerver sometimes consume delay 10s or more. no warning&error in client-service log, delay time was usually 10s，occasionally 28s，it seem a pattern.
broker-a-s.properties
```
brokerClusterName=testCluster
brokerName=broker-a
brokerId=1
deleteWhen=02
fileReservedTime=48
brokerRole=SLAVE
flushDiskType=ASYNC_FLUSH
listenPort=6001
autoCreateTopicEnable=true
traceTopicEnable=true
namesrvAddr=172.21.4.7:9876;172.21.4.10:9876
storePathRootDir=/www/rocketmq-store/broker-a
storePathCommitLog=/www/rocketmq-store/broker-a/commitlog
storePathConsumeQueue=/www/rocketmq-store/broker-a/consumequeue
storePathIndex=/www/rocketmq-store/broker-a/index
storeCheckpoint=/www/rocketmq-store/broker-a/checkpoint
abortFile=/www/rocketmq-store/broker-a/abort
```
client-service log:
```
2020-11-27 10:28:41 INFO [code-trades-bus,,,] c.c.controller.BusTradeController.tradesReceive(86) 发送交易topic数据：{"channelNo":"02","price":1,"terminalId":"1022000015","terminalSn":"1022000015_1574754592","tradeDate":1606444129834,"tradeAddress":"测试公交502;4500101","userId":"00000000000104957110","tradeType":"00","tradeSeq":"50dd1473a5f94b24b3760ed88574aa11","operator":"000000","customDomain":"e6aca2e8bf8ee69da5e588b062656a736f6e2e636f6d21","merchantNo":"45040001"}，结果：SendResult [sendStatus=SEND_OK, msgId=FE80000000000000F8163EFFFE65F5B90000439F5B3D8824EC140038, offsetMsgId=AC15040A00001B590000000000054858, messageQueue=MessageQueue [topic=tradeMsgTopic, brokerName=broker-a, queueId=0], queueOffset=2]
2020-11-27 10:28:43 DEBUG [code-trades-bus,,,] c.c.f.a.i.RemoteConfigLongPollService.doLongPollingRefresh(172) Long polling response: 304, url: http://172.21.4.8:23004/notifications/v2?cluster=default&appId=code-trades-bus&ip=172.21.4.8¬ifications=%5B%7B%22namespaceName%22%3A%22application%22%2C%22notificationId%22%3A80%7D%5D
2020-11-27 10:28:43 DEBUG [code-trades-bus,,,] c.c.f.a.i.RemoteConfigLongPollService.doLongPollingRefresh(163) Long polling from http://172.21.4.8:23004/notifications/v2?cluster=default&appId=code-trades-bus&ip=172.21.4.8¬ifications=%5B%7B%22namespaceName%22%3A%22application%22%2C%22notificationId%22%3A80%7D%5D
2020-11-27 10:28:51 INFO [code-trades-bus,,,] c.c.common.conf.BusTradesMQConfig.consumeMessage(93) 目标：{"channelNo":"02","customDomain":"e6aca2e8bf8ee69da5e588b062656a736f6e2e636f6d21","merchantNo":"45040001","operator":"000000","price":1,"receiveDate":1606444121108,"terminalId":"1022000015","terminalSn":"1022000015_1574754592","tradeAddress":"测试公交502;4500101","tradeDate":1606444129834,"tradeSeq":"50dd1473a5f94b24b3760ed88574aa11","tradeType":"00","userId":"00000000000104957110"}，启动消费，消息相关：szjt-fwpt-ybb-tst05.novalocal，tradeMsgTopic-transitBrtTradeTag...
```
then i use rocketmq-console find something might useful, trigger a history message resend seem MQ timeout 10s then retryconsume ok, but network is seem fine & i couldn't find any warn&error in broker log
please help! it bother me few days
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] dmbj commented on issue #2460: 2m2s-async cluster consume message sometimes delay 10s or more
Posted by GitBox <gi...@apache.org>.
dmbj commented on issue #2460:
URL: https://github.com/apache/rocketmq/issues/2460#issuecomment-737033812
@duhenglucky here my rocketmq-client.log 2 node service
i trigger msg 2 times
| produce_time | consume_time |
| ---- | ---- |
| 14:16:31 | 14:16:49 |
| 14:24:10 | 14:24:38 |
i found rocketmq-client.log has WARN log, it happens before i send msg
[rocketmq_client_code-trades-bus27_2020-12-02.0.log](https://github.com/apache/rocketmq/files/5627490/rocketmq_client_code-trades-bus27_2020-12-02.0.log)
[rocketmq_client_code-trades-bus38_2020-12-02.0.log](https://github.com/apache/rocketmq/files/5627491/rocketmq_client_code-trades-bus38_2020-12-02.0.log)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] duhenglucky commented on issue #2460: 2m2s-async cluster consume message sometimes delay 10s or more
Posted by GitBox <gi...@apache.org>.
duhenglucky commented on issue #2460:
URL: https://github.com/apache/rocketmq/issues/2460#issuecomment-735885191
@dmbj Could you try to use the [native client](https://github.com/apache/rocketmq/tree/master/example/src/main/java/org/apache/rocketmq/example/quickstart) to consume the same topic to see if the same problem still exists. In addition, you can see if the subscription information under the same consumer group is consistent. If the problem still cannot be solved, it is recommended to provide some key information such as rocketmq_client.log
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] dmbj commented on issue #2460: 2m2s-async cluster consume message sometimes delay 10s or more
Posted by GitBox <gi...@apache.org>.
dmbj commented on issue #2460:
URL: https://github.com/apache/rocketmq/issues/2460#issuecomment-739464438
any tips help? i stuck here, base springboot 2.1.12.RELEASE
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] linqh1 commented on issue #2460: 2m2s-async cluster consume message sometimes delay 10s or more
Posted by GitBox <gi...@apache.org>.
linqh1 commented on issue #2460:
URL: https://github.com/apache/rocketmq/issues/2460#issuecomment-803849201
这就没了？？？？？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] dmbj commented on issue #2460: 2m2s-async cluster consume message sometimes delay 10s or more
Posted by GitBox <gi...@apache.org>.
dmbj commented on issue #2460:
URL: https://github.com/apache/rocketmq/issues/2460#issuecomment-736998935
> @dmbj Could you try to use the [native client](https://github.com/apache/rocketmq/tree/master/example/src/main/java/org/apache/rocketmq/example/quickstart) to consume the same topic to see if the same problem still exists. In addition, you can see if the subscription information under the same consumer group is consistent. If the problem still cannot be solved, it is recommended to provide some key information such as rocketmq_client.log
thanks to follow my question, i use native client test same topic with same consumer group, it work fine. but switch to my service also delay, so i guess may be my service code problem
i compare different between my service to rocketmq-4.6.0-release, found use different netty-all.jar, so i config netty.jar hope it's helpful. but the problem still cannot be solved, later i will put some rocketmq_client.log
here my service pom & consume code, i couldn't find any different from quckstart example , i was confused
```
<dependency>
<groupId>org.apache.rocketmq</groupId>
<artifactId>rocketmq-client</artifactId>
<version>4.6.0</version>
</dependency>
<dependency>
<groupId>io.netty</groupId>
<artifactId>netty-all</artifactId>
<version>4.0.42.Final</version>
</dependency>
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] dmbj edited a comment on issue #2460: 2m2s-async cluster consume message sometimes delay 10s or more
Posted by GitBox <gi...@apache.org>.
dmbj edited a comment on issue #2460:
URL: https://github.com/apache/rocketmq/issues/2460#issuecomment-739464438
any tips help? i stuck here, base springboot 2.1.12.RELEASE
plus:
i change client service execute method, use rocketmq-spring starter. same problem. is rocketmq server config or network cause?
however produce&consume can work (but delay 10s or more).
```
<!-- rocketmq starter -->
<dependency>
<groupId>org.apache.rocketmq</groupId>
<artifactId>rocketmq-spring-boot-starter</artifactId>
<version>2.1.0</version>
</dependency>
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] dmbj closed issue #2460: 2m2s-async cluster consume message sometimes delay 10s or more
Posted by GitBox <gi...@apache.org>.
dmbj closed issue #2460:
URL: https://github.com/apache/rocketmq/issues/2460
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org