You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rocketmq.apache.org by GitBox <gi...@apache.org> on 2022/10/14 15:09:08 UTC
[GitHub] [rocketmq-client-go] hxzqlh opened a new issue, #947: still consumption blocked after issue #944
hxzqlh opened a new issue, #947:
URL: https://github.com/apache/rocketmq-client-go/issues/947
I use the commit: [f3349bd](https://github.com/apache/rocketmq-client-go/commit/f3349bdbb4dbcf9a7481563cb0fc3dd3d3ce3985) which says it fixed the push consuner blocked issue [#944](https://github.com/apache/rocketmq-client-go/pull/944). But in my experience, it's also blocked while rocket mq actually has newest msg produced.
some logs like this:
time="2022-10-14T10:19:19Z" level=warning msg="the queue's messages span too long, so do flow control" ConsumeConcurrentlyMaxSpan=1000 PullRequest="[ConsumerGroup: spot_quote_kline, Topic: etp_quotation, MessageQueue: brokerName=rocketmq-internal-0, queueId=0, nextOffset=18219201]" flowControlTimes=1 maxOffset=18219200 maxSpan=1404 minOffset=18217796
time="2022-10-14T10:19:21Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=1]" consumerGroup=spot_quote_kline offset=18117134
time="2022-10-14T10:19:21Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=2]" consumerGroup=spot_quote_kline offset=18218244
time="2022-10-14T10:19:21Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=3]" consumerGroup=spot_quote_kline offset=18217609
time="2022-10-14T10:19:21Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=%RETRY%spot_quote_kline, brokerName=rocketmq-internal-0, queueId=0]" consumerGroup=spot_quote_kline offset=668
time="2022-10-14T10:19:21Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=0]" consumerGroup=spot_quote_kline offset=18217796
time="2022-10-14T10:19:26Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=0]" consumerGroup=spot_quote_kline offset=18217796
time="2022-10-14T10:19:26Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=1]" consumerGroup=spot_quote_kline offset=18117134
time="2022-10-14T10:19:26Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=2]" consumerGroup=spot_quote_kline offset=18218244
time="2022-10-14T10:19:26Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=3]" consumerGroup=spot_quote_kline offset=18217609
time="2022-10-14T10:19:26Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=%RETRY%spot_quote_kline, brokerName=rocketmq-internal-0, queueId=0]" consumerGroup=spot_quote_kline offset=668
time="2022-10-14T10:19:31Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=0]" consumerGroup=spot_quote_kline offset=18217796
time="2022-10-14T10:19:31Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=1]" consumerGroup=spot_quote_kline offset=18117134
time="2022-10-14T10:19:31Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=2]" consumerGroup=spot_quote_kline offset=18218244
time="2022-10-14T10:19:31Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=etp_quotation, brokerName=rocketmq-internal-0, queueId=3]" consumerGroup=spot_quote_kline offset=18217609
time="2022-10-14T10:19:31Z" level=info msg="update offset to broker success" MessageQueue="MessageQueue [topic=%RETRY%spot_quote_kline, brokerName=rocketmq-internal-0, queueId=0]" consumerGroup=spot_quote_kline offset=668
time="2022-10-14T10:19:31Z" level=warning msg="the queue's messages span too long, so do flow control" ConsumeConcurrentlyMaxSpan=1000 PullRequest="[ConsumerGroup: spot_quote_kline, Topic: etp_quotation, MessageQueue: brokerName=rocketmq-internal-0, queueId=3, nextOffset=18218971]" flowControlTimes=1 maxOffset=18218970 maxSpan=1361 minOffset=18217609
then, after some minutes, the client continue consumed out new msg.
For short, the client do the loop: consumed some msg ---> blocked for a period of time ----> continue consumed out msg ----> blocked for a period of time ---> continue consumed out msg...
PS: rocket mq always has new msg produced.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-client-go] xuehuizhang commented on issue #947: still consumption blocked after issue #944
Posted by GitBox <gi...@apache.org>.
xuehuizhang commented on issue #947:
URL: https://github.com/apache/rocketmq-client-go/issues/947#issuecomment-1371986037
This problem has not been solved？
I had the same problem in v.2.1.1
`INFO[1665] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=2]" consumerGroup=GID_Test offset=3
INFO[1665] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=3]" consumerGroup=GID_Test offset=2
INFO[1665] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=0]" consumerGroup=GID_Test offset=2
INFO[1670] update offset to broker success MessageQueue="MessageQueue [topic=%RETRY%GID_Test, brokerName=broker-a, queueId=0]" consumerGroup=GID_Test offset=0
INFO[1670] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=1]" consumerGroup=GID_Test offset=4
INFO[1670] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=2]" consumerGroup=GID_Test offset=3
INFO[1670] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=3]" consumerGroup=GID_Test offset=2
INFO[1670] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=0]" consumerGroup=GID_Test offset=2
INFO[1675] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=3]" consumerGroup=GID_Test offset=2
INFO[1675] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=0]" consumerGroup=GID_Test offset=2
INFO[1675] update offset to broker success MessageQueue="MessageQueue [topic=%RETRY%GID_Test, brokerName=broker-a, queueId=0]" consumerGroup=GID_Test offset=0
INFO[1675] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=1]" consumerGroup=GID_Test offset=4
INFO[1675] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=2]" consumerGroup=GID_Test offset=3
INFO[1680] update offset to broker success MessageQueue="MessageQueue [topic=%RETRY%GID_Test, brokerName=broker-a, queueId=0]" consumerGroup=GID_Test offset=0
INFO[1680] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=1]" consumerGroup=GID_Test offset=4
INFO[1680] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=2]" consumerGroup=GID_Test offset=3
INFO[1680] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=3]" consumerGroup=GID_Test offset=2
INFO[1680] update offset to broker success MessageQueue="MessageQueue [topic=test, brokerName=broker-a, queueId=0]" consumerGroup=GID_Test offset=2
`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-client-go] francisoliverlee commented on issue #947: still consumption blocked after issue #944
Posted by "francisoliverlee (via GitHub)" <gi...@apache.org>.
francisoliverlee commented on issue #947:
URL: https://github.com/apache/rocketmq-client-go/issues/947#issuecomment-1439392426
> the queue's messages span too long, so do flow control"
一般的， 有这种日志
> time="2022-10-14T15:30:30Z" level=warning msg="the queue's messages span too long, so do flow control" ConsumeConcurrentlyMaxSpan=1000 PullRequest="[ConsumerGroup: spot_quote_kline_test, Topic: rocket_mq_test, MessageQueue: brokerName=rocketmq-internal-0, queueId=0, nextOffset=2035]" flowControlTimes=0 maxOffset=2034 maxSpan=1030 minOffset=1004
表示消息消费消费太慢，本地缓存消息没有被及时消费，引起client的pull线程挂起，这个也可以成为 “背压机制”
代码如下：https://github.com/apache/rocketmq-client-go/blob/26142da1b88ef22ac018138c724f5d4f48059da3/consumer/push_consumer.go#L715-L729
建议记录下本地消费耗时，以此来确认下是客户端背压机制有问题， 还是消费慢。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-client-go] nelsonkti commented on issue #947: still consumption blocked after issue #944
Posted by "nelsonkti (via GitHub)" <gi...@apache.org>.
nelsonkti commented on issue #947:
URL: https://github.com/apache/rocketmq-client-go/issues/947#issuecomment-1490209269
@francisoliverlee 没有报错确实没有必要打印出来，或者你设计一个关闭的参数吧，不断打印确实不太好
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-client-go] cserwen commented on issue #947: still consumption blocked after issue #944
Posted by "cserwen (via GitHub)" <gi...@apache.org>.
cserwen commented on issue #947:
URL: https://github.com/apache/rocketmq-client-go/issues/947#issuecomment-1526889364
> @francisoliverlee 没有报错确实没有必要打印出来，或者你设计一个关闭的参数吧，不断打印确实不太好
@nelsonkti 这个是客户端的消费被压机制，需要日志来提醒使用者消费太慢，不打日志的话，用户如何去知道自己消费堆积的原因呢？ 简单的关闭可能不是一个好选择，当然如果有更好的办法的话，可以直接通过 issue 描述解决 :-D
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-client-go] 0daypwn commented on issue #947: still consumption blocked after issue #944
Posted by GitBox <gi...@apache.org>.
0daypwn commented on issue #947:
URL: https://github.com/apache/rocketmq-client-go/issues/947#issuecomment-1280160363
see #927 #928, you can try it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org