You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rocketmq.apache.org by GitBox <gi...@apache.org> on 2021/11/20 06:17:17 UTC

[GitHub] [rocketmq-exporter] NeilyoSH opened a new issue #77: rocketmq-exporter cause huge error log output with large topic situation

NeilyoSH opened a new issue #77:
URL: https://github.com/apache/rocketmq-exporter/issues/77


   **Describe the bug**
   In our QA & Online Cluster, we get problems with RocketMQ have thousands of topics and consumer groups.
   so rocketm-exporter will cause Namesrv service output huge number error logs till disk is full.
   
   ERROR log sample
   "
   [2021-11-18 18:28:36.433] ERROR SNDBCK_PUT_NUMS-error, topic=taskKey_saveRemovedTopic_cdp_tag_mysql_2_saas_user_match_tag_att_103, group=ucCdpTagTasCdpJobSaveRemoveMqCustomGroupV23, master broker=10.11.35.156:10911, The stats <SNDBCK_PUT_NUMS> <ta...@ucCdpTagTasCdpJobSaveRemoveMqCustomGroupV23> not exist
   [2021-11-18 18:28:36.433] ERROR GROUP_GET_NUMS-error, topic=taskKey_saveRemovedTopic_cdp_tag_mysql_2_saas_user_match_tag_att_103, group=cdpTagTasCdpJobSaveAddedMqCustomGroup3,master broker=10.11.35.156:10911, The stats <GROUP_GET_NUMS> <ta...@cdpTagTasCdpJobSaveAddedMqCustomGroup3> not exist
   [2021-11-18 18:28:36.434] ERROR GROUP_GET_SIZE-error, topic=taskKey_saveRemovedTopic_cdp_tag_mysql_2_saas_user_match_tag_att_103, group=cdpTagTasCdpJobSaveAddedMqCustomGroup3, master broker=10.11.35.156:10911, The stats <GROUP_GET_SIZE> <ta...@cdpTagTasCdpJobSaveAddedMqCustomGroup3> not exist
   [2021-11-18 18:28:36.434] ERROR SNDBCK_PUT_NUMS-error, topic=taskKey_saveRemovedTopic_cdp_tag_mysql_2_saas_user_match_tag_att_103, group=cdpTagTasCdpJobSaveAddedMqCustomGroup3, master broker=10.11.35.156:10911, The stats <SNDBCK_PUT_NUMS> <ta...@cdpTagTasCdpJobSaveAddedMqCustomGroup3> not exist
   "
   
   when stop rocketmq-exporter, error log lo longer output
   
   RocketMQ: 4.5.2  、4.8.0
   rocketmq-exporter: 0.0.2
   OS: CentOS7
   JDK: 1.8.0
   
   Documents about this error log output:
   https://github.com/apache/rocketmq-exporter/blob/master/src/main/java/org/apache/rocketmq/exporter/task/MetricsCollectTask.java
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [rocketmq-exporter] maixiaohai commented on issue #77: rocketmq-exporter cause huge error log output with large topic situation

Posted by GitBox <gi...@apache.org>.
maixiaohai commented on issue #77:
URL: https://github.com/apache/rocketmq-exporter/issues/77#issuecomment-980838096


   @NeilyoSH Can you help to improve, I will assign it to you ~


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [rocketmq-exporter] hdchen closed issue #77: rocketmq-exporter cause huge error log output with large topic situation

Posted by GitBox <gi...@apache.org>.
hdchen closed issue #77:
URL: https://github.com/apache/rocketmq-exporter/issues/77


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org