You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rocketmq.apache.org by GitBox <gi...@apache.org> on 2021/08/23 09:40:14 UTC

[GitHub] [rocketmq-exporter] humkum opened a new issue #64: rocketmq-exporter causes OOM error

humkum opened a new issue #64:
URL: https://github.com/apache/rocketmq-exporter/issues/64


   **Describe the bug**
   We use rocketmq-exporter to capture the metrics of the rocketmq cluster. Because our cluster has a large number of users, OOM errors often occur, causing the exporter to be unavailable,which makes a huge impact on our company's business.The error log is as follows:
   ![image](https://user-images.githubusercontent.com/50660789/130422097-bf11d336-4ee0-472b-882f-b4ebda5efc20.png)
   **Additional context**
   	To access the specified interface I found that there are too many metrics.And there are so many expired metrics that we don’t need. With searching the key word “rocketmq_”, I get 225425 metrics,which is inaccurate. 
   ![image](https://user-images.githubusercontent.com/50660789/130422148-e85d970e-d9c6-4df4-89ed-06ae591ebbf8.png)
           Go further. By analyzing the heap dump file captured at the OOM time，I found that there are a large number of ConcurrentHashMap Instance，as follows:
   ![image](https://user-images.githubusercontent.com/50660789/130425890-6c59d4de-6234-472a-ab1b-38b97db715e4.png)
   	Moreover, I create a new consumer group"consumer_h", after a series send and consume test, I delete this consumer group. I found that there are still so many metrics for the deleted consumer, as follows:
   ![3510a629-df4e-4f16-a8f4-9b2bfb5c5308](https://user-images.githubusercontent.com/50660789/130422869-216f90b2-2bc5-42e6-b2b6-38f827ba1e79.png)
          And this is the same issue as described in issue #60 and issue #62 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq-exporter] maixiaohai closed issue #64: rocketmq-exporter causes OOM error

Posted by GitBox <gi...@apache.org>.
maixiaohai closed issue #64:
URL: https://github.com/apache/rocketmq-exporter/issues/64


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org