You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rocketmq.apache.org by GitBox <gi...@apache.org> on 2021/08/19 09:56:57 UTC
[GitHub] [rocketmq] ledefe opened a new issue #3277: OOM under the aarch64 architecture
ledefe opened a new issue #3277:
URL: https://github.com/apache/rocketmq/issues/3277
OOM is caused by too many consumerManageExecutor task
By looking at the source code, I learned that consumerManagerThreadPoolQueueCapacity has settings but is not used. As shown below.....
```java
this.consumerManagerThreadPoolQueue = new LinkedBlockingQueue<Runnable>(this.brokerConfig.getConsumerManagerThreadPoolQueueCapacity());
....
this.consumerManageExecutor =
Executors.newFixedThreadPool(this.brokerConfig.getConsumerManageThreadPoolNums(), new ThreadFactoryImpl(
"ConsumerManageThread_"));
````
I want to know why unbounded queues are used .Is there any special design?
By the way, this problem occurs under the aarch64 architecture. There is no such problem under AMD architecture.
JVM:
```java
-XX:+UseG1GC -XX:G1HeapRegionSize=16m -XX:G1ReservePercent=25 -XX:InitiatingHeapOccupancyPercent=30 -XX:SoftRefLRUPolicyMSPerMB=0 -XX:SurvivorRatio=8 -verbose:gc -Xloggc:/dev/shm/mq_gc_%p.log -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -XX:+PrintAdaptiveSizePolicy -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=5 -XX:GCLogFileSize=30m -XX:-OmitStackTraceInFastThrow -XX:+AlwaysPreTouch -XX:MaxDirectMemorySize=1073741824 -XX:-UseLargePages -XX:-UseBiasedLocking -Djava.ext.dirs=/opt/jre/jre/lib/ext:/opt/rocketmq/bin/../lib -Xms2g -Xmx2g -Xmn1g -Drocketmq.broker.rebalance.lockMaxLiveTime=7000 -cp .:/opt/rocketmq/bin/../conf: org.apache.rocketmq.broker.BrokerStartup -c /opt/rocketmq/conf/broker.conf
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] RongtongJin closed issue #3277: OOM under the aarch64 architecture
Posted by GitBox <gi...@apache.org>.
RongtongJin closed issue #3277:
URL: https://github.com/apache/rocketmq/issues/3277
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] ni-ze commented on issue #3277: OOM under the aarch64 architecture
Posted by GitBox <gi...@apache.org>.
ni-ze commented on issue #3277:
URL: https://github.com/apache/rocketmq/issues/3277#issuecomment-902398814
> UPDATE_CONSUMER_OFFSET request is very much.
are you sure it's UPDATE_CONSUMER_OFFSET request cause too much task in unbounded queues, and eventually lead to OOM?
UPDATE_CONSUMER_OFFSET is send by tool mqadmin， It is almost impossible send by client duration consume message. You can check the code in version 4.9.0 release
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] ledefe commented on issue #3277: OOM under the aarch64 architecture
Posted by GitBox <gi...@apache.org>.
ledefe commented on issue #3277:
URL: https://github.com/apache/rocketmq/issues/3277#issuecomment-902377367
UPDATE_CONSUMER_OFFSET request is very much.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] francisoliverlee edited a comment on issue #3277: OOM under the aarch64 architecture
Posted by GitBox <gi...@apache.org>.
francisoliverlee edited a comment on issue #3277:
URL: https://github.com/apache/rocketmq/issues/3277#issuecomment-902107126
oom log pls and make sure which request are so many
https://github.com/apache/rocketmq/blob/a20f31bb3de242756542c552d7212a7a40000ba4/broker/src/main/java/org/apache/rocketmq/broker/BrokerController.java#L601-L613
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] francisoliverlee commented on issue #3277: OOM under the aarch64 architecture
Posted by GitBox <gi...@apache.org>.
francisoliverlee commented on issue #3277:
URL: https://github.com/apache/rocketmq/issues/3277#issuecomment-902107126
oom log pls
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org