You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rocketmq.apache.org by GitBox <gi...@apache.org> on 2021/05/06 10:13:05 UTC
[GitHub] [rocketmq] LuciferInLove opened a new issue #2859: Out of memory error when dledger is used
LuciferInLove opened a new issue #2859:
URL: https://github.com/apache/rocketmq/issues/2859
Hello. We had the rocketmq cluster installed with master-slave architecture, and then we moved it to the new dledger architecture. Brokers are running on small ec2 instances with such java options:
```
-Xms128m -Xmx128m -Xmn128m -XX:G1HeapRegionSize=1m -XX:MaxDirectMemorySize=256m
```
When we've used the master-slave architecture, everything worked correctly, but when we switched to the dledger architecture, we started getting Out of memory errors. We see many threads that allocate 4mb buffer. Is it the right behavior?
The log file with errors is attached.
[hs_err_pid_1.log](https://github.com/apache/rocketmq/files/6433664/hs_err_pid_1.log)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] panzhi33 commented on issue #2859: Out of memory error when dledger is used
Posted by GitBox <gi...@apache.org>.
panzhi33 commented on issue #2859:
URL: https://github.com/apache/rocketmq/issues/2859#issuecomment-834016646
I think it has nothing to do with the architecture mode, mainly due to insufficient memory。as you can see from the log you gave, the thread that caused the OutOfMemory exception is sendmessage, and there is no change in the memory before and after gc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] LuciferInLove commented on issue #2859: Out of memory error when dledger is used
Posted by GitBox <gi...@apache.org>.
LuciferInLove commented on issue #2859:
URL: https://github.com/apache/rocketmq/issues/2859#issuecomment-840463487
Sorry. After updating to 4.8.0, the problem is not reproducible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] LuciferInLove closed issue #2859: Out of memory error when dledger is used
Posted by GitBox <gi...@apache.org>.
LuciferInLove closed issue #2859:
URL: https://github.com/apache/rocketmq/issues/2859
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] panzhi33 edited a comment on issue #2859: Out of memory error when dledger is used
Posted by GitBox <gi...@apache.org>.
panzhi33 edited a comment on issue #2859:
URL: https://github.com/apache/rocketmq/issues/2859#issuecomment-834016646
I think it has nothing to do with the architecture mode, mainly due to insufficient memory。as you can see from the log you gave, the thread that caused the OutOfMemory exception is sendmessage, and there is no change in the memory before and after gc.you can dump memory to see。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq] LuciferInLove commented on issue #2859: Out of memory error when dledger is used
Posted by GitBox <gi...@apache.org>.
LuciferInLove commented on issue #2859:
URL: https://github.com/apache/rocketmq/issues/2859#issuecomment-840402161
In the dump, I also see sendmessage threads. I tried to increase memory on virtual machines drastically, and that didn't help - memory always runs out when dledger is enabled. When I don't use dledger, I don't have any OutOfMemory errors under the same load even with a small amount of memory.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org