You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@rocketmq.apache.org by "RongtongJin (via GitHub)" <gi...@apache.org> on 2026/05/19 06:29:14 UTC
[I] Make RocksDB ConsumeQueue size amplification configurable [rocketmq]
RongtongJin opened a new issue, #10344:
URL: https://github.com/apache/rocketmq/issues/10344
### Before Creating the Enhancement Request
- [x] I have confirmed that this should be classified as an enhancement rather than a bug/feature.
### Summary
Make RocksDB ConsumeQueue universal compaction size amplification configurable. This gives operators a CQ only tuning option while keeping the current default behavior.
### Motivation
RocksDB ConsumeQueue currently uses a fixed universal compaction max size amplification percent of 25. In environments with high compaction pressure operators may need to allow more temporary space amplification in exchange for fewer compactions and lower CPU pressure. A broker side config makes this tunable without changing the default.
### Describe the Solution You'd Like
Add a MessageStoreConfig option rocksdbMaxSizeAmplificationPercent with default value 25. Use it only when building the RocksDB ConsumeQueue column family universal compaction options. Do not change POP Index Trans Timer or RocksDB DBOptions defaults.
### Describe Alternatives You've Considered
Keep the value hard coded which requires a code change for deployments that need a different compaction tradeoff. Broader RocksDB option parameterization was also considered but it is not needed for this scoped CQ improvement.
### Additional Context
Scope is intentionally limited to RocksDB ConsumeQueue. Related PR will follow after this issue is created.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Make RocksDB ConsumeQueue size amplification configurable [rocketmq]
Posted by "Aias00 (via GitHub)" <gi...@apache.org>.
Aias00 commented on issue #10344:
URL: https://github.com/apache/rocketmq/issues/10344#issuecomment-4931384141
This issue has been implemented in PR #10343 which was merged to develop branch on 2026-06-01. The implementation adds `rocksdbMaxSizeAmplificationPercent` configuration to MessageStoreConfig with default value 25, and applies it only to RocksDB ConsumeQueue column family universal compaction options as requested. POP Index, Trans, and Timer column families remain with the hardcoded value of 25 as specified in the issue requirements.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org