You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by "amaechler (via GitHub)" <gi...@apache.org> on 2026/06/15 16:42:33 UTC

[PR] Raise `start-druid` middleManager memory to 256m (druid)

amaechler opened a new pull request, #19582:
URL: https://github.com/apache/druid/pull/19582

   This PR addresses a flaky test in the web console's end-to-end test `multi-stage-query.spec.ts`.
   
   _Analysis and implementation done with the help of Claude Code._
   
   ### Description
   
   The `bin/start-druid` script allocates memory to services based on assigned weights. The `middleManager`, having the lowest weight, receives a small heap size of about 68 MB when using `-m 16g`. This is inadequate for its role in proxying task reports and logs, which can lead to `OutOfMemoryError` and result in flaky test failures.
   
   #### Change
   
   Increase the `middleManager` allocation in `MINIMUM_MEMORY_MB` from 64 MB to 256 MB.
   
   - 256 MB is consistent with the sizes already in the `medium`, `large`, and `xlarge` single-server example configs,.
   - This change impacts only smaller deployments (below ~60 GB total memory), while larger deployments are unaffected.
   - Consequently, the minimum memory required for `start-druid` increases from ~4.25 GB to ~4.5 GB.
   
   Validation with `bin/start-druid -m 16g --compute` shows the `middleManager` heap increases to 256 MB, while other services remain stable.
   
   #### Release Note
   
   The `bin/start-druid` now allocates at least 256 MB to the `middleManager`, preventing `OutOfMemoryError`s during task report/log proxying. The overall minimum memory requirement for `start-druid` increases by approximately 240 MB.
   
   <hr>
   
   This PR has:
   
   - [x] been self-reviewed.
   - [x] added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
   - [x] a release note entry in the PR description.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


Re: [PR] fix: Raise `start-druid` middleManager memory to 256m (druid)

Posted by "abhishekrb19 (via GitHub)" <gi...@apache.org>.
abhishekrb19 merged PR #19582:
URL: https://github.com/apache/druid/pull/19582


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org