You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by "tejaswini-imply (via GitHub)" <gi...@apache.org> on 2023/05/28 03:34:10 UTC

[GitHub] [druid] tejaswini-imply opened a new pull request, #14345: Update heap size of MiddleManager service in docker IT environment Area

tejaswini-imply opened a new pull request, #14345:
URL: https://github.com/apache/druid/pull/14345

   Cloud deep storage tests are flaky and failing with following error
   
   Overlord logs:
   ```
   2023-05-19T04:16:41,012 INFO [qtp999685353-107] org.apache.druid.indexing.overlord.RemoteTaskRunner - Shutdown [single_phase_sub_task_wikipedia_index_test_f73ffed5-459a-497a-bdf0-db045f9b43a5 %?????? ?? ??!?_nnbhooje_2023-05-19T04:16:12.774Z] because: [Shutdown request from user]
   2023-05-19T04:16:41,021 WARN [qtp999685353-107] org.apache.druid.indexing.overlord.TaskQueue - TaskRunner failed to cleanup task after completion: single_phase_sub_task_wikipedia_index_test_f73ffed5-459a-497a-bdf0-db045f9b43a5 %?????? ?? ??!?_nnbhooje_2023-05-19T04:16:12.774Z
   org.apache.druid.java.util.common.RE: Error in handling post to [druid-middlemanager:8291] for task [single_phase_sub_task_wikipedia_index_test_f73ffed5-459a-497a-bdf0-db045f9b43a5 %?????? ?? ??!?_nnbhooje_2023-05-19T04:16:12.774Z]
   2023-05-19T04:16:41,038 INFO [qtp999685353-107] org.apache.druid.indexing.overlord.TaskLockbox - Removing task[single_phase_sub_task_wikipedia_index_test_f73ffed5-459a-497a-bdf0-db045f9b43a5 %?????? ?? ??!?_nnbhooje_2023-05-19T04:16:12.774Z] from activeTasks
   2023-05-19T04:16:41,072 INFO [TaskQueue-Manager] org.apache.druid.indexing.overlord.RemoteTaskRunner - Shutdown [single_phase_sub_task_wikipedia_index_test_f73ffed5-459a-497a-bdf0-db045f9b43a5 %?????? ?? ??!?_nnbhooje_2023-05-19T04:16:12.774Z] because: [Task is not in knownTaskIds]
   ```
   
   middleManager logs:
   ```
   output to: /tmp/persistent/task/slot0/single_phase_sub_task_wikipedia_index_test_f73ffed5-459a-497a-bdf0-db045f9b43a5 %?????? ?? ??!?_nnbhooje_2023-05-19T04:16:12.774Z/log
   java.lang.OutOfMemoryError: Java heap space
   Dumping heap to /tmp/java_pid660.hprof ...
   Heap dump file created [85041468 bytes in 6.807 secs]
   Terminating due to java.lang.OutOfMemoryError: Java heap space
   ```
   
   Since 64M size is too small and observed no erratic object creation on the heap profile incrementing the size of the middleManager to 128M.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


[GitHub] [druid] abhishekagarwal87 merged pull request #14345: Update heap size of MiddleManager service in docker IT environment

Posted by "abhishekagarwal87 (via GitHub)" <gi...@apache.org>.
abhishekagarwal87 merged PR #14345:
URL: https://github.com/apache/druid/pull/14345


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org