You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2021/08/10 05:00:42 UTC
[GitHub] [druid] didip opened a new issue #11567: Druid tasks UI becomes very slow when there are hundreds of tasks running at the same time.
didip opened a new issue #11567:
URL: https://github.com/apache/druid/issues/11567
### Affected Version
0.21.1
### Description
when there are hundreds of subtasks running, Druid tasks UI became slow and sometimes threw gateway timeout error.
I have 10 routers running each has 10GB of RAM. In comparison, normal Druid queries are running decently fast.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] didip commented on issue #11567: Druid tasks UI becomes very slow when there are hundreds of tasks running at the same time.
Posted by GitBox <gi...@apache.org>.
didip commented on issue #11567:
URL: https://github.com/apache/druid/issues/11567#issuecomment-896212732
Increasing Overlord heap to 64GB helped a little bit. But sometimes, I still get 504 error.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] didip commented on issue #11567: Druid tasks UI becomes very slow when there are hundreds of tasks running at the same time.
Posted by GitBox <gi...@apache.org>.
didip commented on issue #11567:
URL: https://github.com/apache/druid/issues/11567#issuecomment-896212258
Unfortunately, I have set `druid.indexer.storage.recentlyFinishedThreshold` to 1 day and it's still unresponsive when there are > 700 sub tasks in 1 day.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] FrankChen021 commented on issue #11567: Druid tasks UI becomes very slow when there are hundreds of tasks running at the same time.
Posted by GitBox <gi...@apache.org>.
FrankChen021 commented on issue #11567:
URL: https://github.com/apache/druid/issues/11567#issuecomment-895985790
I think it's same as #11042 and #11140. As a workaround, you can set a smaller value on `druid.indexer.storage.recentlyFinishedThreshold`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org