You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2022/03/04 08:07:11 UTC

[GitHub] [druid] happy5035 opened a new issue #12305: HttpRemoteTaskRunner leak memory

happy5035 opened a new issue #12305:
URL: https://github.com/apache/druid/issues/12305


   
   In my test environment, there was a total of 3500supervisor(index_kafka,task count:1, replicas:1),task is pending
   
   The runPendingTasksExec thread pool in HttpRemoteTaskRunner contains 50 million tasks.
   
   ![image](https://user-images.githubusercontent.com/13789954/156723605-8d138d61-92a8-4cf4-8d25-8cfcb587929d.png)
   ![image](https://user-images.githubusercontent.com/13789954/156723746-f843c753-cbde-4384-95d0-a632cd452e60.png)
   
   ![image](https://user-images.githubusercontent.com/13789954/156723954-87fb04dd-94fe-4820-b229-c3db0e7e940a.png)
   
   ### Affected Version
   
   0.21.1
   
   ### Description
   
   Please include as much detailed information about the problem as possible.
   - Cluster size
   master*2
   query*3
   historical*21
   middlemanager * 16
   indexers * 5
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


[GitHub] [druid] happy5035 commented on issue #12305: HttpRemoteTaskRunner leak memory

Posted by GitBox <gi...@apache.org>.
happy5035 commented on issue #12305:
URL: https://github.com/apache/druid/issues/12305#issuecomment-1065983479


   > 
   
   I'm testing how many datasources and supervisors a druid cluster can run at the same time. Supervisor tasks are KIS, so there are many streams.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


[GitHub] [druid] happy5035 removed a comment on issue #12305: HttpRemoteTaskRunner leak memory

Posted by GitBox <gi...@apache.org>.
happy5035 removed a comment on issue #12305:
URL: https://github.com/apache/druid/issues/12305#issuecomment-1065983496


   > I'm testing how many datasources and supervisors a druid cluster can run at the same time. Supervisor tasks are KIS, so there are many streams.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


[GitHub] [druid] sergioferragut commented on issue #12305: HttpRemoteTaskRunner leak memory

Posted by GitBox <gi...@apache.org>.
sergioferragut commented on issue #12305:
URL: https://github.com/apache/druid/issues/12305#issuecomment-1064669889


   Could you provide a bit more context. 
   How did the cluster arrive at this state?
   3500 seems like a lot, what are you expecting to see and why?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


[GitHub] [druid] happy5035 edited a comment on issue #12305: HttpRemoteTaskRunner leak memory

Posted by GitBox <gi...@apache.org>.
happy5035 edited a comment on issue #12305:
URL: https://github.com/apache/druid/issues/12305#issuecomment-1065983564


   > Could you provide a bit more context.
   How did the cluster arrive at this state?
   3500 seems like a lot, what are you expecting to see and why?
   
   I'm testing how many datasources and supervisors a druid cluster can run at the same time. Supervisor tasks are KIS, so there are many streams.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


[GitHub] [druid] happy5035 commented on issue #12305: HttpRemoteTaskRunner leak memory

Posted by GitBox <gi...@apache.org>.
happy5035 commented on issue #12305:
URL: https://github.com/apache/druid/issues/12305#issuecomment-1065983564


   > Could you provide a bit more context.
   How did the cluster arrive at this state?
   3500 seems like a lot, what are you expecting to see and why?
   I'm testing how many datasources and supervisors a druid cluster can run at the same time. Supervisor tasks are KIS, so there are many streams.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


[GitHub] [druid] happy5035 removed a comment on issue #12305: HttpRemoteTaskRunner leak memory

Posted by GitBox <gi...@apache.org>.
happy5035 removed a comment on issue #12305:
URL: https://github.com/apache/druid/issues/12305#issuecomment-1065983479


   > 
   
   I'm testing how many datasources and supervisors a druid cluster can run at the same time. Supervisor tasks are KIS, so there are many streams.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


[GitHub] [druid] happy5035 commented on issue #12305: HttpRemoteTaskRunner leak memory

Posted by GitBox <gi...@apache.org>.
happy5035 commented on issue #12305:
URL: https://github.com/apache/druid/issues/12305#issuecomment-1065983496


   > I'm testing how many datasources and supervisors a druid cluster can run at the same time. Supervisor tasks are KIS, so there are many streams.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org