You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-dev@hadoop.apache.org by "Xie YiFan (Jira)" <ji...@apache.org> on 2020/12/18 03:49:00 UTC

[jira] [Created] (YARN-10537) Change type of LogAggregationService threadPool

Xie YiFan created YARN-10537:
--------------------------------

             Summary: Change type of LogAggregationService threadPool
                 Key: YARN-10537
                 URL: https://issues.apache.org/jira/browse/YARN-10537
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Xie YiFan


Now, LogAggregationService threadPool is FixedThreadPool which of default threadPoolSize is 100. LogAggregationService will construct AppLogAggregator for new come application and submit to threadPool. AppLogAggregator do while loop unitl application finished. Some application may run very long time due to reason such as no enough resource or other. As result, it occupy one thread of threadPool. When this application size greater than threadPoolSize, the later short-live application can't upload logs until previous long-live application finished. So, i think we should replace FixedThreadPool to CachedThreadPool.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org