You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Sudarshan Vasudevan (Jira)" <ji...@apache.org> on 2021/08/23 16:52:00 UTC

[jira] [Created] (GOBBLIN-1524) Limit the number of container launch threads used by YarnService

Sudarshan Vasudevan created GOBBLIN-1524:
--------------------------------------------

             Summary: Limit the number of container launch threads used by YarnService
                 Key: GOBBLIN-1524
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1524
             Project: Apache Gobblin
          Issue Type: Improvement
          Components: gobblin-yarn
    Affects Versions: 0.15.0
            Reporter: Sudarshan Vasudevan
            Assignee: Sudarshan Vasudevan
             Fix For: 0.16.0


Currently, there are no limits on the number of threads used, which can result in OOMEs with "unable to create a new native thread". This PR makes the number of threads configurable with a default of 1024.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)