You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-dev@hadoop.apache.org by "Weiwei Yang (JIRA)" <ji...@apache.org> on 2018/04/09 02:49:00 UTC

[jira] [Created] (YARN-8127) Resource leak when async scheduling is enabled

Weiwei Yang created YARN-8127:
---------------------------------

             Summary: Resource leak when async scheduling is enabled
                 Key: YARN-8127
                 URL: https://issues.apache.org/jira/browse/YARN-8127
             Project: Hadoop YARN
          Issue Type: Bug
            Reporter: Weiwei Yang


Brief steps to reproduce
 # Enable async scheduling, 5 threads
 # Submit a lot of jobs trying to exhaust cluster resource
 # After a while, observed NM allocated resource is more than resource requested by allocated containers

Looks like the commit phase is not sync handling reserved containers, causing some proposal incorrectly accepted, subsequently resource was deducted multiple times for a container.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org