You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Mikayla Konst (JIRA)" <ji...@apache.org> on 2018/12/10 22:38:00 UTC

[jira] [Created] (YARN-9106) Add option to graceful decommission to not wait for applications

Mikayla Konst created YARN-9106:
-----------------------------------

             Summary: Add option to graceful decommission to not wait for applications
                 Key: YARN-9106
                 URL: https://issues.apache.org/jira/browse/YARN-9106
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: resourcemanager
            Reporter: Mikayla Konst


Add property yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-applications.

If true (the default), the resource manager waits for all containers, as well as all applications associated with those containers, to finish before gracefully decommissioning a node.

If false, the resource manager only waits for containers, but not applications, to finish. For map-only jobs or other jobs in which mappers do not need to serve shuffle data, this allows nodes to be decommissioned as soon as their containers are finished as opposed to when the job is done.

Add property yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-app-masters.

If false, during graceful decommission, when the resource manager waits for all containers on a node to finish, it will not wait for app master containers to finish. Defaults to true. This property should only be set to false if app master failure is recoverable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org