You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Junping Du (JIRA)" <ji...@apache.org> on 2016/03/11 15:06:59 UTC

[jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line

     [ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Junping Du updated YARN-313:
----------------------------
    Release Note: 
After this patch, the feature to support NM resource dynamically configuration is completed, so that user can configure NM with new resource without bring NM down or decommissioned.
Two CLIs are provided to support update resources on individual node or a batch of nodes:
1. Update resource on single node: yarn rmadmin -updateNodeResource [NodeID] [MemSize] [vCores] 
2. Update resource on a batch of nodes: yarn rmadmin -refreshNodesResources, that reflect nodes' resource configuration defined in dynamic-resources.xml which is loaded by RM dynamically (like capacity-scheduler.xml or fair-scheduler.xml). 
The first version of configuration format is:
<configuration>
  <property>
    <name>yarn.resource.dynamic.nodes</name>
    <value>h1:1234</value>
  </property>
  <property>
    <name>yarn.resource.dynamic.h1:1234.vcores</name>
    <value>16</value>
  </property>
  <property>
    <name>yarn.resource.dynamic.h1:1234.memory</name>
    <value>1024</value>
  </property>
</configuration> 

  was:
Since this patch, we are providing CLI to support NM resource dynamically configuration that user can configure NM with new resource without bring NM down or decommissioned.
Two CLIs are provided to support update resources on individual node or a batch of nodes:
1. Update resource on single node: yarn rmadmin -updateNodeResource [NodeID] [MemSize] [vCores] 
2. Update resource on a batch of nodes: yarn rmadmin -refreshNodesResources, that reflect nodes' resource configuration defined in dynamic-resources.xml, the format of configuration is get optimized in YARN-4160.


> Add Admin API for supporting node resource configuration in command line
> ------------------------------------------------------------------------
>
>                 Key: YARN-313
>                 URL: https://issues.apache.org/jira/browse/YARN-313
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: client, graceful
>            Reporter: Junping Du
>            Assignee: Inigo Goiri
>            Priority: Critical
>             Fix For: 2.8.0
>
>         Attachments: YARN-313-sample.patch, YARN-313-v1.patch, YARN-313-v10.patch, YARN-313-v11.patch, YARN-313-v2.patch, YARN-313-v3.patch, YARN-313-v4.patch, YARN-313-v5.patch, YARN-313-v6.patch, YARN-313-v7.patch, YARN-313-v8.patch, YARN-313-v9.patch
>
>
> We should provide some admin interface, e.g. "yarn rmadmin -refreshResources" to support changes of node's resource specified in a config file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)