[jira] [Created] (YARN-10835) Pass user defined variables of yarn.nodemanager.env-whitelist along jobs

["Janus Chow (Jira)" <ji...@apache.org>]

Janus Chow created YARN-10835:
---------------------------------

             Summary: Pass user defined variables of yarn.nodemanager.env-whitelist along jobs
                 Key: YARN-10835
                 URL: https://issues.apache.org/jira/browse/YARN-10835
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Janus Chow


The configuration of "yarn.nodemanager.env-whitelist" has been helpful in running multi version Hadoop on Yarn. But the pain point is that users need to use different configurations to run jobs of different versions of Hadoop.

The first idea is to have SRE prepared different versions of configurations and let users specify different environment variables of "HADOOP_CONF_DIR", this shifts the burden from users to SRE that they have to maintain different versions of configurations with only one or two configurations changed.

This ticket proposes to export the value of the environment variable in "yarn.nodemanager.env-whitelist" via the environment variable or Java properties of the client submitting jobs. So that SRE only has to maintain one version of configuration and users can easily define Hadoop version with one export in an environment variable or Java property.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org