[jira] [Created] (YARN-8071) Provide Spark-like API for setting Environment Variables to enable vars with commas

["Jim Brennan (JIRA)" <ji...@apache.org>]

Jim Brennan created YARN-8071:
---------------------------------

             Summary: Provide Spark-like API for setting Environment Variables to enable vars with commas
                 Key: YARN-8071
                 URL: https://issues.apache.org/jira/browse/YARN-8071
             Project: Hadoop YARN
          Issue Type: Bug
          Components: yarn
    Affects Versions: 3.0.0
            Reporter: Jim Brennan
            Assignee: Jim Brennan


YARN-6830 describes a problem where environment variables that contain commas cannot be specified via {{-Dmapreduce.map.env}}.

For example:

{{-Dmapreduce.map.env="MODE=bar,IMAGE_NAME=foo,MOUNTS=/tmp/foo,/tmp/bar"}}

will set {{MOUNTS}} to {{/tmp/foo}}

In that Jira, [~aw] suggested that we change the API to provide a way to specify environment variables individually, the same way that Spark does.
{quote}Rather than fight with a regex why not redefine the API instead?

 

-Dmapreduce.map.env.MODE=bar
 -Dmapreduce.map.env.IMAGE_NAME=foo
 -Dmapreduce.map.env.MOUNTS=/tmp/foo,/tmp/bar

...

e.g, mapreduce.map.env.[foo]=bar gets turned into foo=bar

This greatly simplifies the input validation needed and makes it clear what is actually being defined.
{quote}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org