[jira] [Created] (YARN-6830) Support quoted strings for environment variables

["Shane Kumpf (JIRA)" <ji...@apache.org>]

Shane Kumpf created YARN-6830:
---------------------------------

             Summary: Support quoted strings for environment variables
                 Key: YARN-6830
                 URL: https://issues.apache.org/jira/browse/YARN-6830
             Project: Hadoop YARN
          Issue Type: Bug
            Reporter: Shane Kumpf


There are cases where it is necessary to allow for quoted string literals within environment variables values when passed via the yarn command line interface.

For example, consider the follow environment variables for a MR map task.

{{MODE=bar}}
{{IMAGE_NAME=foo}}
{{MOUNTS=/tmp/foo,/tmp/bar}}

When running the MR job, these environment variables are supplied as a comma delimited string.

{{-Dmapreduce.map.env="MODE=bar,IMAGE_NAME=foo,MOUNTS=/tmp/foo,/tmp/bar"}}

In this case, {{MOUNTS}} will be parsed and added to the task environment as {{MOUNTS=/tmp/foo}}. Any attempts to quote the embedded comma separated value results in quote characters becoming part of the value, and parsing still breaks down at the comma.

This issue is to allow for quoting the comma separated value (escaped double or single quote). This was mentioned on YARN-4595 and will impact YARN-5534 as well.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org