You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "groot (Jira)" <ji...@apache.org> on 2022/08/18 20:58:00 UTC

[jira] [Created] (YARN-11255) Support loading alternative docker client config from system environment

groot created YARN-11255:
----------------------------

             Summary: Support loading alternative docker client config from system environment
                 Key: YARN-11255
                 URL: https://issues.apache.org/jira/browse/YARN-11255
             Project: Hadoop YARN
          Issue Type: New Feature
            Reporter: groot
            Assignee: groot


When using YARN docker support, although the hadoop shell supported 
{code:java}
-docker_client_config{code}
 to pass the client config file that contains security token to generate the docker config for each job as a temporary file.

For other applications that submit jobs to YARN, e.g. Spark, which loads the docker setting via system environment e.g. 
{code:java}
spark.executorEnv.* {code}
will not be able to add those authorization token because this system environment isn't considered in YARN.

Add genetic solution to handle these kind of cases without making changes in spark code or others



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org