You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Jim Brennan (JIRA)" <ji...@apache.org> on 2018/06/19 20:45:00 UTC
[jira] [Commented] (YARN-8417) Should skip passing HDFS_HOME,
HADOOP_CONF_DIR, JAVA_HOME, etc. to Docker container.
[ https://issues.apache.org/jira/browse/YARN-8417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16517531#comment-16517531 ]
Jim Brennan commented on YARN-8417:
-----------------------------------
Just to clarify - this is only for the ENTRY_POINT case, right? For the non-ENTRY_POINT case, we are using a launch_container.sh script to specify environment variables, and for those in the NM whitelist, we specify them using the syntax that allows the value in the docker file to override it. e.g.:
{noformat}
JAVA_HOME=${JAVA_HOME:-/nm/java/home}
{noformat}
{quote}
For Docker container, it actually doesn't make sense to pass JAVA_HOME, HDFS_HOME, etc. because inside docker image we have a separate Java/Hadoop installed or mounted to exactly same directory of host machine.
{quote}
In the non-ENTRY_POINT case, we need to support the ability for NM to set these if they are in the whitelist and they are not defined in the docker container, which is why we use the above syntax.
> Should skip passing HDFS_HOME, HADOOP_CONF_DIR, JAVA_HOME, etc. to Docker container.
> ------------------------------------------------------------------------------------
>
> Key: YARN-8417
> URL: https://issues.apache.org/jira/browse/YARN-8417
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Wangda Tan
> Priority: Critical
>
> Currently, YARN NM passes JAVA_HOME, HDFS_HOME, CLASSPATH environments before launching Docker container no matter if ENTRY_POINT is used or not. This will overwrite environments defined inside Dockerfile (by using \{{ENV}}). For Docker container, it actually doesn't make sense to pass JAVA_HOME, HDFS_HOME, etc. because inside docker image we have a separate Java/Hadoop installed or mounted to exactly same directory of host machine.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org