You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2018/01/02 16:55:00 UTC
[jira] [Comment Edited] (YARN-7677) HADOOP_CONF_DIR should not be
automatically put in task environment
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308357#comment-16308357 ]
Eric Yang edited comment on YARN-7677 at 1/2/18 4:54 PM:
---------------------------------------------------------
[~ebadger] Happy new year. I think it will be safer for {{HADOOP_CONF_DIR}} to be passed from host to docker image as default. This is better for preventing mistakes instead of allowing override system specific settings at container level. This will also ensure that when an application requires system settings, docker doesn't need to reconstruct the environment, but simply mount the {{HADOOP_CONF_DIR}} as source of truth. If docker container wants to generate its own environment, there shouldn't be anything getting in the way for docker application to accomplish that. I don't understand how is this paramount for docker case, could you elaborate? Thanks
was (Author: eyang):
[~ebadger] Happy new year. I think it will be safer for {HADOOP_CONF_DIR} to be passed from host to docker image as default. This is better for preventing mistakes instead of allowing override system specific settings at container level. This will also ensure that when an application requires system settings, docker doesn't need to reconstruct the environment, but simply mount the {HADOOP_CONF_DIR} as source of truth. If docker container wants to generate its own environment, there shouldn't be anything getting in the way for docker application to accomplish that. I don't understand how is this paramount for docker case, could you elaborate? Thanks
> HADOOP_CONF_DIR should not be automatically put in task environment
> -------------------------------------------------------------------
>
> Key: YARN-7677
> URL: https://issues.apache.org/jira/browse/YARN-7677
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Eric Badger
> Assignee: Eric Badger
>
> Currently, {{HADOOP_CONF_DIR}} is being put into the task environment whether it's set by the user or not. It completely bypasses the whitelist and so there is no way for a task to not have {{HADOOP_CONF_DIR}} set. This causes problems in the Docker use case where Docker containers will set up their own environment and have their own {{HADOOP_CONF_DIR}} preset in the image itself.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org