You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2019/10/10 10:23:00 UTC
[jira] [Updated] (HADOOP-16649) Defining hadoop-azure and
hadoop-azure-datalake in HADOOP_OPTIONAL_TOOLS will ignore hadoop-azure
[ https://issues.apache.org/jira/browse/HADOOP-16649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran updated HADOOP-16649:
------------------------------------
Description:
When defining both `hadoop-azure` and `hadoop-azure-datalake` in HADOOP_OPTIONAL_TOOLS in `conf/hadoop-env.sh`, `hadoop-azure` will get ignored.
eg setting this:
HADOOP_OPTIONAL_TOOLS="hadoop-azure-datalake,hadoop-azure"
with debug on:
DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure-datalake.sh
DEBUG: HADOOP_SHELL_PROFILES accepted hadoop-azure-datalake
DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure.sh
DEBUG: HADOOP_SHELL_PROFILES
hadoop-azure
whereas:
HADOOP_OPTIONAL_TOOLS="hadoop-azure"
with debug on:
DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure.sh
DEBUG: HADOOP_SHELL_PROFILES accepted hadoop-azure
was:
When defining both `hadoop-azure` and `hadoop-azure-datalake` in HADOOP_OPTIONAL_TOOLS in `conf/hadoop-env.sh`, `hadoop-azure` will get ignored.
eg setting this:
HADOOP_OPTIONAL_TOOLS="hadoop-azure-datalake,hadoop-azure"
with debug on:
DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure-datalake.sh
DEBUG: HADOOP_SHELL_PROFILES accepted hadoop-azure-datalake
DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure.sh
DEBUG: HADOOP_SHELL_PROFILES declined hadoop-azure
whereas:
HADOOP_OPTIONAL_TOOLS="hadoop-azure"
with debug on:
DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure.sh
DEBUG: HADOOP_SHELL_PROFILES accepted hadoop-azure
> Defining hadoop-azure and hadoop-azure-datalake in HADOOP_OPTIONAL_TOOLS will ignore hadoop-azure
> -------------------------------------------------------------------------------------------------
>
> Key: HADOOP-16649
> URL: https://issues.apache.org/jira/browse/HADOOP-16649
> Project: Hadoop Common
> Issue Type: Bug
> Components: conf, fs
> Affects Versions: 3.2.1
> Environment: Shell, but it also trickles down into all code using `FileSystem`
> Reporter: Tom Lous
> Priority: Minor
>
> When defining both `hadoop-azure` and `hadoop-azure-datalake` in HADOOP_OPTIONAL_TOOLS in `conf/hadoop-env.sh`, `hadoop-azure` will get ignored.
> eg setting this:
> HADOOP_OPTIONAL_TOOLS="hadoop-azure-datalake,hadoop-azure"
>
> with debug on:
>
> DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure-datalake.sh
> DEBUG: HADOOP_SHELL_PROFILES accepted hadoop-azure-datalake
> DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure.sh
> DEBUG: HADOOP_SHELL_PROFILES
> hadoop-azure
>
> whereas:
>
> HADOOP_OPTIONAL_TOOLS="hadoop-azure"
>
> with debug on:
> DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure.sh
> DEBUG: HADOOP_SHELL_PROFILES accepted hadoop-azure
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org