[jira] [Commented] (BIGTOP-3495) Optional tools of hadoop-tools should be optional

["Masatake Iwasaki (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17281148#comment-17281148 ] 

Masatake Iwasaki commented on BIGTOP-3495:
------------------------------------------

Optional tools on the classpath by default.
{noformat}
[root@149b41790e16 /]# hadoop classpath --glob | sed -z -e 's/:/\n/g' | grep aws
/usr/lib/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.563.jar
/usr/lib/hadoop-mapreduce/.//hadoop-aws-3.2.2.jar
/usr/lib/hadoop-mapreduce/.//hadoop-aws.jar
{noformat}
{noformat}
[root@149b41790e16 /]# hadoop classpath --glob | sed -z -e 's/:/\n/g' | grep azure
/usr/lib/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.9.jar
/usr/lib/hadoop-mapreduce/.//azure-keyvault-core-1.0.0.jar
/usr/lib/hadoop-mapreduce/.//azure-storage-7.0.0.jar
/usr/lib/hadoop-mapreduce/.//hadoop-azure-3.2.2.jar
/usr/lib/hadoop-mapreduce/.//hadoop-azure-datalake-3.2.2.jar
/usr/lib/hadoop-mapreduce/.//hadoop-azure-datalake.jar
/usr/lib/hadoop-mapreduce/.//hadoop-azure.jar
{noformat}

> Optional tools of hadoop-tools should be optional
> -------------------------------------------------
>
>                 Key: BIGTOP-3495
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-3495
>             Project: Bigtop
>          Issue Type: Improvement
>          Components: hadoop
>            Reporter: Masatake Iwasaki
>            Assignee: Masatake Iwasaki
>            Priority: Major
>
> All jars of hadoop-tools are packaged as part of hadoop-mapreduce and exist in the classpath by default because they are placed under /usr/lib/hadoop-mapreduce/.
> Tools listed below should enabled and loaded only if HADOOP_OPTIONAL_TOOLS contains the entry.
> * hadoop-aliyun
> * hadoop-aws
> * hadoop-azure-datalake
> * hadoop-azure
> * hadoop-openstack
> * hadoop-kafka



--
This message was sent by Atlassian Jira
(v8.3.4#803005)