You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Joe McDonnell (JIRA)" <ji...@apache.org> on 2019/07/27 21:46:00 UTC

[jira] [Resolved] (IMPALA-8766) Change hadoop cloud dependencies to use hadoop-cloud-storage

     [ https://issues.apache.org/jira/browse/IMPALA-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joe McDonnell resolved IMPALA-8766.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 3.3.0

> Change hadoop cloud dependencies to use hadoop-cloud-storage
> ------------------------------------------------------------
>
>                 Key: IMPALA-8766
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8766
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Infrastructure
>    Affects Versions: Impala 3.3.0
>            Reporter: Joe McDonnell
>            Assignee: Joe McDonnell
>            Priority: Major
>             Fix For: Impala 3.3.0
>
>
> Currently, fe/pom.xml specifically includes hadoop-aws, hadoop-azure, and hadoop-azure-datalake directly. There is a meta-package in hadoop called hadoop-cloud-storage that includes these dependencies and others as customized by the hadoop provider, with appropriate exclusions applied to each package.
> Migrating Impala to use this meta-package would make it easier for different providers of hadoop to customize hadoop-cloud-storage and the resulting CLASSPATH without needing to change Impala. For example, a hadoop provider may want to include Apache Knox for cloud identity management.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)