[jira] [Commented] (DRILL-6540) Upgrade to HADOOP-3.1 libraries

["Vitalii Diravka (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-6540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606306#comment-16606306 ] 

Vitalii Diravka commented on DRILL-6540:
----------------------------------------

It requires proper Drill's dependency on loggers, currently a lot of logger transitive dependencies are used, for example {{org.slf4j.LoggerFactory}} is used from avatica-1.12.0 - resolved.

Also it requires upgrade {{jetty.version}} from 9.1 to at least 9.3 version (it is used in setting up {{hdfs.MiniDFSCluster}} for Drill unit tests) - resolved.

It requires {{commons-logging}}, which is currently banned in Drill. For some reason {{Log4JLogger}} is absent in {{jcl-over-slf4j}} - still the issue.

Adapting the code with 2.7-mapr version - resolved.

Work in progress branch - https://github.com/vdiravka/drill/commits/DRILL-6540

> Upgrade to HADOOP-3.1 libraries 
> --------------------------------
>
>                 Key: DRILL-6540
>                 URL: https://issues.apache.org/jira/browse/DRILL-6540
>             Project: Apache Drill
>          Issue Type: Improvement
>            Reporter: Vitalii Diravka
>            Priority: Major
>             Fix For: Future
>
>
> Currently Drill uses 2.7.1 version of hadoop libraries (hadoop-common, hadoop-hdfs, hadoop-annotations, hadoop-aws, hadoop-yarn-api, hadoop-client, hadoop-yarn-client).
> Half of year ago the [Hadoop 3.0|https://hadoop.apache.org/docs/r3.0.0/index.html] was released and recently it was an update - [Hadoop 3.1|https://hadoop.apache.org/docs/r3.1.0/]. 
> To use Drill under Hadoop3.0 distribution we need this upgrade. Also the newer version includes new features, which can be useful for Drill.
> This upgrade is also needed to leverage the newest version of zookeeper libraries.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)