You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Udit Mehrotra (Jira)" <ji...@apache.org> on 2020/08/12 21:30:00 UTC

[jira] [Commented] (HUDI-1183) PrestoDB dependency on Apache Hudi

    [ https://issues.apache.org/jira/browse/HUDI-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176615#comment-17176615 ] 

Udit Mehrotra commented on HUDI-1183:
-------------------------------------

Some of dependency conflicts that require shading can be found at [https://github.com/apache/hudi/pull/1944/] where we are adding support for Presto queries to work with bootstrapped tables. Bootstrapped tables introduce HBase as a dependency that has runtime conflicts with presto's guava version.

To be able to handle such issue in this case as well as in future, depending on presto-bundle seems like the better option.

> PrestoDB dependency on Apache Hudi
> ----------------------------------
>
>                 Key: HUDI-1183
>                 URL: https://issues.apache.org/jira/browse/HUDI-1183
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: Presto Integration
>            Reporter: Bhavani Sudha
>            Priority: Major
>             Fix For: 0.6.1
>
>
> Presto versions 0.232 and below depend on a bundle being dropped into the presto plugin directories for integrating Hudi. From 0.233 we introduced compile time dependency on `hudi-hadoop-mr`. The compile time dependency works fine for snapshot queries and MOR queries on regular Hudi tables.  For due to some runtime issues that require shading of jars, we would rather prefer the dependency on presto bundle instead. This Jira is to track this gap and identify how we want to proceed forward.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)