You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@phoenix.apache.org by "Istvan Toth (Jira)" <ji...@apache.org> on 2020/12/02 16:42:00 UTC

[jira] [Commented] (PHOENIX-5787) Do not package hive dependencies into phoenix-hive jar

    [ https://issues.apache.org/jira/browse/PHOENIX-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17242501#comment-17242501 ] 

Istvan Toth commented on PHOENIX-5787:
--------------------------------------

A basic problem is that Hive has super-ancient Hbase version included  in every release.

The users will need to replace the bundled HBase libraries with the ones that Phoenix was built with, likely braking the included HBase-Hive  connector. (It definitely breaks 3.1.2, I didn't test 2.3.x yet)

Replacing the HBase libraries is a hard requirement, otherwise we're very likely to hit incompatibilities.

However, this wouldn't necessarily have to break the included HBase storage handler, if Hive stuck to the public APIs and final, releases.

> Do not package hive dependencies into phoenix-hive jar
> ------------------------------------------------------
>
>                 Key: PHOENIX-5787
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-5787
>             Project: Phoenix
>          Issue Type: Bug
>          Components: connectors, hive-connector
>    Affects Versions: connectors-6.0.0
>            Reporter: Istvan Toth
>            Assignee: Istvan Toth
>            Priority: Major
>
> Phoenix and hive share a lot of dependencies, starting with hadoop and hbase.
> We are shading all phoenix dependencies into the phoenix-hive connector, that regularly case classpath/version mismatch problems with hive.
> Instead of trying to resolve these one by one, exclude/shade all dependencies from phoenix-jar that are available on the hive classpath.
> The most critcal of these are the hadoop and hbase transitive dependencies.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)