You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Istvan Toth (Jira)" <ji...@apache.org> on 2021/05/11 10:15:00 UTC

[jira] [Created] (HIVE-25101) Remove HBase libraries from HBase distribution

Istvan Toth created HIVE-25101:
----------------------------------

             Summary: Remove HBase libraries from HBase distribution
                 Key: HIVE-25101
                 URL: https://issues.apache.org/jira/browse/HIVE-25101
             Project: Hive
          Issue Type: Improvement
          Components: HBase Handler, Hive
    Affects Versions: 4.0.0
            Reporter: Istvan Toth
            Assignee: Istvan Toth


Hive currently packages HBase libraries into its lib directory.
It also adds the HBase libraries separately to its classpath in the hive startup script.

Having both mechanisms is redundant, and it also causes errors, as the standard HBase libraries packaged into Hive are unshaded, while the libraries added by _hbase mapredcp_
are shaded, and the two are NOT compatible when custom coprocessors are used, and in some cases the classpaths during local execution and for MR/TEZ jobs are mutually incompatible.

I propose removing all HBase libraries from the distribution, and pulling them via the hbase mapredcp mechanism.

This also solves the old problem of including ancient HBase alpha versions Hive.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)