[jira] [Commented] (METAMODEL-93) Upgrade HBase dependency to support Hadoop 2

["Tomasz Guzialek (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/METAMODEL-93?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14312115#comment-14312115 ] 

Tomasz Guzialek commented on METAMODEL-93:
------------------------------------------

The proposal for the solution with classifiers is available in my fork: https://github.com/tomaszguzialek/metamodel/tree/METAMODEL-93

It introduced two build profiles: hadoop1 and hadoop2 (hadoop2 being the default). The command "mvn install -Phadoop1" will produce MetaModel-hbase-{metamodel.version}-hadoop1.jar with hbase-client in version 0.95.1-hadoop1 as a dependency. The command "mvn install -Phadoop2" (or just "mvn install") will produce MetaModel-hbase-{metamodel.version}-hadoop2.jar with hbase-client in version 0.98.1-hadoop2 as a dependency.

Now the MetaModel-hbase module can be imported a dependency in such a manner:
    <dependency>
        <groupId>org.apache.metamodel</groupId>
        <artifactId>MetaModel-hbase</artifactId>
        <version>${metamodel.version}</version>
        <classifier>hadoop2</classifier>
    </dependency>

Unfortunately, Eclipse seems to have a problem with such a setup. The dependency tree looks absolutely correct (both MetaModel-hbase and hbase-client dependencies are present and in correct versions), but in the runtime ClassNotFoundException is being thrown. Running from command line seems to be working fine, although maven-assembly-plugin is needed to build jar-with-dependencies.

However, HBase as a dependency seems to be very unstable, so sticking to just two versions of hbase-client might be not enough. Forcing the user to import MetaModel-hbase and explicitly hbase-client in a correct version might be a better and easier solution. I am looking forward to your thoughts.


> Upgrade HBase dependency to support Hadoop 2
> --------------------------------------------
>
>                 Key: METAMODEL-93
>                 URL: https://issues.apache.org/jira/browse/METAMODEL-93
>             Project: Apache MetaModel
>          Issue Type: Improvement
>    Affects Versions: 4.3.0-incubating
>         Environment: Cloudera CDH 5.1.0
>            Reporter: Tomasz Guzialek
>              Labels: hadoop
>
> Current hbase-client dependency version in HBase module is 0.95.1-hadoop1. We should consider upgrading our depedency to support Hadoop 2.
> I tried to connect to HBase in Cloudera's Quickstart VM with CDH 5.1.0 from MetaModel, but it is using HBase 0.98.1 (Hadoop 2). I guess, many people start with this popular distribution for a proof of concept, so ensuring that MetaModel can connect to HBase on Hadoop 2 is important. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)