You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by "Hezhiqiang (Ransom)" <ra...@huawei.com> on 2012/05/09 09:47:13 UTC

does hive 0.9 supported hbase 0.90?

In 0.8.1 version ,it’s ok
But in 0.9
When I run selelct * from tbl, it was faild.

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hbase.mapred.TableMapReduceUtil.initCredentials(Lorg/apache/hadoop/mapred/JobConf;)V
        at org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat.getSplits(HiveHBaseTableInputFormat.java:419)
        at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:281)
        at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:320)
        at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:154)
        at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1377)
        at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:269)
        at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

I see the codes in 0.90,  this codes was added in HiveHBaseTableInputFormat.getSplits
TableMapReduceUtil.initCredentials(jobConf);

Should  I change other fileinputformat?

Best regards
Ransom.

Re: does hive 0.9 supported hbase 0.90?

Posted by Ashutosh Chauhan <ha...@apache.org>.

Hi Ransom,

Jira which bumped the Hbase version:
https://issues.apache.org/jira/browse/HIVE-2748

Ashutosh

On Wed, May 9, 2012 at 1:43 AM, Hezhiqiang (Ransom) <
ransom.hezhiqiang@huawei.com> wrote:

>  Thank you Ashutosh****
>
> Where is the JIRA address , I doesn’t found it in JIRA and 0.90 release
> notes.****
>
> ** **
>
> Best regards****
>
> Ransom.****
>
> ** **
>
> *From:* Ashutosh Chauhan [mailto:hashutosh@apache.org]
> *Sent:* Wednesday, May 09, 2012 4:29 PM
> *To:* user@hive.apache.org
> *Cc:* Wenzaohua
> *Subject:* Re: does hive 0.9 supported hbase 0.90?****
>
> ** **
>
> Hi Ransom,****
>
> ** **
>
> Hive 0.9 requires HBase 0.92 to work correctly.****
>
> ** **
>
> Thanks,****
>
> Ashutosh****
>
> On Wed, May 9, 2012 at 12:47 AM, Hezhiqiang (Ransom) <
> ransom.hezhiqiang@huawei.com> wrote:****
>
> In 0.8.1 version ,it’s ok****
>
> But in 0.9****
>
> When I run selelct * from tbl, it was faild.****
>
>  ****
>
> Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.mapred.TableMapReduceUtil.initCredentials(Lorg/apache/hadoop/mapred/JobConf;)V
> ****
>
>         at
> org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat.getSplits(HiveHBaseTableInputFormat.java:419)
> ****
>
>         at
> org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:281)
> ****
>
>         at
> org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:320)
> ****
>
>         at
> org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:154)****
>
>         at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1377)**
> **
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:269)**
> **
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)****
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)****
>
>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)***
> *
>
>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)**
> **
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)****
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> ****
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> ****
>
>         at java.lang.reflect.Method.invoke(Method.java:597)****
>
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)****
>
>  ****
>
> I see the codes in 0.90,  this codes was added in
> HiveHBaseTableInputFormat.getSplits****
>
> *TableMapReduceUtil*.*initCredentials**(jobConf)*;****
>
>  ****
>
> Should  I change other fileinputformat?****
>
>  ****
>
> Best regards****
>
> Ransom.****
>
>  ****
>
>  ****
>
> ** **
>

RE: does hive 0.9 supported hbase 0.90?

Posted by "Hezhiqiang (Ransom)" <ra...@huawei.com>.

Thank you Ashutosh
Where is the JIRA address , I doesn’t found it in JIRA and 0.90 release notes.

Best regards
Ransom.

From: Ashutosh Chauhan [mailto:hashutosh@apache.org]
Sent: Wednesday, May 09, 2012 4:29 PM
To: user@hive.apache.org
Cc: Wenzaohua
Subject: Re: does hive 0.9 supported hbase 0.90?

Hi Ransom,

Hive 0.9 requires HBase 0.92 to work correctly.

Thanks,
Ashutosh
On Wed, May 9, 2012 at 12:47 AM, Hezhiqiang (Ransom) <ra...@huawei.com>> wrote:
In 0.8.1 version ,it’s ok
But in 0.9
When I run selelct * from tbl, it was faild.

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hbase.mapred.TableMapReduceUtil.initCredentials(Lorg/apache/hadoop/mapred/JobConf;)V
        at org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat.getSplits(HiveHBaseTableInputFormat.java:419)
        at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:281)
        at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:320)
        at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:154)
        at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1377)
        at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:269)
        at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

I see the codes in 0.90,  this codes was added in HiveHBaseTableInputFormat.getSplits
TableMapReduceUtil.initCredentials(jobConf);

Should  I change other fileinputformat?

Best regards
Ransom.

Re: does hive 0.9 supported hbase 0.90?

Posted by Ashutosh Chauhan <ha...@apache.org>.

Hi Ransom,

Hive 0.9 requires HBase 0.92 to work correctly.

Thanks,
Ashutosh

On Wed, May 9, 2012 at 12:47 AM, Hezhiqiang (Ransom) <
ransom.hezhiqiang@huawei.com> wrote:

>  In 0.8.1 version ,it’s ok****
>
> But in 0.9****
>
> When I run selelct * from tbl, it was faild.****
>
> ** **
>
> Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.mapred.TableMapReduceUtil.initCredentials(Lorg/apache/hadoop/mapred/JobConf;)V
> ****
>
>         at
> org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat.getSplits(HiveHBaseTableInputFormat.java:419)
> ****
>
>         at
> org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:281)
> ****
>
>         at
> org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:320)
> ****
>
>         at
> org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:154)****
>
>         at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1377)**
> **
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:269)**
> **
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)****
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)****
>
>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)***
> *
>
>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)**
> **
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)****
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> ****
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> ****
>
>         at java.lang.reflect.Method.invoke(Method.java:597)****
>
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)****
>
> ** **
>
> I see the codes in 0.90,  this codes was added in
> HiveHBaseTableInputFormat.getSplits****
>
> *TableMapReduceUtil*.*initCredentials**(jobConf)*;****
>
> ** **
>
> Should  I change other fileinputformat?****
>
> ** **
>
> Best regards****
>
> Ransom.****
>
> ** **
>
> ** **
>