You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Brian Jeltema <br...@digitalenvoy.net> on 2014/06/23 18:14:24 UTC
hive/hbase integration
I’m running Hive 0.12 on Hadoop V2 (Ambari installation) and have been trying to use HBase integration. Hive generated Map/Reduce jobs
are failing with:
Error: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.mapreduce.TableSplit
this is discussed in several discussion threads, but I there are so many different distributions, bugs, and versions involved
that it’s difficult to find the correct solution.
Can someone suggest the correct fix (or approach to a fix) for this configuration?
Thanks
Brian
Re: hive/hbase integration
Posted by Brian Jeltema <br...@digitalenvoy.net>.
This did work, though specifying the same list in the HIVE_AUX_JARS_PATH environment variable
or in a ‘set hive.aux.jars.path’ command does not work.
Thanks, I can work with this.
Brian
On Jun 24, 2014, at 11:49 PM, D K <de...@gmail.com> wrote:
> If the MR job is failing can you try the following on Hive CLI before running the query?
>
> add jar $HBASE_HOME/lib/hbase-client-<version>-hadoop2.jar;
> add jar $HBASE_HOME/lib/hbase-protocol-<version>-hadoop2.jar;
> add jar $HBASE_HOME/lib/hbase-server-<version>-hadoop2.jar;
> add jar $HBASE_HOME/lib/htrace-core-2.01.jar
>
> replace <version> based on your install environment. Also replace $HBASE_HOME with the full path of your hbase install.
>
> -Deepesh
>
> On Mon, Jun 23, 2014 at 9:14 AM, Brian Jeltema <br...@digitalenvoy.net> wrote:
> I’m running Hive 0.12 on Hadoop V2 (Ambari installation) and have been trying to use HBase integration. Hive generated Map/Reduce jobs
> are failing with:
>
> Error: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.mapreduce.TableSplit
>
> this is discussed in several discussion threads, but I there are so many different distributions, bugs, and versions involved
> that it’s difficult to find the correct solution.
>
> Can someone suggest the correct fix (or approach to a fix) for this configuration?
>
> Thanks
> Brian
>
Re: hive/hbase integration
Posted by D K <de...@gmail.com>.
If the MR job is failing can you try the following on Hive CLI before
running the query?
add jar $HBASE_HOME/lib/hbase-client-<version>-hadoop2.jar;
add jar $HBASE_HOME/lib/hbase-protocol-<version>-hadoop2.jar;
add jar $HBASE_HOME/lib/hbase-server-<version>-hadoop2.jar;
add jar $HBASE_HOME/lib/htrace-core-2.01.jar
replace <version> based on your install environment. Also replace
$HBASE_HOME with the full path of your hbase install.
-Deepesh
On Mon, Jun 23, 2014 at 9:14 AM, Brian Jeltema <
brian.jeltema@digitalenvoy.net> wrote:
> I’m running Hive 0.12 on Hadoop V2 (Ambari installation) and have been
> trying to use HBase integration. Hive generated Map/Reduce jobs
> are failing with:
>
> Error: java.lang.ClassNotFoundException:
> org.apache.hadoop.hbase.mapreduce.TableSplit
>
> this is discussed in several discussion threads, but I there are so many
> different distributions, bugs, and versions involved
> that it’s difficult to find the correct solution.
>
> Can someone suggest the correct fix (or approach to a fix) for this
> configuration?
>
> Thanks
> Brian
>
Re: hive/hbase integration
Posted by Andre Araujo <ar...@pythian.com>.
Brian,
I'm successfully using Hive/Hbase integration on CDH5 (Hive 0.12.0 and
Hbase 0.96.1)
Can you explain your setup and configuration in details?
Cheers,
Andre'
On 24 June 2014 02:14, Brian Jeltema <br...@digitalenvoy.net> wrote:
> I’m running Hive 0.12 on Hadoop V2 (Ambari installation) and have been
> trying to use HBase integration. Hive generated Map/Reduce jobs
> are failing with:
>
> Error: java.lang.ClassNotFoundException:
> org.apache.hadoop.hbase.mapreduce.TableSplit
>
> this is discussed in several discussion threads, but I there are so many
> different distributions, bugs, and versions involved
> that it’s difficult to find the correct solution.
>
> Can someone suggest the correct fix (or approach to a fix) for this
> configuration?
>
> Thanks
> Brian
>
--
André Araújo
Big Data Consultant/Solutions Architect
The Pythian Group - Australia - www.pythian.com
Office (calls from within Australia): 1300 366 021 x1270
Office (international): +61 2 8016 7000 x270 *OR* +1 613 565 8696 x1270
Mobile: +61 410 323 559
Fax: +61 2 9805 0544
IM: pythianaraujo @ AIM/MSN/Y! or araujo@pythian.com @ GTalk
“Success is not about standing at the top, it's the steps you leave behind.”
— Iker Pou (rock climber)
--
--