You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Sai Pavan Gadde <id...@gmail.com> on 2014/03/13 05:45:20 UTC
HBase- Hive Integration
Hi,
I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0 version
for a project. I got a requirement such that i have to integrate hbase to
hive , so that table reflection should happens.
while i am doing this, i got error like TARGET INNOVOCATION EXCEPTION.
This is because jar file target missing. please suggest me to overcome the
problem
--
*THANKS & REGARDS,*
G.SAI PAVAN,
CCDH4 CERTIFIED,
Ph: 8121914494,
*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
HYDERABAD.
Re: HBase- Hive Integration
Posted by Sai Pavan Gadde <id...@gmail.com>.
Hi all,
Thank you for replies,
Looking for more suggestions
--
*THANKS & REGARDS,*
G.SAI PAVAN,
CCDH4 CERTIFIED,
Ph: 8121914494,
*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
HYDERABAD.
On Fri, Mar 14, 2014 at 11:59 PM, Nick Dimiduk <nd...@gmail.com> wrote:
> hbase-dev to bcc; adding hive-user. this is a question for the user lists,
> and more for Hive's than HBase, as HBaseStorageHandler is code in Hive
> project, not HBase.
>
> Hi Sai,
>
> You are embarking into a brave world. Because your aim is the interop
> across these different Apache projects, I highly recommend using a vendor's
> distribution. The reason being that the vendor has done the work of
> certifying interoperability for you, so you won't be left finding bugs in
> the edges that aren't well tested in the communities. Notice in the blog
> post referenced, I was using a distribution and even then I've found
> interop issues.
>
> Hive 0.11 will require you manually specify the HBase jars. Please don't
> copy them around, instead use environment variables. You can follow along
> with my blog post and set HADOOP_CLASSPATH and HIVE_AUX_JARS_PATH
> appropriately. You're using HBase 0.96.1, which includes HBASE-8438, so you
> can use `hbase mapredcp` instead of itemizing jars manually. This
> requirement (hopefully) goes away entirely in Hive 0.13 with HIVE-2379
> and HIVE-2055.
>
> Finally, are you using Hive on the CLI or through a web tool (Hue?). The
> details change slightly based on all these... details.
>
> Good luck. Keep asking questions. Please file bugs.
>
> Thanks,
> Nick
>
>
> On Thu, Mar 13, 2014 at 10:56 PM, Sai Pavan Gadde <id4gpavan@gmail.com
> >wrote:
>
> > Hi,
> >
> > Here is my document in an attached file. It contains my flow of
> hive-hbase
> > integration.
> > 1. I created a table in mysql and imported into hbase,
> > 2. I copied a hive-handler.jar, guva.jar and zookeeper.jar file in
> > Hadoop-2.2.0/share/mapred/lib folder
> > 3. copied required hive(0.11.0) jars to hbase(0.96.1.1-hadoop2) && hbase
> > jars to hive
> > 4. Trying to create a table in hive with hbase properties but gets error
> as
> >
> >
> > *FAILED: Error in metadata: MetaException(message:java.io.IOException:
> > java.lang.reflect.InvocationTargetException*
> >
> >
> > I think so hbase-0.96.1.1-hadoop2.jar file is not present in HBase
> > directory.
> >
> > So, Suggest for further step to proceed.
> >
> >
> > On Thu, Mar 13, 2014 at 7:12 PM, kulkarni.swarnim@gmail.com <
> > kulkarni.swarnim@gmail.com> wrote:
> >
> >> Hi Sai,
> >>
> >> If you can show us what specific exception you are seeing, we would be
> >> able
> >> to help you out in a better way.
> >>
> >> Thanks,
> >>
> >>
> >> On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpavan@gmail.com
> >> >wrote:
> >>
> >> > Hi,
> >> > Thanks for reply... but
> >> >
> >> > I worked with hadoop-1.2.1 which is fine working, but need with real
> >> > requirement is Hadoop-2.2.0 i.e, YARN
> >> >
> >> > Please show the way to get solve with apache products
> >> >
> >> > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
> >> > hive-0.11.0 too,
> >> >
> >> > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar,
> >> zookeeper.jar
> >> >
> >> > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and
> >> worked
> >> > but not getting connected with hive. I suppose to work with
> >> hadoop-0.94.x
> >> > but the version is not compatible with hadoop-2.2.0
> >> >
> >> > I tried in all the way, not found the solution, please suggest me
> >> >
> >> >
> >> >
> >> >
> >> > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Rekha_Joshi@intuit.com
> >> > >wrote:
> >> >
> >> > > Hi,
> >> > >
> >> > > We have successfully created external hive table pointing to hbase
> >> table
> >> > > with settings for hive, zookeeper, HBase security tokens.
> >> > >
> >> > > If it is a jar problem, then mostly the env is not set
> correctly.Hive
> >> > > should be able to recognize HBaseStorageHandler.
> >> > >
> >> > > Thanks
> >> > > Rekha
> >> > >
> >> > >
> http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
> >> > >
> >> > >
> >> > >
> >> > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com>
> wrote:
> >> > >
> >> > > >Hi,
> >> > > >
> >> > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0
> >> version
> >> > > >for a project. I got a requirement such that i have to integrate
> >> hbase
> >> > to
> >> > > >hive , so that table reflection should happens.
> >> > > >
> >> > > >while i am doing this, i got error like TARGET INNOVOCATION
> >> EXCEPTION.
> >> > > >This is because jar file target missing. please suggest me to
> >> overcome
> >> > the
> >> > > >problem
> >> > > >
> >> > > >--
> >> > > >*THANKS & REGARDS,*
> >> > > >G.SAI PAVAN,
> >> > > >CCDH4 CERTIFIED,
> >> > > >Ph: 8121914494,
> >> > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> >> > > >linkedin profile <
> >> > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> >> > > >HYDERABAD.
> >> > >
> >> > >
> >> >
> >> >
> >> > --
> >> > *THANKS & REGARDS,*
> >> > G.SAI PAVAN,
> >> > CCDH4 CERTIFIED,
> >> > Ph: 8121914494,
> >> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> >> > linkedin profile <
> >> http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> >> > HYDERABAD.
> >> >
> >>
> >>
> >>
> >> --
> >> Swarnim
> >>
> >
> >
> >
> > --
> > *THANKS & REGARDS,*
> > G.SAI PAVAN,
> > CCDH4 CERTIFIED,
> > Ph: 8121914494,
> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> > linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/
> >
> > HYDERABAD.
> >
>
Re: HBase- Hive Integration
Posted by Sai Pavan Gadde <id...@gmail.com>.
Hi all,
Thank you for replies,
Looking for more suggestions
--
*THANKS & REGARDS,*
G.SAI PAVAN,
CCDH4 CERTIFIED,
Ph: 8121914494,
*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
HYDERABAD.
On Fri, Mar 14, 2014 at 11:59 PM, Nick Dimiduk <nd...@gmail.com> wrote:
> hbase-dev to bcc; adding hive-user. this is a question for the user lists,
> and more for Hive's than HBase, as HBaseStorageHandler is code in Hive
> project, not HBase.
>
> Hi Sai,
>
> You are embarking into a brave world. Because your aim is the interop
> across these different Apache projects, I highly recommend using a vendor's
> distribution. The reason being that the vendor has done the work of
> certifying interoperability for you, so you won't be left finding bugs in
> the edges that aren't well tested in the communities. Notice in the blog
> post referenced, I was using a distribution and even then I've found
> interop issues.
>
> Hive 0.11 will require you manually specify the HBase jars. Please don't
> copy them around, instead use environment variables. You can follow along
> with my blog post and set HADOOP_CLASSPATH and HIVE_AUX_JARS_PATH
> appropriately. You're using HBase 0.96.1, which includes HBASE-8438, so you
> can use `hbase mapredcp` instead of itemizing jars manually. This
> requirement (hopefully) goes away entirely in Hive 0.13 with HIVE-2379
> and HIVE-2055.
>
> Finally, are you using Hive on the CLI or through a web tool (Hue?). The
> details change slightly based on all these... details.
>
> Good luck. Keep asking questions. Please file bugs.
>
> Thanks,
> Nick
>
>
> On Thu, Mar 13, 2014 at 10:56 PM, Sai Pavan Gadde <id4gpavan@gmail.com
> >wrote:
>
> > Hi,
> >
> > Here is my document in an attached file. It contains my flow of
> hive-hbase
> > integration.
> > 1. I created a table in mysql and imported into hbase,
> > 2. I copied a hive-handler.jar, guva.jar and zookeeper.jar file in
> > Hadoop-2.2.0/share/mapred/lib folder
> > 3. copied required hive(0.11.0) jars to hbase(0.96.1.1-hadoop2) && hbase
> > jars to hive
> > 4. Trying to create a table in hive with hbase properties but gets error
> as
> >
> >
> > *FAILED: Error in metadata: MetaException(message:java.io.IOException:
> > java.lang.reflect.InvocationTargetException*
> >
> >
> > I think so hbase-0.96.1.1-hadoop2.jar file is not present in HBase
> > directory.
> >
> > So, Suggest for further step to proceed.
> >
> >
> > On Thu, Mar 13, 2014 at 7:12 PM, kulkarni.swarnim@gmail.com <
> > kulkarni.swarnim@gmail.com> wrote:
> >
> >> Hi Sai,
> >>
> >> If you can show us what specific exception you are seeing, we would be
> >> able
> >> to help you out in a better way.
> >>
> >> Thanks,
> >>
> >>
> >> On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpavan@gmail.com
> >> >wrote:
> >>
> >> > Hi,
> >> > Thanks for reply... but
> >> >
> >> > I worked with hadoop-1.2.1 which is fine working, but need with real
> >> > requirement is Hadoop-2.2.0 i.e, YARN
> >> >
> >> > Please show the way to get solve with apache products
> >> >
> >> > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
> >> > hive-0.11.0 too,
> >> >
> >> > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar,
> >> zookeeper.jar
> >> >
> >> > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and
> >> worked
> >> > but not getting connected with hive. I suppose to work with
> >> hadoop-0.94.x
> >> > but the version is not compatible with hadoop-2.2.0
> >> >
> >> > I tried in all the way, not found the solution, please suggest me
> >> >
> >> >
> >> >
> >> >
> >> > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Rekha_Joshi@intuit.com
> >> > >wrote:
> >> >
> >> > > Hi,
> >> > >
> >> > > We have successfully created external hive table pointing to hbase
> >> table
> >> > > with settings for hive, zookeeper, HBase security tokens.
> >> > >
> >> > > If it is a jar problem, then mostly the env is not set
> correctly.Hive
> >> > > should be able to recognize HBaseStorageHandler.
> >> > >
> >> > > Thanks
> >> > > Rekha
> >> > >
> >> > >
> http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
> >> > >
> >> > >
> >> > >
> >> > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com>
> wrote:
> >> > >
> >> > > >Hi,
> >> > > >
> >> > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0
> >> version
> >> > > >for a project. I got a requirement such that i have to integrate
> >> hbase
> >> > to
> >> > > >hive , so that table reflection should happens.
> >> > > >
> >> > > >while i am doing this, i got error like TARGET INNOVOCATION
> >> EXCEPTION.
> >> > > >This is because jar file target missing. please suggest me to
> >> overcome
> >> > the
> >> > > >problem
> >> > > >
> >> > > >--
> >> > > >*THANKS & REGARDS,*
> >> > > >G.SAI PAVAN,
> >> > > >CCDH4 CERTIFIED,
> >> > > >Ph: 8121914494,
> >> > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> >> > > >linkedin profile <
> >> > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> >> > > >HYDERABAD.
> >> > >
> >> > >
> >> >
> >> >
> >> > --
> >> > *THANKS & REGARDS,*
> >> > G.SAI PAVAN,
> >> > CCDH4 CERTIFIED,
> >> > Ph: 8121914494,
> >> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> >> > linkedin profile <
> >> http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> >> > HYDERABAD.
> >> >
> >>
> >>
> >>
> >> --
> >> Swarnim
> >>
> >
> >
> >
> > --
> > *THANKS & REGARDS,*
> > G.SAI PAVAN,
> > CCDH4 CERTIFIED,
> > Ph: 8121914494,
> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> > linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/
> >
> > HYDERABAD.
> >
>
Re: HBase- Hive Integration
Posted by Nick Dimiduk <nd...@gmail.com>.
hbase-dev to bcc; adding hive-user. this is a question for the user lists,
and more for Hive's than HBase, as HBaseStorageHandler is code in Hive
project, not HBase.
Hi Sai,
You are embarking into a brave world. Because your aim is the interop
across these different Apache projects, I highly recommend using a vendor's
distribution. The reason being that the vendor has done the work of
certifying interoperability for you, so you won't be left finding bugs in
the edges that aren't well tested in the communities. Notice in the blog
post referenced, I was using a distribution and even then I've found
interop issues.
Hive 0.11 will require you manually specify the HBase jars. Please don't
copy them around, instead use environment variables. You can follow along
with my blog post and set HADOOP_CLASSPATH and HIVE_AUX_JARS_PATH
appropriately. You're using HBase 0.96.1, which includes HBASE-8438, so you
can use `hbase mapredcp` instead of itemizing jars manually. This
requirement (hopefully) goes away entirely in Hive 0.13 with HIVE-2379
and HIVE-2055.
Finally, are you using Hive on the CLI or through a web tool (Hue?). The
details change slightly based on all these... details.
Good luck. Keep asking questions. Please file bugs.
Thanks,
Nick
On Thu, Mar 13, 2014 at 10:56 PM, Sai Pavan Gadde <id...@gmail.com>wrote:
> Hi,
>
> Here is my document in an attached file. It contains my flow of hive-hbase
> integration.
> 1. I created a table in mysql and imported into hbase,
> 2. I copied a hive-handler.jar, guva.jar and zookeeper.jar file in
> Hadoop-2.2.0/share/mapred/lib folder
> 3. copied required hive(0.11.0) jars to hbase(0.96.1.1-hadoop2) && hbase
> jars to hive
> 4. Trying to create a table in hive with hbase properties but gets error as
>
>
> *FAILED: Error in metadata: MetaException(message:java.io.IOException:
> java.lang.reflect.InvocationTargetException*
>
>
> I think so hbase-0.96.1.1-hadoop2.jar file is not present in HBase
> directory.
>
> So, Suggest for further step to proceed.
>
>
> On Thu, Mar 13, 2014 at 7:12 PM, kulkarni.swarnim@gmail.com <
> kulkarni.swarnim@gmail.com> wrote:
>
>> Hi Sai,
>>
>> If you can show us what specific exception you are seeing, we would be
>> able
>> to help you out in a better way.
>>
>> Thanks,
>>
>>
>> On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpavan@gmail.com
>> >wrote:
>>
>> > Hi,
>> > Thanks for reply... but
>> >
>> > I worked with hadoop-1.2.1 which is fine working, but need with real
>> > requirement is Hadoop-2.2.0 i.e, YARN
>> >
>> > Please show the way to get solve with apache products
>> >
>> > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
>> > hive-0.11.0 too,
>> >
>> > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar,
>> zookeeper.jar
>> >
>> > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and
>> worked
>> > but not getting connected with hive. I suppose to work with
>> hadoop-0.94.x
>> > but the version is not compatible with hadoop-2.2.0
>> >
>> > I tried in all the way, not found the solution, please suggest me
>> >
>> >
>> >
>> >
>> > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Rekha_Joshi@intuit.com
>> > >wrote:
>> >
>> > > Hi,
>> > >
>> > > We have successfully created external hive table pointing to hbase
>> table
>> > > with settings for hive, zookeeper, HBase security tokens.
>> > >
>> > > If it is a jar problem, then mostly the env is not set correctly.Hive
>> > > should be able to recognize HBaseStorageHandler.
>> > >
>> > > Thanks
>> > > Rekha
>> > >
>> > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
>> > >
>> > >
>> > >
>> > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
>> > >
>> > > >Hi,
>> > > >
>> > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0
>> version
>> > > >for a project. I got a requirement such that i have to integrate
>> hbase
>> > to
>> > > >hive , so that table reflection should happens.
>> > > >
>> > > >while i am doing this, i got error like TARGET INNOVOCATION
>> EXCEPTION.
>> > > >This is because jar file target missing. please suggest me to
>> overcome
>> > the
>> > > >problem
>> > > >
>> > > >--
>> > > >*THANKS & REGARDS,*
>> > > >G.SAI PAVAN,
>> > > >CCDH4 CERTIFIED,
>> > > >Ph: 8121914494,
>> > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
>> > > >linkedin profile <
>> > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
>> > > >HYDERABAD.
>> > >
>> > >
>> >
>> >
>> > --
>> > *THANKS & REGARDS,*
>> > G.SAI PAVAN,
>> > CCDH4 CERTIFIED,
>> > Ph: 8121914494,
>> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
>> > linkedin profile <
>> http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
>> > HYDERABAD.
>> >
>>
>>
>>
>> --
>> Swarnim
>>
>
>
>
> --
> *THANKS & REGARDS,*
> G.SAI PAVAN,
> CCDH4 CERTIFIED,
> Ph: 8121914494,
> *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> HYDERABAD.
>
Re: HBase- Hive Integration
Posted by Nick Dimiduk <nd...@gmail.com>.
hbase-dev to bcc; adding hive-user. this is a question for the user lists,
and more for Hive's than HBase, as HBaseStorageHandler is code in Hive
project, not HBase.
Hi Sai,
You are embarking into a brave world. Because your aim is the interop
across these different Apache projects, I highly recommend using a vendor's
distribution. The reason being that the vendor has done the work of
certifying interoperability for you, so you won't be left finding bugs in
the edges that aren't well tested in the communities. Notice in the blog
post referenced, I was using a distribution and even then I've found
interop issues.
Hive 0.11 will require you manually specify the HBase jars. Please don't
copy them around, instead use environment variables. You can follow along
with my blog post and set HADOOP_CLASSPATH and HIVE_AUX_JARS_PATH
appropriately. You're using HBase 0.96.1, which includes HBASE-8438, so you
can use `hbase mapredcp` instead of itemizing jars manually. This
requirement (hopefully) goes away entirely in Hive 0.13 with HIVE-2379
and HIVE-2055.
Finally, are you using Hive on the CLI or through a web tool (Hue?). The
details change slightly based on all these... details.
Good luck. Keep asking questions. Please file bugs.
Thanks,
Nick
On Thu, Mar 13, 2014 at 10:56 PM, Sai Pavan Gadde <id...@gmail.com>wrote:
> Hi,
>
> Here is my document in an attached file. It contains my flow of hive-hbase
> integration.
> 1. I created a table in mysql and imported into hbase,
> 2. I copied a hive-handler.jar, guva.jar and zookeeper.jar file in
> Hadoop-2.2.0/share/mapred/lib folder
> 3. copied required hive(0.11.0) jars to hbase(0.96.1.1-hadoop2) && hbase
> jars to hive
> 4. Trying to create a table in hive with hbase properties but gets error as
>
>
> *FAILED: Error in metadata: MetaException(message:java.io.IOException:
> java.lang.reflect.InvocationTargetException*
>
>
> I think so hbase-0.96.1.1-hadoop2.jar file is not present in HBase
> directory.
>
> So, Suggest for further step to proceed.
>
>
> On Thu, Mar 13, 2014 at 7:12 PM, kulkarni.swarnim@gmail.com <
> kulkarni.swarnim@gmail.com> wrote:
>
>> Hi Sai,
>>
>> If you can show us what specific exception you are seeing, we would be
>> able
>> to help you out in a better way.
>>
>> Thanks,
>>
>>
>> On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpavan@gmail.com
>> >wrote:
>>
>> > Hi,
>> > Thanks for reply... but
>> >
>> > I worked with hadoop-1.2.1 which is fine working, but need with real
>> > requirement is Hadoop-2.2.0 i.e, YARN
>> >
>> > Please show the way to get solve with apache products
>> >
>> > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
>> > hive-0.11.0 too,
>> >
>> > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar,
>> zookeeper.jar
>> >
>> > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and
>> worked
>> > but not getting connected with hive. I suppose to work with
>> hadoop-0.94.x
>> > but the version is not compatible with hadoop-2.2.0
>> >
>> > I tried in all the way, not found the solution, please suggest me
>> >
>> >
>> >
>> >
>> > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Rekha_Joshi@intuit.com
>> > >wrote:
>> >
>> > > Hi,
>> > >
>> > > We have successfully created external hive table pointing to hbase
>> table
>> > > with settings for hive, zookeeper, HBase security tokens.
>> > >
>> > > If it is a jar problem, then mostly the env is not set correctly.Hive
>> > > should be able to recognize HBaseStorageHandler.
>> > >
>> > > Thanks
>> > > Rekha
>> > >
>> > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
>> > >
>> > >
>> > >
>> > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
>> > >
>> > > >Hi,
>> > > >
>> > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0
>> version
>> > > >for a project. I got a requirement such that i have to integrate
>> hbase
>> > to
>> > > >hive , so that table reflection should happens.
>> > > >
>> > > >while i am doing this, i got error like TARGET INNOVOCATION
>> EXCEPTION.
>> > > >This is because jar file target missing. please suggest me to
>> overcome
>> > the
>> > > >problem
>> > > >
>> > > >--
>> > > >*THANKS & REGARDS,*
>> > > >G.SAI PAVAN,
>> > > >CCDH4 CERTIFIED,
>> > > >Ph: 8121914494,
>> > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
>> > > >linkedin profile <
>> > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
>> > > >HYDERABAD.
>> > >
>> > >
>> >
>> >
>> > --
>> > *THANKS & REGARDS,*
>> > G.SAI PAVAN,
>> > CCDH4 CERTIFIED,
>> > Ph: 8121914494,
>> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
>> > linkedin profile <
>> http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
>> > HYDERABAD.
>> >
>>
>>
>>
>> --
>> Swarnim
>>
>
>
>
> --
> *THANKS & REGARDS,*
> G.SAI PAVAN,
> CCDH4 CERTIFIED,
> Ph: 8121914494,
> *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> HYDERABAD.
>
Re: HBase- Hive Integration
Posted by Nick Dimiduk <nd...@gmail.com>.
hbase-dev to bcc; adding hive-user. this is a question for the user lists,
and more for Hive's than HBase, as HBaseStorageHandler is code in Hive
project, not HBase.
Hi Sai,
You are embarking into a brave world. Because your aim is the interop
across these different Apache projects, I highly recommend using a vendor's
distribution. The reason being that the vendor has done the work of
certifying interoperability for you, so you won't be left finding bugs in
the edges that aren't well tested in the communities. Notice in the blog
post referenced, I was using a distribution and even then I've found
interop issues.
Hive 0.11 will require you manually specify the HBase jars. Please don't
copy them around, instead use environment variables. You can follow along
with my blog post and set HADOOP_CLASSPATH and HIVE_AUX_JARS_PATH
appropriately. You're using HBase 0.96.1, which includes HBASE-8438, so you
can use `hbase mapredcp` instead of itemizing jars manually. This
requirement (hopefully) goes away entirely in Hive 0.13 with HIVE-2379
and HIVE-2055.
Finally, are you using Hive on the CLI or through a web tool (Hue?). The
details change slightly based on all these... details.
Good luck. Keep asking questions. Please file bugs.
Thanks,
Nick
On Thu, Mar 13, 2014 at 10:56 PM, Sai Pavan Gadde <id...@gmail.com>wrote:
> Hi,
>
> Here is my document in an attached file. It contains my flow of hive-hbase
> integration.
> 1. I created a table in mysql and imported into hbase,
> 2. I copied a hive-handler.jar, guva.jar and zookeeper.jar file in
> Hadoop-2.2.0/share/mapred/lib folder
> 3. copied required hive(0.11.0) jars to hbase(0.96.1.1-hadoop2) && hbase
> jars to hive
> 4. Trying to create a table in hive with hbase properties but gets error as
>
>
> *FAILED: Error in metadata: MetaException(message:java.io.IOException:
> java.lang.reflect.InvocationTargetException*
>
>
> I think so hbase-0.96.1.1-hadoop2.jar file is not present in HBase
> directory.
>
> So, Suggest for further step to proceed.
>
>
> On Thu, Mar 13, 2014 at 7:12 PM, kulkarni.swarnim@gmail.com <
> kulkarni.swarnim@gmail.com> wrote:
>
>> Hi Sai,
>>
>> If you can show us what specific exception you are seeing, we would be
>> able
>> to help you out in a better way.
>>
>> Thanks,
>>
>>
>> On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpavan@gmail.com
>> >wrote:
>>
>> > Hi,
>> > Thanks for reply... but
>> >
>> > I worked with hadoop-1.2.1 which is fine working, but need with real
>> > requirement is Hadoop-2.2.0 i.e, YARN
>> >
>> > Please show the way to get solve with apache products
>> >
>> > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
>> > hive-0.11.0 too,
>> >
>> > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar,
>> zookeeper.jar
>> >
>> > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and
>> worked
>> > but not getting connected with hive. I suppose to work with
>> hadoop-0.94.x
>> > but the version is not compatible with hadoop-2.2.0
>> >
>> > I tried in all the way, not found the solution, please suggest me
>> >
>> >
>> >
>> >
>> > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Rekha_Joshi@intuit.com
>> > >wrote:
>> >
>> > > Hi,
>> > >
>> > > We have successfully created external hive table pointing to hbase
>> table
>> > > with settings for hive, zookeeper, HBase security tokens.
>> > >
>> > > If it is a jar problem, then mostly the env is not set correctly.Hive
>> > > should be able to recognize HBaseStorageHandler.
>> > >
>> > > Thanks
>> > > Rekha
>> > >
>> > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
>> > >
>> > >
>> > >
>> > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
>> > >
>> > > >Hi,
>> > > >
>> > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0
>> version
>> > > >for a project. I got a requirement such that i have to integrate
>> hbase
>> > to
>> > > >hive , so that table reflection should happens.
>> > > >
>> > > >while i am doing this, i got error like TARGET INNOVOCATION
>> EXCEPTION.
>> > > >This is because jar file target missing. please suggest me to
>> overcome
>> > the
>> > > >problem
>> > > >
>> > > >--
>> > > >*THANKS & REGARDS,*
>> > > >G.SAI PAVAN,
>> > > >CCDH4 CERTIFIED,
>> > > >Ph: 8121914494,
>> > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
>> > > >linkedin profile <
>> > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
>> > > >HYDERABAD.
>> > >
>> > >
>> >
>> >
>> > --
>> > *THANKS & REGARDS,*
>> > G.SAI PAVAN,
>> > CCDH4 CERTIFIED,
>> > Ph: 8121914494,
>> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
>> > linkedin profile <
>> http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
>> > HYDERABAD.
>> >
>>
>>
>>
>> --
>> Swarnim
>>
>
>
>
> --
> *THANKS & REGARDS,*
> G.SAI PAVAN,
> CCDH4 CERTIFIED,
> Ph: 8121914494,
> *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> HYDERABAD.
>
Re: HBase- Hive Integration
Posted by Sai Pavan Gadde <id...@gmail.com>.
Hi,
Here is my document in an attached file. It contains my flow of hive-hbase
integration.
1. I created a table in mysql and imported into hbase,
2. I copied a hive-handler.jar, guva.jar and zookeeper.jar file in
Hadoop-2.2.0/share/mapred/lib folder
3. copied required hive(0.11.0) jars to hbase(0.96.1.1-hadoop2) && hbase
jars to hive
4. Trying to create a table in hive with hbase properties but gets error as
*FAILED: Error in metadata: MetaException(message:java.io.IOException:
java.lang.reflect.InvocationTargetException*
I think so hbase-0.96.1.1-hadoop2.jar file is not present in HBase
directory.
So, Suggest for further step to proceed.
On Thu, Mar 13, 2014 at 7:12 PM, kulkarni.swarnim@gmail.com <
kulkarni.swarnim@gmail.com> wrote:
> Hi Sai,
>
> If you can show us what specific exception you are seeing, we would be able
> to help you out in a better way.
>
> Thanks,
>
>
> On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpavan@gmail.com
> >wrote:
>
> > Hi,
> > Thanks for reply... but
> >
> > I worked with hadoop-1.2.1 which is fine working, but need with real
> > requirement is Hadoop-2.2.0 i.e, YARN
> >
> > Please show the way to get solve with apache products
> >
> > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
> > hive-0.11.0 too,
> >
> > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar, zookeeper.jar
> >
> > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and
> worked
> > but not getting connected with hive. I suppose to work with hadoop-0.94.x
> > but the version is not compatible with hadoop-2.2.0
> >
> > I tried in all the way, not found the solution, please suggest me
> >
> >
> >
> >
> > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Rekha_Joshi@intuit.com
> > >wrote:
> >
> > > Hi,
> > >
> > > We have successfully created external hive table pointing to hbase
> table
> > > with settings for hive, zookeeper, HBase security tokens.
> > >
> > > If it is a jar problem, then mostly the env is not set correctly.Hive
> > > should be able to recognize HBaseStorageHandler.
> > >
> > > Thanks
> > > Rekha
> > >
> > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
> > >
> > >
> > >
> > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
> > >
> > > >Hi,
> > > >
> > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0
> version
> > > >for a project. I got a requirement such that i have to integrate hbase
> > to
> > > >hive , so that table reflection should happens.
> > > >
> > > >while i am doing this, i got error like TARGET INNOVOCATION
> EXCEPTION.
> > > >This is because jar file target missing. please suggest me to overcome
> > the
> > > >problem
> > > >
> > > >--
> > > >*THANKS & REGARDS,*
> > > >G.SAI PAVAN,
> > > >CCDH4 CERTIFIED,
> > > >Ph: 8121914494,
> > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> > > >linkedin profile <
> > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> > > >HYDERABAD.
> > >
> > >
> >
> >
> > --
> > *THANKS & REGARDS,*
> > G.SAI PAVAN,
> > CCDH4 CERTIFIED,
> > Ph: 8121914494,
> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> > linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/
> >
> > HYDERABAD.
> >
>
>
>
> --
> Swarnim
>
--
*THANKS & REGARDS,*
G.SAI PAVAN,
CCDH4 CERTIFIED,
Ph: 8121914494,
*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
HYDERABAD.
RE: HBase- Hive Integration
Posted by "Tapper, Gunnar" <gu...@hp.com>.
0.94 AFAIK. I'll ask one of the people working on Trafodion to provide more info. Stay tuned.
Sincerely,
Gunnar
“People don’t know what they want until you show it to them… Our task is to read things that are not yet on the page.” — Steve Jobs
-----Original Message-----
From: Jean-Marc Spaggiari [mailto:jean-marc@spaggiari.org]
Sent: Thursday, March 13, 2014 7:55 PM
To: user
Subject: Re: HBase- Hive Integration
Oh, nice! Do you know where we can download the source?
I will try to take a look at it and see with which HBase versions it works.
Thanks for sharing the info.
JM
2014-03-13 21:39 GMT-04:00 Tapper, Gunnar <gu...@hp.com>:
> Yes. Refer to:
> http://www.hpl.hp.com/research/trafodion/architecture.htm
>
> As you can see, Trafodion can sit on top of both HBase and Hive. You
> can access native HBase tables as well as Trafodion-created tables
> using ANSI SQL.
>
> Sincerely,
>
> Gunnar
>
> “People don’t know what they want until you show it to them… Our task
> is to read things that are not yet on the page.” — Steve Jobs
>
>
>
>
> -----Original Message-----
> From: Jean-Marc Spaggiari [mailto:jean-marc@spaggiari.org]
> Sent: Thursday, March 13, 2014 6:59 PM
> To: user
> Subject: Re: HBase- Hive Integration
>
> Is Trafodion working on top of HBase like Phoenix? Or is it something
> not related?
>
>
> 2014-03-13 19:07 GMT-04:00 Tapper, Gunnar <gu...@hp.com>:
>
> > Or, try out Trafodion: http://www.hpl.hp.com/research/trafodion.htm
> >
> > Sincerely,
> >
> > Gunnar
> >
> >
> > -----Original Message-----
> > From: Jean-Marc Spaggiari [mailto:jean-marc@spaggiari.org]
> > Sent: Thursday, March 13, 2014 9:36 AM
> > To: user
> > Subject: Re: HBase- Hive Integration
> >
> > If you want to run SQL queries on top of HBase table, I will expect
> > Phoenix to do better than Hive...
> >
> >
> > 2014-03-13 9:42 GMT-04:00 kulkarni.swarnim@gmail.com <
> > kulkarni.swarnim@gmail.com>:
> >
> > > Hi Sai,
> > >
> > > If you can show us what specific exception you are seeing, we
> > > would be able to help you out in a better way.
> > >
> > > Thanks,
> > >
> > >
> > > On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde
> > > <id4gpavan@gmail.com
> > > >wrote:
> > >
> > > > Hi,
> > > > Thanks for reply... but
> > > >
> > > > I worked with hadoop-1.2.1 which is fine working, but need with
> > > > real requirement is Hadoop-2.2.0 i.e, YARN
> > > >
> > > > Please show the way to get solve with apache products
> > > >
> > > > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0,
> > > > installed
> > > > hive-0.11.0 too,
> > > >
> > > > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar,
> > > > zookeeper.jar
> > > >
> > > > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version)
> > > > and
> > > worked
> > > > but not getting connected with hive. I suppose to work with
> > > > hadoop-0.94.x but the version is not compatible with
> > > > hadoop-2.2.0
> > > >
> > > > I tried in all the way, not found the solution, please suggest
> > > > me
> > > >
> > > >
> > > >
> > > >
> > > > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha
> > > > <Rekha_Joshi@intuit.com
> > > > >wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > We have successfully created external hive table pointing to
> > > > > hbase
> > > table
> > > > > with settings for hive, zookeeper, HBase security tokens.
> > > > >
> > > > > If it is a jar problem, then mostly the env is not set
> > > > > correctly.Hive should be able to recognize HBaseStorageHandler.
> > > > >
> > > > > Thanks
> > > > > Rekha
> > > > >
> > > > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-
> > > > > pa
> > > > > rt
> > > > > -2/
> > > > >
> > > > >
> > > > >
> > > > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com>
> wrote:
> > > > >
> > > > > >Hi,
> > > > > >
> > > > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and
> > > > > >hive-0.11.0
> > > version
> > > > > >for a project. I got a requirement such that i have to
> > > > > >integrate hbase
> > > > to
> > > > > >hive , so that table reflection should happens.
> > > > > >
> > > > > >while i am doing this, i got error like TARGET INNOVOCATION
> > > EXCEPTION.
> > > > > >This is because jar file target missing. please suggest me to
> > > > > >overcome
> > > > the
> > > > > >problem
> > > > > >
> > > > > >--
> > > > > >*THANKS & REGARDS,*
> > > > > >G.SAI PAVAN,
> > > > > >CCDH4 CERTIFIED,
> > > > > >Ph: 8121914494,
> > > > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> > > > > >linkedin profile <
> > > > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> > > > > >HYDERABAD.
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > *THANKS & REGARDS,*
> > > > G.SAI PAVAN,
> > > > CCDH4 CERTIFIED,
> > > > Ph: 8121914494,
> > > > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>* linkedin
> > > > profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/
> > > >
> > > > HYDERABAD.
> > > >
> > >
> > >
> > >
> > > --
> > > Swarnim
> > >
> >
>
Re: HBase- Hive Integration
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Oh, nice! Do you know where we can download the source?
I will try to take a look at it and see with which HBase versions it works.
Thanks for sharing the info.
JM
2014-03-13 21:39 GMT-04:00 Tapper, Gunnar <gu...@hp.com>:
> Yes. Refer to: http://www.hpl.hp.com/research/trafodion/architecture.htm
>
> As you can see, Trafodion can sit on top of both HBase and Hive. You can
> access native HBase tables as well as Trafodion-created tables using ANSI
> SQL.
>
> Sincerely,
>
> Gunnar
>
> “People don’t know what they want until you show it to them… Our task is
> to read things that are not yet on the page.” — Steve Jobs
>
>
>
>
> -----Original Message-----
> From: Jean-Marc Spaggiari [mailto:jean-marc@spaggiari.org]
> Sent: Thursday, March 13, 2014 6:59 PM
> To: user
> Subject: Re: HBase- Hive Integration
>
> Is Trafodion working on top of HBase like Phoenix? Or is it something not
> related?
>
>
> 2014-03-13 19:07 GMT-04:00 Tapper, Gunnar <gu...@hp.com>:
>
> > Or, try out Trafodion: http://www.hpl.hp.com/research/trafodion.htm
> >
> > Sincerely,
> >
> > Gunnar
> >
> >
> > -----Original Message-----
> > From: Jean-Marc Spaggiari [mailto:jean-marc@spaggiari.org]
> > Sent: Thursday, March 13, 2014 9:36 AM
> > To: user
> > Subject: Re: HBase- Hive Integration
> >
> > If you want to run SQL queries on top of HBase table, I will expect
> > Phoenix to do better than Hive...
> >
> >
> > 2014-03-13 9:42 GMT-04:00 kulkarni.swarnim@gmail.com <
> > kulkarni.swarnim@gmail.com>:
> >
> > > Hi Sai,
> > >
> > > If you can show us what specific exception you are seeing, we would
> > > be able to help you out in a better way.
> > >
> > > Thanks,
> > >
> > >
> > > On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde
> > > <id4gpavan@gmail.com
> > > >wrote:
> > >
> > > > Hi,
> > > > Thanks for reply... but
> > > >
> > > > I worked with hadoop-1.2.1 which is fine working, but need with
> > > > real requirement is Hadoop-2.2.0 i.e, YARN
> > > >
> > > > Please show the way to get solve with apache products
> > > >
> > > > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0,
> > > > installed
> > > > hive-0.11.0 too,
> > > >
> > > > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar,
> > > > zookeeper.jar
> > > >
> > > > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version)
> > > > and
> > > worked
> > > > but not getting connected with hive. I suppose to work with
> > > > hadoop-0.94.x but the version is not compatible with hadoop-2.2.0
> > > >
> > > > I tried in all the way, not found the solution, please suggest me
> > > >
> > > >
> > > >
> > > >
> > > > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha
> > > > <Rekha_Joshi@intuit.com
> > > > >wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > We have successfully created external hive table pointing to
> > > > > hbase
> > > table
> > > > > with settings for hive, zookeeper, HBase security tokens.
> > > > >
> > > > > If it is a jar problem, then mostly the env is not set
> > > > > correctly.Hive should be able to recognize HBaseStorageHandler.
> > > > >
> > > > > Thanks
> > > > > Rekha
> > > > >
> > > > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-pa
> > > > > rt
> > > > > -2/
> > > > >
> > > > >
> > > > >
> > > > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com>
> wrote:
> > > > >
> > > > > >Hi,
> > > > > >
> > > > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and
> > > > > >hive-0.11.0
> > > version
> > > > > >for a project. I got a requirement such that i have to
> > > > > >integrate hbase
> > > > to
> > > > > >hive , so that table reflection should happens.
> > > > > >
> > > > > >while i am doing this, i got error like TARGET INNOVOCATION
> > > EXCEPTION.
> > > > > >This is because jar file target missing. please suggest me to
> > > > > >overcome
> > > > the
> > > > > >problem
> > > > > >
> > > > > >--
> > > > > >*THANKS & REGARDS,*
> > > > > >G.SAI PAVAN,
> > > > > >CCDH4 CERTIFIED,
> > > > > >Ph: 8121914494,
> > > > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>* linkedin
> > > > > >profile <
> > > > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> > > > > >HYDERABAD.
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > *THANKS & REGARDS,*
> > > > G.SAI PAVAN,
> > > > CCDH4 CERTIFIED,
> > > > Ph: 8121914494,
> > > > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>* linkedin
> > > > profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/
> > > >
> > > > HYDERABAD.
> > > >
> > >
> > >
> > >
> > > --
> > > Swarnim
> > >
> >
>
RE: HBase- Hive Integration
Posted by "Tapper, Gunnar" <gu...@hp.com>.
Yes. Refer to: http://www.hpl.hp.com/research/trafodion/architecture.htm
As you can see, Trafodion can sit on top of both HBase and Hive. You can access native HBase tables as well as Trafodion-created tables using ANSI SQL.
Sincerely,
Gunnar
“People don’t know what they want until you show it to them… Our task is to read things that are not yet on the page.” — Steve Jobs
-----Original Message-----
From: Jean-Marc Spaggiari [mailto:jean-marc@spaggiari.org]
Sent: Thursday, March 13, 2014 6:59 PM
To: user
Subject: Re: HBase- Hive Integration
Is Trafodion working on top of HBase like Phoenix? Or is it something not related?
2014-03-13 19:07 GMT-04:00 Tapper, Gunnar <gu...@hp.com>:
> Or, try out Trafodion: http://www.hpl.hp.com/research/trafodion.htm
>
> Sincerely,
>
> Gunnar
>
>
> -----Original Message-----
> From: Jean-Marc Spaggiari [mailto:jean-marc@spaggiari.org]
> Sent: Thursday, March 13, 2014 9:36 AM
> To: user
> Subject: Re: HBase- Hive Integration
>
> If you want to run SQL queries on top of HBase table, I will expect
> Phoenix to do better than Hive...
>
>
> 2014-03-13 9:42 GMT-04:00 kulkarni.swarnim@gmail.com <
> kulkarni.swarnim@gmail.com>:
>
> > Hi Sai,
> >
> > If you can show us what specific exception you are seeing, we would
> > be able to help you out in a better way.
> >
> > Thanks,
> >
> >
> > On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde
> > <id4gpavan@gmail.com
> > >wrote:
> >
> > > Hi,
> > > Thanks for reply... but
> > >
> > > I worked with hadoop-1.2.1 which is fine working, but need with
> > > real requirement is Hadoop-2.2.0 i.e, YARN
> > >
> > > Please show the way to get solve with apache products
> > >
> > > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0,
> > > installed
> > > hive-0.11.0 too,
> > >
> > > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar,
> > > zookeeper.jar
> > >
> > > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version)
> > > and
> > worked
> > > but not getting connected with hive. I suppose to work with
> > > hadoop-0.94.x but the version is not compatible with hadoop-2.2.0
> > >
> > > I tried in all the way, not found the solution, please suggest me
> > >
> > >
> > >
> > >
> > > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha
> > > <Rekha_Joshi@intuit.com
> > > >wrote:
> > >
> > > > Hi,
> > > >
> > > > We have successfully created external hive table pointing to
> > > > hbase
> > table
> > > > with settings for hive, zookeeper, HBase security tokens.
> > > >
> > > > If it is a jar problem, then mostly the env is not set
> > > > correctly.Hive should be able to recognize HBaseStorageHandler.
> > > >
> > > > Thanks
> > > > Rekha
> > > >
> > > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-pa
> > > > rt
> > > > -2/
> > > >
> > > >
> > > >
> > > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
> > > >
> > > > >Hi,
> > > > >
> > > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and
> > > > >hive-0.11.0
> > version
> > > > >for a project. I got a requirement such that i have to
> > > > >integrate hbase
> > > to
> > > > >hive , so that table reflection should happens.
> > > > >
> > > > >while i am doing this, i got error like TARGET INNOVOCATION
> > EXCEPTION.
> > > > >This is because jar file target missing. please suggest me to
> > > > >overcome
> > > the
> > > > >problem
> > > > >
> > > > >--
> > > > >*THANKS & REGARDS,*
> > > > >G.SAI PAVAN,
> > > > >CCDH4 CERTIFIED,
> > > > >Ph: 8121914494,
> > > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>* linkedin
> > > > >profile <
> > > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> > > > >HYDERABAD.
> > > >
> > > >
> > >
> > >
> > > --
> > > *THANKS & REGARDS,*
> > > G.SAI PAVAN,
> > > CCDH4 CERTIFIED,
> > > Ph: 8121914494,
> > > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>* linkedin
> > > profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/
> > >
> > > HYDERABAD.
> > >
> >
> >
> >
> > --
> > Swarnim
> >
>
Re: HBase- Hive Integration
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Is Trafodion working on top of HBase like Phoenix? Or is it something not
related?
2014-03-13 19:07 GMT-04:00 Tapper, Gunnar <gu...@hp.com>:
> Or, try out Trafodion: http://www.hpl.hp.com/research/trafodion.htm
>
> Sincerely,
>
> Gunnar
>
>
> -----Original Message-----
> From: Jean-Marc Spaggiari [mailto:jean-marc@spaggiari.org]
> Sent: Thursday, March 13, 2014 9:36 AM
> To: user
> Subject: Re: HBase- Hive Integration
>
> If you want to run SQL queries on top of HBase table, I will expect
> Phoenix to do better than Hive...
>
>
> 2014-03-13 9:42 GMT-04:00 kulkarni.swarnim@gmail.com <
> kulkarni.swarnim@gmail.com>:
>
> > Hi Sai,
> >
> > If you can show us what specific exception you are seeing, we would be
> > able to help you out in a better way.
> >
> > Thanks,
> >
> >
> > On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpavan@gmail.com
> > >wrote:
> >
> > > Hi,
> > > Thanks for reply... but
> > >
> > > I worked with hadoop-1.2.1 which is fine working, but need with real
> > > requirement is Hadoop-2.2.0 i.e, YARN
> > >
> > > Please show the way to get solve with apache products
> > >
> > > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
> > > hive-0.11.0 too,
> > >
> > > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar,
> > > zookeeper.jar
> > >
> > > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and
> > worked
> > > but not getting connected with hive. I suppose to work with
> > > hadoop-0.94.x but the version is not compatible with hadoop-2.2.0
> > >
> > > I tried in all the way, not found the solution, please suggest me
> > >
> > >
> > >
> > >
> > > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha
> > > <Rekha_Joshi@intuit.com
> > > >wrote:
> > >
> > > > Hi,
> > > >
> > > > We have successfully created external hive table pointing to hbase
> > table
> > > > with settings for hive, zookeeper, HBase security tokens.
> > > >
> > > > If it is a jar problem, then mostly the env is not set
> > > > correctly.Hive should be able to recognize HBaseStorageHandler.
> > > >
> > > > Thanks
> > > > Rekha
> > > >
> > > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part
> > > > -2/
> > > >
> > > >
> > > >
> > > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
> > > >
> > > > >Hi,
> > > > >
> > > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0
> > version
> > > > >for a project. I got a requirement such that i have to integrate
> > > > >hbase
> > > to
> > > > >hive , so that table reflection should happens.
> > > > >
> > > > >while i am doing this, i got error like TARGET INNOVOCATION
> > EXCEPTION.
> > > > >This is because jar file target missing. please suggest me to
> > > > >overcome
> > > the
> > > > >problem
> > > > >
> > > > >--
> > > > >*THANKS & REGARDS,*
> > > > >G.SAI PAVAN,
> > > > >CCDH4 CERTIFIED,
> > > > >Ph: 8121914494,
> > > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>* linkedin
> > > > >profile <
> > > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> > > > >HYDERABAD.
> > > >
> > > >
> > >
> > >
> > > --
> > > *THANKS & REGARDS,*
> > > G.SAI PAVAN,
> > > CCDH4 CERTIFIED,
> > > Ph: 8121914494,
> > > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>* linkedin
> > > profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/
> > >
> > > HYDERABAD.
> > >
> >
> >
> >
> > --
> > Swarnim
> >
>
RE: HBase- Hive Integration
Posted by "Tapper, Gunnar" <gu...@hp.com>.
Or, try out Trafodion: http://www.hpl.hp.com/research/trafodion.htm
Sincerely,
Gunnar
-----Original Message-----
From: Jean-Marc Spaggiari [mailto:jean-marc@spaggiari.org]
Sent: Thursday, March 13, 2014 9:36 AM
To: user
Subject: Re: HBase- Hive Integration
If you want to run SQL queries on top of HBase table, I will expect Phoenix to do better than Hive...
2014-03-13 9:42 GMT-04:00 kulkarni.swarnim@gmail.com <
kulkarni.swarnim@gmail.com>:
> Hi Sai,
>
> If you can show us what specific exception you are seeing, we would be
> able to help you out in a better way.
>
> Thanks,
>
>
> On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpavan@gmail.com
> >wrote:
>
> > Hi,
> > Thanks for reply... but
> >
> > I worked with hadoop-1.2.1 which is fine working, but need with real
> > requirement is Hadoop-2.2.0 i.e, YARN
> >
> > Please show the way to get solve with apache products
> >
> > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
> > hive-0.11.0 too,
> >
> > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar,
> > zookeeper.jar
> >
> > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and
> worked
> > but not getting connected with hive. I suppose to work with
> > hadoop-0.94.x but the version is not compatible with hadoop-2.2.0
> >
> > I tried in all the way, not found the solution, please suggest me
> >
> >
> >
> >
> > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha
> > <Rekha_Joshi@intuit.com
> > >wrote:
> >
> > > Hi,
> > >
> > > We have successfully created external hive table pointing to hbase
> table
> > > with settings for hive, zookeeper, HBase security tokens.
> > >
> > > If it is a jar problem, then mostly the env is not set
> > > correctly.Hive should be able to recognize HBaseStorageHandler.
> > >
> > > Thanks
> > > Rekha
> > >
> > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part
> > > -2/
> > >
> > >
> > >
> > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
> > >
> > > >Hi,
> > > >
> > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0
> version
> > > >for a project. I got a requirement such that i have to integrate
> > > >hbase
> > to
> > > >hive , so that table reflection should happens.
> > > >
> > > >while i am doing this, i got error like TARGET INNOVOCATION
> EXCEPTION.
> > > >This is because jar file target missing. please suggest me to
> > > >overcome
> > the
> > > >problem
> > > >
> > > >--
> > > >*THANKS & REGARDS,*
> > > >G.SAI PAVAN,
> > > >CCDH4 CERTIFIED,
> > > >Ph: 8121914494,
> > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>* linkedin
> > > >profile <
> > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> > > >HYDERABAD.
> > >
> > >
> >
> >
> > --
> > *THANKS & REGARDS,*
> > G.SAI PAVAN,
> > CCDH4 CERTIFIED,
> > Ph: 8121914494,
> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>* linkedin
> > profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/
> >
> > HYDERABAD.
> >
>
>
>
> --
> Swarnim
>
Re: HBase- Hive Integration
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
If you want to run SQL queries on top of HBase table, I will expect Phoenix
to do better than Hive...
2014-03-13 9:42 GMT-04:00 kulkarni.swarnim@gmail.com <
kulkarni.swarnim@gmail.com>:
> Hi Sai,
>
> If you can show us what specific exception you are seeing, we would be able
> to help you out in a better way.
>
> Thanks,
>
>
> On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpavan@gmail.com
> >wrote:
>
> > Hi,
> > Thanks for reply... but
> >
> > I worked with hadoop-1.2.1 which is fine working, but need with real
> > requirement is Hadoop-2.2.0 i.e, YARN
> >
> > Please show the way to get solve with apache products
> >
> > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
> > hive-0.11.0 too,
> >
> > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar, zookeeper.jar
> >
> > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and
> worked
> > but not getting connected with hive. I suppose to work with hadoop-0.94.x
> > but the version is not compatible with hadoop-2.2.0
> >
> > I tried in all the way, not found the solution, please suggest me
> >
> >
> >
> >
> > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Rekha_Joshi@intuit.com
> > >wrote:
> >
> > > Hi,
> > >
> > > We have successfully created external hive table pointing to hbase
> table
> > > with settings for hive, zookeeper, HBase security tokens.
> > >
> > > If it is a jar problem, then mostly the env is not set correctly.Hive
> > > should be able to recognize HBaseStorageHandler.
> > >
> > > Thanks
> > > Rekha
> > >
> > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
> > >
> > >
> > >
> > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
> > >
> > > >Hi,
> > > >
> > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0
> version
> > > >for a project. I got a requirement such that i have to integrate hbase
> > to
> > > >hive , so that table reflection should happens.
> > > >
> > > >while i am doing this, i got error like TARGET INNOVOCATION
> EXCEPTION.
> > > >This is because jar file target missing. please suggest me to overcome
> > the
> > > >problem
> > > >
> > > >--
> > > >*THANKS & REGARDS,*
> > > >G.SAI PAVAN,
> > > >CCDH4 CERTIFIED,
> > > >Ph: 8121914494,
> > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> > > >linkedin profile <
> > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> > > >HYDERABAD.
> > >
> > >
> >
> >
> > --
> > *THANKS & REGARDS,*
> > G.SAI PAVAN,
> > CCDH4 CERTIFIED,
> > Ph: 8121914494,
> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> > linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/
> >
> > HYDERABAD.
> >
>
>
>
> --
> Swarnim
>
Re: HBase- Hive Integration
Posted by Sai Pavan Gadde <id...@gmail.com>.
Hi,
Here is my document in an attached file. It contains my flow of hive-hbase
integration.
1. I created a table in mysql and imported into hbase,
2. I copied a hive-handler.jar, guva.jar and zookeeper.jar file in
Hadoop-2.2.0/share/mapred/lib folder
3. copied required hive(0.11.0) jars to hbase(0.96.1.1-hadoop2) && hbase
jars to hive
4. Trying to create a table in hive with hbase properties but gets error as
*FAILED: Error in metadata: MetaException(message:java.io.IOException:
java.lang.reflect.InvocationTargetException*
I think so hbase-0.96.1.1-hadoop2.jar file is not present in HBase
directory.
So, Suggest for further step to proceed.
On Thu, Mar 13, 2014 at 7:12 PM, kulkarni.swarnim@gmail.com <
kulkarni.swarnim@gmail.com> wrote:
> Hi Sai,
>
> If you can show us what specific exception you are seeing, we would be able
> to help you out in a better way.
>
> Thanks,
>
>
> On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpavan@gmail.com
> >wrote:
>
> > Hi,
> > Thanks for reply... but
> >
> > I worked with hadoop-1.2.1 which is fine working, but need with real
> > requirement is Hadoop-2.2.0 i.e, YARN
> >
> > Please show the way to get solve with apache products
> >
> > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
> > hive-0.11.0 too,
> >
> > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar, zookeeper.jar
> >
> > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and
> worked
> > but not getting connected with hive. I suppose to work with hadoop-0.94.x
> > but the version is not compatible with hadoop-2.2.0
> >
> > I tried in all the way, not found the solution, please suggest me
> >
> >
> >
> >
> > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Rekha_Joshi@intuit.com
> > >wrote:
> >
> > > Hi,
> > >
> > > We have successfully created external hive table pointing to hbase
> table
> > > with settings for hive, zookeeper, HBase security tokens.
> > >
> > > If it is a jar problem, then mostly the env is not set correctly.Hive
> > > should be able to recognize HBaseStorageHandler.
> > >
> > > Thanks
> > > Rekha
> > >
> > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
> > >
> > >
> > >
> > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
> > >
> > > >Hi,
> > > >
> > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0
> version
> > > >for a project. I got a requirement such that i have to integrate hbase
> > to
> > > >hive , so that table reflection should happens.
> > > >
> > > >while i am doing this, i got error like TARGET INNOVOCATION
> EXCEPTION.
> > > >This is because jar file target missing. please suggest me to overcome
> > the
> > > >problem
> > > >
> > > >--
> > > >*THANKS & REGARDS,*
> > > >G.SAI PAVAN,
> > > >CCDH4 CERTIFIED,
> > > >Ph: 8121914494,
> > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> > > >linkedin profile <
> > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> > > >HYDERABAD.
> > >
> > >
> >
> >
> > --
> > *THANKS & REGARDS,*
> > G.SAI PAVAN,
> > CCDH4 CERTIFIED,
> > Ph: 8121914494,
> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> > linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/
> >
> > HYDERABAD.
> >
>
>
>
> --
> Swarnim
>
--
*THANKS & REGARDS,*
G.SAI PAVAN,
CCDH4 CERTIFIED,
Ph: 8121914494,
*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
HYDERABAD.
Re: HBase- Hive Integration
Posted by "kulkarni.swarnim@gmail.com" <ku...@gmail.com>.
Hi Sai,
If you can show us what specific exception you are seeing, we would be able
to help you out in a better way.
Thanks,
On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id...@gmail.com>wrote:
> Hi,
> Thanks for reply... but
>
> I worked with hadoop-1.2.1 which is fine working, but need with real
> requirement is Hadoop-2.2.0 i.e, YARN
>
> Please show the way to get solve with apache products
>
> I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
> hive-0.11.0 too,
>
> Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar, zookeeper.jar
>
> I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and worked
> but not getting connected with hive. I suppose to work with hadoop-0.94.x
> but the version is not compatible with hadoop-2.2.0
>
> I tried in all the way, not found the solution, please suggest me
>
>
>
>
> On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Rekha_Joshi@intuit.com
> >wrote:
>
> > Hi,
> >
> > We have successfully created external hive table pointing to hbase table
> > with settings for hive, zookeeper, HBase security tokens.
> >
> > If it is a jar problem, then mostly the env is not set correctly.Hive
> > should be able to recognize HBaseStorageHandler.
> >
> > Thanks
> > Rekha
> >
> > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
> >
> >
> >
> > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
> >
> > >Hi,
> > >
> > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0 version
> > >for a project. I got a requirement such that i have to integrate hbase
> to
> > >hive , so that table reflection should happens.
> > >
> > >while i am doing this, i got error like TARGET INNOVOCATION EXCEPTION.
> > >This is because jar file target missing. please suggest me to overcome
> the
> > >problem
> > >
> > >--
> > >*THANKS & REGARDS,*
> > >G.SAI PAVAN,
> > >CCDH4 CERTIFIED,
> > >Ph: 8121914494,
> > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> > >linkedin profile <
> http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> > >HYDERABAD.
> >
> >
>
>
> --
> *THANKS & REGARDS,*
> G.SAI PAVAN,
> CCDH4 CERTIFIED,
> Ph: 8121914494,
> *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> HYDERABAD.
>
--
Swarnim
Re: HBase- Hive Integration
Posted by Sai Pavan Gadde <id...@gmail.com>.
Hi,
Thanks for reply... but
I worked with hadoop-1.2.1 which is fine working, but need with real
requirement is Hadoop-2.2.0 i.e, YARN
Please show the way to get solve with apache products
I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
hive-0.11.0 too,
Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar, zookeeper.jar
I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and worked
but not getting connected with hive. I suppose to work with hadoop-0.94.x
but the version is not compatible with hadoop-2.2.0
I tried in all the way, not found the solution, please suggest me
On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Re...@intuit.com>wrote:
> Hi,
>
> We have successfully created external hive table pointing to hbase table
> with settings for hive, zookeeper, HBase security tokens.
>
> If it is a jar problem, then mostly the env is not set correctly.Hive
> should be able to recognize HBaseStorageHandler.
>
> Thanks
> Rekha
>
> http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
>
>
>
> On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
>
> >Hi,
> >
> >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0 version
> >for a project. I got a requirement such that i have to integrate hbase to
> >hive , so that table reflection should happens.
> >
> >while i am doing this, i got error like TARGET INNOVOCATION EXCEPTION.
> >This is because jar file target missing. please suggest me to overcome the
> >problem
> >
> >--
> >*THANKS & REGARDS,*
> >G.SAI PAVAN,
> >CCDH4 CERTIFIED,
> >Ph: 8121914494,
> >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> >linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> >HYDERABAD.
>
>
--
*THANKS & REGARDS,*
G.SAI PAVAN,
CCDH4 CERTIFIED,
Ph: 8121914494,
*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
HYDERABAD.
Re: HBase- Hive Integration
Posted by Sai Pavan Gadde <id...@gmail.com>.
Hi,
Thanks for reply... but
I worked with hadoop-1.2.1 which is fine working, but need with real
requirement is Hadoop-2.2.0 i.e, YARN
Please show the way to get solve with apache products
I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
hive-0.11.0 too,
Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar, zookeeper.jar
I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and worked
but not getting connected with hive. I suppose to work with hadoop-0.94.x
but the version is not compatible with hadoop-2.2.0
I tried in all the way, not found the solution, please suggest me
On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Re...@intuit.com>wrote:
> Hi,
>
> We have successfully created external hive table pointing to hbase table
> with settings for hive, zookeeper, HBase security tokens.
>
> If it is a jar problem, then mostly the env is not set correctly.Hive
> should be able to recognize HBaseStorageHandler.
>
> Thanks
> Rekha
>
> http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
>
>
>
> On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
>
> >Hi,
> >
> >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0 version
> >for a project. I got a requirement such that i have to integrate hbase to
> >hive , so that table reflection should happens.
> >
> >while i am doing this, i got error like TARGET INNOVOCATION EXCEPTION.
> >This is because jar file target missing. please suggest me to overcome the
> >problem
> >
> >--
> >*THANKS & REGARDS,*
> >G.SAI PAVAN,
> >CCDH4 CERTIFIED,
> >Ph: 8121914494,
> >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> >linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> >HYDERABAD.
>
>
--
*THANKS & REGARDS,*
G.SAI PAVAN,
CCDH4 CERTIFIED,
Ph: 8121914494,
*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
HYDERABAD.
Re: HBase- Hive Integration
Posted by "Joshi, Rekha" <Re...@intuit.com>.
Hi,
We have successfully created external hive table pointing to hbase table
with settings for hive, zookeeper, HBase security tokens.
If it is a jar problem, then mostly the env is not set correctly.Hive
should be able to recognize HBaseStorageHandler.
Thanks
Rekha
http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
>Hi,
>
>I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0 version
>for a project. I got a requirement such that i have to integrate hbase to
>hive , so that table reflection should happens.
>
>while i am doing this, i got error like TARGET INNOVOCATION EXCEPTION.
>This is because jar file target missing. please suggest me to overcome the
>problem
>
>--
>*THANKS & REGARDS,*
>G.SAI PAVAN,
>CCDH4 CERTIFIED,
>Ph: 8121914494,
>*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
>linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
>HYDERABAD.
Re: HBase- Hive Integration
Posted by "Joshi, Rekha" <Re...@intuit.com>.
Hi,
We have successfully created external hive table pointing to hbase table
with settings for hive, zookeeper, HBase security tokens.
If it is a jar problem, then mostly the env is not set correctly.Hive
should be able to recognize HBaseStorageHandler.
Thanks
Rekha
http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id...@gmail.com> wrote:
>Hi,
>
>I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0 version
>for a project. I got a requirement such that i have to integrate hbase to
>hive , so that table reflection should happens.
>
>while i am doing this, i got error like TARGET INNOVOCATION EXCEPTION.
>This is because jar file target missing. please suggest me to overcome the
>problem
>
>--
>*THANKS & REGARDS,*
>G.SAI PAVAN,
>CCDH4 CERTIFIED,
>Ph: 8121914494,
>*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
>linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
>HYDERABAD.