You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Barney Frank <ba...@gmail.com> on 2011/03/11 16:36:55 UTC
Reading Hbase data directly from HDFS
I am working with a partner who knows very little about Hbase, but has lots
of experience reading data from Hadoop/HDFS. He has existing connectors to
Hadoop so should I recommend that he use those to extract the HBASE data
into his existing data store? (He would only be reading data. I assume
writing would be problematic.) Hence there wouldn't be a need for
additional development work on his side outside of understanding how to read
my schema. What are the Pros/Cons of this approach? Could it be done?
Thanks for the advice.
Re: Reading Hbase data directly from HDFS
Posted by Stack <st...@duboce.net>.
What Lars said. Or point him at
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/TableInputFormat.html
Its form is probably familiar given his background (For more on hbase
and mapreduce, point him at
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/package-summary.html#package_description)
St.Ack
On Fri, Mar 11, 2011 at 8:19 AM, Lars George <la...@gmail.com> wrote:
> Hi,
>
> How is he supposed to read the data form HDFS? Reading the low level store files is difficult at the least and also does not take into account unflushed edits.
>
> You better provide him with the data on HDFS yourself using some sort of export or have him brush up on his API skillz.
>
> You could set up a Thrift or Rest server for him to retrieve the data.
>
> Lars
>
> On Mar 11, 2011, at 16:36, Barney Frank <ba...@gmail.com> wrote:
>
>> I am working with a partner who knows very little about Hbase, but has lots
>> of experience reading data from Hadoop/HDFS. He has existing connectors to
>> Hadoop so should I recommend that he use those to extract the HBASE data
>> into his existing data store? (He would only be reading data. I assume
>> writing would be problematic.) Hence there wouldn't be a need for
>> additional development work on his side outside of understanding how to read
>> my schema. What are the Pros/Cons of this approach? Could it be done?
>>
>> Thanks for the advice.
>
Re: Reading Hbase data directly from HDFS
Posted by Lars George <la...@gmail.com>.
Hi,
How is he supposed to read the data form HDFS? Reading the low level store files is difficult at the least and also does not take into account unflushed edits.
You better provide him with the data on HDFS yourself using some sort of export or have him brush up on his API skillz.
You could set up a Thrift or Rest server for him to retrieve the data.
Lars
On Mar 11, 2011, at 16:36, Barney Frank <ba...@gmail.com> wrote:
> I am working with a partner who knows very little about Hbase, but has lots
> of experience reading data from Hadoop/HDFS. He has existing connectors to
> Hadoop so should I recommend that he use those to extract the HBASE data
> into his existing data store? (He would only be reading data. I assume
> writing would be problematic.) Hence there wouldn't be a need for
> additional development work on his side outside of understanding how to read
> my schema. What are the Pros/Cons of this approach? Could it be done?
>
> Thanks for the advice.