You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Nishanth S <ni...@gmail.com> on 2014/12/05 18:54:35 UTC
Using Pig To Scan Hbase
Hey folks,
I am trying to write a map reduce in pig against my hbase table.I have a
salting in my rowkey appended with reverse timestamps ,so I guess the best
way is to do a scan for all the dates that I require to pull out
records.Does any one know if pig supports hbase scan out of the box or do
we need to write a udf for that.
Thannks,
Nishanth
Re: Using Pig To Scan Hbase
Posted by Nishanth S <ni...@gmail.com>.
Thank you Pradeep.That was helpful.
-Nishan
On Fri, Dec 5, 2014 at 11:08 AM, Pradeep Gollakota <pr...@gmail.com>
wrote:
> There is a built in storage handler for HBase. Take a look at the docs at
>
> https://pig.apache.org/docs/r0.14.0/api/org/apache/pig/backend/hadoop/hbase/HBaseStorage.html
>
> It doesn't support dealing with salted rowkeys (or reverse timestamps) out
> of the box, so you may have to munge with the data a little bit after it's
> loaded to get what you want.
>
> Hope this helps.
> Pradeep
>
> On Fri Dec 05 2014 at 9:55:04 AM Nishanth S <ni...@gmail.com>
> wrote:
>
> > Hey folks,
> >
> > I am trying to write a map reduce in pig against my hbase table.I have a
> > salting in my rowkey appended with reverse timestamps ,so I guess the
> best
> > way is to do a scan for all the dates that I require to pull out
> > records.Does any one know if pig supports hbase scan out of the box or
> do
> > we need to write a udf for that.
> >
> > Thannks,
> > Nishanth
> >
>
Re: Using Pig To Scan Hbase
Posted by Pradeep Gollakota <pr...@gmail.com>.
There is a built in storage handler for HBase. Take a look at the docs at
https://pig.apache.org/docs/r0.14.0/api/org/apache/pig/backend/hadoop/hbase/HBaseStorage.html
It doesn't support dealing with salted rowkeys (or reverse timestamps) out
of the box, so you may have to munge with the data a little bit after it's
loaded to get what you want.
Hope this helps.
Pradeep
On Fri Dec 05 2014 at 9:55:04 AM Nishanth S <ni...@gmail.com> wrote:
> Hey folks,
>
> I am trying to write a map reduce in pig against my hbase table.I have a
> salting in my rowkey appended with reverse timestamps ,so I guess the best
> way is to do a scan for all the dates that I require to pull out
> records.Does any one know if pig supports hbase scan out of the box or do
> we need to write a udf for that.
>
> Thannks,
> Nishanth
>