You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jason Bourne <pr...@gmail.com> on 2011/02/02 07:33:12 UTC
Re: MapReduce Program for the bulkUpload into the hbase-0.89
Hi,
I need to upload the bulk load of data into the Hbase-0.89 using the Map
Reduce program, I tried with the MapReduce program sample available in the
Hbase-0.20.6 API documents. But when I used the same samples for the
Hbase-0.89, BatchUpdate class files are removed, Then I used the PUT to
insert the data. I gave up finally and I seeking help. Anyone succeeded in
the uploading the bulk load of data into the Hbase-0.89 using the MapReduce
program.
I need the Map Reduce code to do the BulkUpload
Regards
Jason
Re: MapReduce Program for the bulkUpload into the hbase-0.89
Posted by Stack <st...@duboce.net>.
See the MR jobs that ship w/ hbase. See here
http://hbase.apache.org/xref/org/apache/hadoop/hbase/mapreduce/package-summary.html.
There's the Import* jobs that will read from an HDFS source or there
is Exporter to read from HBase. Then there are unit tests at
src/test. You know these 'examples' work. There are examples that
use HBase as src and sink, etc.
Let us know what is missing.
St.Ack
On Wed, Feb 2, 2011 at 4:28 PM, praba karan <pr...@gmail.com> wrote:
> Yeah Mark!
>
> I proceeded certain distance and struct well. Need some more inputs from the
> well known guys. Well we ll wait with hope!!
>
>
>
>
> Regards
> Prabkaran
>
> On Wed, Feb 2, 2011 at 9:31 PM, Mark Kerzner <ma...@gmail.com> wrote:
>
>> Well Praba,
>>
>> we are in the same boat. I also feel that there is not enough published
>> examples, and I have started accumulating mine here,
>> http://hadoopinpractice.com/code.html
>>
>> <http://hadoopinpractice.com/code.html>Cheers,
>> Mark
>>
>> On Wed, Feb 2, 2011 at 9:56 AM, praba karan <pr...@gmail.com> wrote:
>>
>> > Yeah, I had seen this. I developed the Map Reduce program based on the
>> > Source Codes of Importtsv. I am getting an exception like
>> >
>> > "NoRegionForServer" exception. I am trying to resolve this too. So I am
>> > Requesting the users to post the complete Map Reduce program, so that
>> > Everyone can understand it without complexity
>> >
>> > I dont want to use the command line tools such as "completebulkload or
>> > importtsv"
>> >
>> > Thank you Mark
>> >
>> >
>> > Regards
>> > Prabakaran
>> >
>> > On Wed, Feb 2, 2011 at 9:18 PM, Stack <st...@duboce.net> wrote:
>> >
>> > > See http://hbase.apache.org/bulk-loads.html
>> > > St.Ack
>> > >
>> > > On Wed, Feb 2, 2011 at 3:26 PM, praba karan <pr...@gmail.com>
>> wrote:
>> > > > Thanks Mark,
>> > > >
>> > > > But this is now what I need?
>> > > >
>> > > > I am trying to upload the bulk of data from hdfs file system to the
>> > > > Hbase-0.89. I need the Map Reduce program for that.
>> > > >
>> > > >
>> > > > Regards
>> > > > Jason
>> > > >
>> > > >
>> > > > On Wed, Feb 2, 2011 at 7:46 PM, Mark Kerzner <ma...@gmail.com>
>> > > wrote:
>> > > >
>> > > >> Jason,
>> > > >>
>> > > >> attached is RowCounter.java from 0.90 test code - I think it has
>> what
>> > > you
>> > > >> need.
>> > > >>
>> > > >> Cheers,
>> > > >> Mark
>> > > >>
>> > > >>
>> > > >> On Wed, Feb 2, 2011 at 12:33 AM, Jason Bourne <pr...@gmail.com>
>> > > wrote:
>> > > >>
>> > > >>> Hi,
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>> I need to upload the bulk load of data into the Hbase-0.89 using
>> the
>> > > Map
>> > > >>> Reduce program, I tried with the MapReduce program sample available
>> > in
>> > > the
>> > > >>> Hbase-0.20.6 API documents. But when I used the same samples for
>> the
>> > > >>> Hbase-0.89, BatchUpdate class files are removed, Then I used the
>> PUT
>> > to
>> > > >>> insert the data. I gave up finally and I seeking help. Anyone
>> > succeeded
>> > > in
>> > > >>> the uploading the bulk load of data into the Hbase-0.89 using the
>> > > >>> MapReduce
>> > > >>> program.
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>> I need the Map Reduce code to do the BulkUpload
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>> Regards
>> > > >>>
>> > > >>> Jason
>> > > >>>
>> > > >>>
>> > > >>
>> > > >
>> > >
>> >
>>
>
Re: MapReduce Program for the bulkUpload into the hbase-0.89
Posted by praba karan <pr...@gmail.com>.
Yeah Mark!
I proceeded certain distance and struct well. Need some more inputs from the
well known guys. Well we ll wait with hope!!
Regards
Prabkaran
On Wed, Feb 2, 2011 at 9:31 PM, Mark Kerzner <ma...@gmail.com> wrote:
> Well Praba,
>
> we are in the same boat. I also feel that there is not enough published
> examples, and I have started accumulating mine here,
> http://hadoopinpractice.com/code.html
>
> <http://hadoopinpractice.com/code.html>Cheers,
> Mark
>
> On Wed, Feb 2, 2011 at 9:56 AM, praba karan <pr...@gmail.com> wrote:
>
> > Yeah, I had seen this. I developed the Map Reduce program based on the
> > Source Codes of Importtsv. I am getting an exception like
> >
> > "NoRegionForServer" exception. I am trying to resolve this too. So I am
> > Requesting the users to post the complete Map Reduce program, so that
> > Everyone can understand it without complexity
> >
> > I dont want to use the command line tools such as "completebulkload or
> > importtsv"
> >
> > Thank you Mark
> >
> >
> > Regards
> > Prabakaran
> >
> > On Wed, Feb 2, 2011 at 9:18 PM, Stack <st...@duboce.net> wrote:
> >
> > > See http://hbase.apache.org/bulk-loads.html
> > > St.Ack
> > >
> > > On Wed, Feb 2, 2011 at 3:26 PM, praba karan <pr...@gmail.com>
> wrote:
> > > > Thanks Mark,
> > > >
> > > > But this is now what I need?
> > > >
> > > > I am trying to upload the bulk of data from hdfs file system to the
> > > > Hbase-0.89. I need the Map Reduce program for that.
> > > >
> > > >
> > > > Regards
> > > > Jason
> > > >
> > > >
> > > > On Wed, Feb 2, 2011 at 7:46 PM, Mark Kerzner <ma...@gmail.com>
> > > wrote:
> > > >
> > > >> Jason,
> > > >>
> > > >> attached is RowCounter.java from 0.90 test code - I think it has
> what
> > > you
> > > >> need.
> > > >>
> > > >> Cheers,
> > > >> Mark
> > > >>
> > > >>
> > > >> On Wed, Feb 2, 2011 at 12:33 AM, Jason Bourne <pr...@gmail.com>
> > > wrote:
> > > >>
> > > >>> Hi,
> > > >>>
> > > >>>
> > > >>>
> > > >>> I need to upload the bulk load of data into the Hbase-0.89 using
> the
> > > Map
> > > >>> Reduce program, I tried with the MapReduce program sample available
> > in
> > > the
> > > >>> Hbase-0.20.6 API documents. But when I used the same samples for
> the
> > > >>> Hbase-0.89, BatchUpdate class files are removed, Then I used the
> PUT
> > to
> > > >>> insert the data. I gave up finally and I seeking help. Anyone
> > succeeded
> > > in
> > > >>> the uploading the bulk load of data into the Hbase-0.89 using the
> > > >>> MapReduce
> > > >>> program.
> > > >>>
> > > >>>
> > > >>>
> > > >>> I need the Map Reduce code to do the BulkUpload
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> Regards
> > > >>>
> > > >>> Jason
> > > >>>
> > > >>>
> > > >>
> > > >
> > >
> >
>
Re: MapReduce Program for the bulkUpload into the hbase-0.89
Posted by Mark Kerzner <ma...@gmail.com>.
Well Praba,
we are in the same boat. I also feel that there is not enough published
examples, and I have started accumulating mine here,
http://hadoopinpractice.com/code.html
<http://hadoopinpractice.com/code.html>Cheers,
Mark
On Wed, Feb 2, 2011 at 9:56 AM, praba karan <pr...@gmail.com> wrote:
> Yeah, I had seen this. I developed the Map Reduce program based on the
> Source Codes of Importtsv. I am getting an exception like
>
> "NoRegionForServer" exception. I am trying to resolve this too. So I am
> Requesting the users to post the complete Map Reduce program, so that
> Everyone can understand it without complexity
>
> I dont want to use the command line tools such as "completebulkload or
> importtsv"
>
> Thank you Mark
>
>
> Regards
> Prabakaran
>
> On Wed, Feb 2, 2011 at 9:18 PM, Stack <st...@duboce.net> wrote:
>
> > See http://hbase.apache.org/bulk-loads.html
> > St.Ack
> >
> > On Wed, Feb 2, 2011 at 3:26 PM, praba karan <pr...@gmail.com> wrote:
> > > Thanks Mark,
> > >
> > > But this is now what I need?
> > >
> > > I am trying to upload the bulk of data from hdfs file system to the
> > > Hbase-0.89. I need the Map Reduce program for that.
> > >
> > >
> > > Regards
> > > Jason
> > >
> > >
> > > On Wed, Feb 2, 2011 at 7:46 PM, Mark Kerzner <ma...@gmail.com>
> > wrote:
> > >
> > >> Jason,
> > >>
> > >> attached is RowCounter.java from 0.90 test code - I think it has what
> > you
> > >> need.
> > >>
> > >> Cheers,
> > >> Mark
> > >>
> > >>
> > >> On Wed, Feb 2, 2011 at 12:33 AM, Jason Bourne <pr...@gmail.com>
> > wrote:
> > >>
> > >>> Hi,
> > >>>
> > >>>
> > >>>
> > >>> I need to upload the bulk load of data into the Hbase-0.89 using the
> > Map
> > >>> Reduce program, I tried with the MapReduce program sample available
> in
> > the
> > >>> Hbase-0.20.6 API documents. But when I used the same samples for the
> > >>> Hbase-0.89, BatchUpdate class files are removed, Then I used the PUT
> to
> > >>> insert the data. I gave up finally and I seeking help. Anyone
> succeeded
> > in
> > >>> the uploading the bulk load of data into the Hbase-0.89 using the
> > >>> MapReduce
> > >>> program.
> > >>>
> > >>>
> > >>>
> > >>> I need the Map Reduce code to do the BulkUpload
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>> Regards
> > >>>
> > >>> Jason
> > >>>
> > >>>
> > >>
> > >
> >
>
Re: MapReduce Program for the bulkUpload into the hbase-0.89
Posted by praba karan <pr...@gmail.com>.
Yeah, I had seen this. I developed the Map Reduce program based on the
Source Codes of Importtsv. I am getting an exception like
"NoRegionForServer" exception. I am trying to resolve this too. So I am
Requesting the users to post the complete Map Reduce program, so that
Everyone can understand it without complexity
I dont want to use the command line tools such as "completebulkload or
importtsv"
Thank you Mark
Regards
Prabakaran
On Wed, Feb 2, 2011 at 9:18 PM, Stack <st...@duboce.net> wrote:
> See http://hbase.apache.org/bulk-loads.html
> St.Ack
>
> On Wed, Feb 2, 2011 at 3:26 PM, praba karan <pr...@gmail.com> wrote:
> > Thanks Mark,
> >
> > But this is now what I need?
> >
> > I am trying to upload the bulk of data from hdfs file system to the
> > Hbase-0.89. I need the Map Reduce program for that.
> >
> >
> > Regards
> > Jason
> >
> >
> > On Wed, Feb 2, 2011 at 7:46 PM, Mark Kerzner <ma...@gmail.com>
> wrote:
> >
> >> Jason,
> >>
> >> attached is RowCounter.java from 0.90 test code - I think it has what
> you
> >> need.
> >>
> >> Cheers,
> >> Mark
> >>
> >>
> >> On Wed, Feb 2, 2011 at 12:33 AM, Jason Bourne <pr...@gmail.com>
> wrote:
> >>
> >>> Hi,
> >>>
> >>>
> >>>
> >>> I need to upload the bulk load of data into the Hbase-0.89 using the
> Map
> >>> Reduce program, I tried with the MapReduce program sample available in
> the
> >>> Hbase-0.20.6 API documents. But when I used the same samples for the
> >>> Hbase-0.89, BatchUpdate class files are removed, Then I used the PUT to
> >>> insert the data. I gave up finally and I seeking help. Anyone succeeded
> in
> >>> the uploading the bulk load of data into the Hbase-0.89 using the
> >>> MapReduce
> >>> program.
> >>>
> >>>
> >>>
> >>> I need the Map Reduce code to do the BulkUpload
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> Regards
> >>>
> >>> Jason
> >>>
> >>>
> >>
> >
>
Re: MapReduce Program for the bulkUpload into the hbase-0.89
Posted by Stack <st...@duboce.net>.
See http://hbase.apache.org/bulk-loads.html
St.Ack
On Wed, Feb 2, 2011 at 3:26 PM, praba karan <pr...@gmail.com> wrote:
> Thanks Mark,
>
> But this is now what I need?
>
> I am trying to upload the bulk of data from hdfs file system to the
> Hbase-0.89. I need the Map Reduce program for that.
>
>
> Regards
> Jason
>
>
> On Wed, Feb 2, 2011 at 7:46 PM, Mark Kerzner <ma...@gmail.com> wrote:
>
>> Jason,
>>
>> attached is RowCounter.java from 0.90 test code - I think it has what you
>> need.
>>
>> Cheers,
>> Mark
>>
>>
>> On Wed, Feb 2, 2011 at 12:33 AM, Jason Bourne <pr...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>>
>>>
>>> I need to upload the bulk load of data into the Hbase-0.89 using the Map
>>> Reduce program, I tried with the MapReduce program sample available in the
>>> Hbase-0.20.6 API documents. But when I used the same samples for the
>>> Hbase-0.89, BatchUpdate class files are removed, Then I used the PUT to
>>> insert the data. I gave up finally and I seeking help. Anyone succeeded in
>>> the uploading the bulk load of data into the Hbase-0.89 using the
>>> MapReduce
>>> program.
>>>
>>>
>>>
>>> I need the Map Reduce code to do the BulkUpload
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> Regards
>>>
>>> Jason
>>>
>>>
>>
>
Re: MapReduce Program for the bulkUpload into the hbase-0.89
Posted by praba karan <pr...@gmail.com>.
Thanks Mark,
But this is now what I need?
I am trying to upload the bulk of data from hdfs file system to the
Hbase-0.89. I need the Map Reduce program for that.
Regards
Jason
On Wed, Feb 2, 2011 at 7:46 PM, Mark Kerzner <ma...@gmail.com> wrote:
> Jason,
>
> attached is RowCounter.java from 0.90 test code - I think it has what you
> need.
>
> Cheers,
> Mark
>
>
> On Wed, Feb 2, 2011 at 12:33 AM, Jason Bourne <pr...@gmail.com> wrote:
>
>> Hi,
>>
>>
>>
>> I need to upload the bulk load of data into the Hbase-0.89 using the Map
>> Reduce program, I tried with the MapReduce program sample available in the
>> Hbase-0.20.6 API documents. But when I used the same samples for the
>> Hbase-0.89, BatchUpdate class files are removed, Then I used the PUT to
>> insert the data. I gave up finally and I seeking help. Anyone succeeded in
>> the uploading the bulk load of data into the Hbase-0.89 using the
>> MapReduce
>> program.
>>
>>
>>
>> I need the Map Reduce code to do the BulkUpload
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Regards
>>
>> Jason
>>
>>
>
Re: MapReduce Program for the bulkUpload into the hbase-0.89
Posted by Mark Kerzner <ma...@gmail.com>.
Jason,
attached is RowCounter.java from 0.90 test code - I think it has what you
need.
Cheers,
Mark
On Wed, Feb 2, 2011 at 12:33 AM, Jason Bourne <pr...@gmail.com> wrote:
> Hi,
>
>
>
> I need to upload the bulk load of data into the Hbase-0.89 using the Map
> Reduce program, I tried with the MapReduce program sample available in the
> Hbase-0.20.6 API documents. But when I used the same samples for the
> Hbase-0.89, BatchUpdate class files are removed, Then I used the PUT to
> insert the data. I gave up finally and I seeking help. Anyone succeeded in
> the uploading the bulk load of data into the Hbase-0.89 using the MapReduce
> program.
>
>
>
> I need the Map Reduce code to do the BulkUpload
>
>
>
>
>
>
>
>
>
>
>
>
>
> Regards
>
> Jason
>
>