You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Hari Sreekumar <hs...@clickable.com> on 2011/01/02 08:53:59 UTC
ImportTsv tool for v0.20.6?
Hi,
I am runnning hbase v0.20.6. Is ImportTsv and LoadIncrementalHBase sure to
work on that version? I see that it is supported only in v0.89.2. But if I
simply use the ImportTsv.java and LoadIncremetalHBase.java source files in
my version, is there any reason why it wouldn't work for any case? Is there
any architectural change that is necessary for these to work well that is
not present in 0.20.6?
Thanks,
Hari
Re: ImportTsv tool for v0.20.6?
Posted by Hari Sreekumar <hs...@clickable.com>.
okay, Thanks guys.. I am not very confident about going into the guts of
HBase so I guess I'll use the java API for now.
Thanks,
Hari
On Tue, Jan 4, 2011 at 6:27 AM, Todd Lipcon <to...@cloudera.com> wrote:
> Howdy,
>
> Yes, you'll need the patch to HRegion/HRegionInterface/HRegionServer/etc to
> get the region servers to pick up the incremental load, plus various
> patches
> to the ways StoreFiles are compared.
>
> I wouldn't attempt a backport to 0.20, personally, unless you want to get
> down and dirty with the guts of HBase and support your patched version
> yourself.
>
> -Todd
>
> On Mon, Jan 3, 2011 at 10:07 AM, Stack <st...@duboce.net> wrote:
>
> > Todd the author would know best but without a review of the original
> > patch, I think it'll work. Try it. You might need to mess w/ the
> > patch to get it to apply. IIRC, the original patch added a method to
> > kick the cluster to pick up new hfiles. The mapreduce interfaces are
> > probably unchanged. I believe there may have been a bug fixed since
> > original commit. Make sure you pick up this too.
> >
> > St.Ack
> >
> >
> > On Sat, Jan 1, 2011 at 11:53 PM, Hari Sreekumar
> > <hs...@clickable.com> wrote:
> > > Hi,
> > >
> > > I am runnning hbase v0.20.6. Is ImportTsv and LoadIncrementalHBase sure
> > to
> > > work on that version? I see that it is supported only in v0.89.2. But
> if
> > I
> > > simply use the ImportTsv.java and LoadIncremetalHBase.java source files
> > in
> > > my version, is there any reason why it wouldn't work for any case? Is
> > there
> > > any architectural change that is necessary for these to work well that
> is
> > > not present in 0.20.6?
> > >
> > > Thanks,
> > > Hari
> > >
> >
>
>
>
> --
> Todd Lipcon
> Software Engineer, Cloudera
>
Re: ImportTsv tool for v0.20.6?
Posted by Todd Lipcon <to...@cloudera.com>.
Howdy,
Yes, you'll need the patch to HRegion/HRegionInterface/HRegionServer/etc to
get the region servers to pick up the incremental load, plus various patches
to the ways StoreFiles are compared.
I wouldn't attempt a backport to 0.20, personally, unless you want to get
down and dirty with the guts of HBase and support your patched version
yourself.
-Todd
On Mon, Jan 3, 2011 at 10:07 AM, Stack <st...@duboce.net> wrote:
> Todd the author would know best but without a review of the original
> patch, I think it'll work. Try it. You might need to mess w/ the
> patch to get it to apply. IIRC, the original patch added a method to
> kick the cluster to pick up new hfiles. The mapreduce interfaces are
> probably unchanged. I believe there may have been a bug fixed since
> original commit. Make sure you pick up this too.
>
> St.Ack
>
>
> On Sat, Jan 1, 2011 at 11:53 PM, Hari Sreekumar
> <hs...@clickable.com> wrote:
> > Hi,
> >
> > I am runnning hbase v0.20.6. Is ImportTsv and LoadIncrementalHBase sure
> to
> > work on that version? I see that it is supported only in v0.89.2. But if
> I
> > simply use the ImportTsv.java and LoadIncremetalHBase.java source files
> in
> > my version, is there any reason why it wouldn't work for any case? Is
> there
> > any architectural change that is necessary for these to work well that is
> > not present in 0.20.6?
> >
> > Thanks,
> > Hari
> >
>
--
Todd Lipcon
Software Engineer, Cloudera
Re: ImportTsv tool for v0.20.6?
Posted by Stack <st...@duboce.net>.
Todd the author would know best but without a review of the original
patch, I think it'll work. Try it. You might need to mess w/ the
patch to get it to apply. IIRC, the original patch added a method to
kick the cluster to pick up new hfiles. The mapreduce interfaces are
probably unchanged. I believe there may have been a bug fixed since
original commit. Make sure you pick up this too.
St.Ack
On Sat, Jan 1, 2011 at 11:53 PM, Hari Sreekumar
<hs...@clickable.com> wrote:
> Hi,
>
> I am runnning hbase v0.20.6. Is ImportTsv and LoadIncrementalHBase sure to
> work on that version? I see that it is supported only in v0.89.2. But if I
> simply use the ImportTsv.java and LoadIncremetalHBase.java source files in
> my version, is there any reason why it wouldn't work for any case? Is there
> any architectural change that is necessary for these to work well that is
> not present in 0.20.6?
>
> Thanks,
> Hari
>