Re: Back up HBase tables before hadoop upgrade

[Chathuri Wimalasena <ka...@gmail.com>]

Thank you. What if I stop HBase and copy whole hbase directory to my local
disk ? Will that work if something went wrong with the upgrade ?

Also could you please tell me what's the difference between export and
snapshot ?

Thanks,
Chathuri

On Wed, Mar 30, 2016 at 10:01 AM, Ted Yu <yu...@gmail.com> wrote:

> You can also snapshot each of the 647 tables.
> In case something goes unexpected, you can restore any of them.
>
> FYI
>
> On Wed, Mar 30, 2016 at 6:46 AM, Chathuri Wimalasena <kamalasini@gmail.com
> >
> wrote:
>
> > Hi All,
> >
> > We have production system using hadoop 2.5.1 and HBase 0.94.23. We have
> > nearly around 200 TB of data in HDFS and we are planning to upgrade to
> > newer hadoop version 2.7.2. In HBase we have roughly 647 tables. Before
> the
> > upgrade, we want to back up HBase tables in case of data loss or
> corruption
> > while upgrade. We are thinking of using export and import functionality
> to
> > export each table. Is there any other recommended way to back up hbase
> > tables ?
> >
> > Thanks,
> > Chathuri
> >
>

Re: Back up HBase tables before hadoop upgrade

[Ted Yu <yu...@gmail.com>]

bq. copy whole hbase directory to my local disk

I doubt your local disk has enough space for all your data.
Plus, what if some part of the local disk goes bad ?
With hdfs, the chance of data loss is very low.

w.r.t. hbase snapshot, you can refer to
http://hbase.apache.org/book.html#ops.snapshots

For Export, see http://hbase.apache.org/book.html#export

Note, hbase snapshot doesn't generate sequence file.

On Fri, Apr 1, 2016 at 7:10 AM, Chathuri Wimalasena <ka...@gmail.com>
wrote:

> Thank you. What if I stop HBase and copy whole hbase directory to my local
> disk ? Will that work if something went wrong with the upgrade ?
>
> Also could you please tell me what's the difference between export and
> snapshot ?
>
> Thanks,
> Chathuri
>
> On Wed, Mar 30, 2016 at 10:01 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > You can also snapshot each of the 647 tables.
> > In case something goes unexpected, you can restore any of them.
> >
> > FYI
> >
> > On Wed, Mar 30, 2016 at 6:46 AM, Chathuri Wimalasena <
> kamalasini@gmail.com
> > >
> > wrote:
> >
> > > Hi All,
> > >
> > > We have production system using hadoop 2.5.1 and HBase 0.94.23. We have
> > > nearly around 200 TB of data in HDFS and we are planning to upgrade to
> > > newer hadoop version 2.7.2. In HBase we have roughly 647 tables. Before
> > the
> > > upgrade, we want to back up HBase tables in case of data loss or
> > corruption
> > > while upgrade. We are thinking of using export and import functionality
> > to
> > > export each table. Is there any other recommended way to back up hbase
> > > tables ?
> > >
> > > Thanks,
> > > Chathuri
> > >
> >
>