You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Chathuri Wimalasena <ka...@gmail.com> on 2016/03/30 15:46:40 UTC
Back up HBase tables before hadoop upgrade
Hi All,
We have production system using hadoop 2.5.1 and HBase 0.94.23. We have
nearly around 200 TB of data in HDFS and we are planning to upgrade to
newer hadoop version 2.7.2. In HBase we have roughly 647 tables. Before the
upgrade, we want to back up HBase tables in case of data loss or corruption
while upgrade. We are thinking of using export and import functionality to
export each table. Is there any other recommended way to back up hbase
tables ?
Thanks,
Chathuri
Re: Back up HBase tables before hadoop upgrade
Posted by Ted Yu <yu...@gmail.com>.
bq. copy whole hbase directory to my local disk
I doubt your local disk has enough space for all your data.
Plus, what if some part of the local disk goes bad ?
With hdfs, the chance of data loss is very low.
w.r.t. hbase snapshot, you can refer to
http://hbase.apache.org/book.html#ops.snapshots
For Export, see http://hbase.apache.org/book.html#export
Note, hbase snapshot doesn't generate sequence file.
On Fri, Apr 1, 2016 at 7:10 AM, Chathuri Wimalasena <ka...@gmail.com>
wrote:
> Thank you. What if I stop HBase and copy whole hbase directory to my local
> disk ? Will that work if something went wrong with the upgrade ?
>
> Also could you please tell me what's the difference between export and
> snapshot ?
>
> Thanks,
> Chathuri
>
> On Wed, Mar 30, 2016 at 10:01 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > You can also snapshot each of the 647 tables.
> > In case something goes unexpected, you can restore any of them.
> >
> > FYI
> >
> > On Wed, Mar 30, 2016 at 6:46 AM, Chathuri Wimalasena <
> kamalasini@gmail.com
> > >
> > wrote:
> >
> > > Hi All,
> > >
> > > We have production system using hadoop 2.5.1 and HBase 0.94.23. We have
> > > nearly around 200 TB of data in HDFS and we are planning to upgrade to
> > > newer hadoop version 2.7.2. In HBase we have roughly 647 tables. Before
> > the
> > > upgrade, we want to back up HBase tables in case of data loss or
> > corruption
> > > while upgrade. We are thinking of using export and import functionality
> > to
> > > export each table. Is there any other recommended way to back up hbase
> > > tables ?
> > >
> > > Thanks,
> > > Chathuri
> > >
> >
>
Re: Back up HBase tables before hadoop upgrade
Posted by Chathuri Wimalasena <ka...@gmail.com>.
Thank you. What if I stop HBase and copy whole hbase directory to my local
disk ? Will that work if something went wrong with the upgrade ?
Also could you please tell me what's the difference between export and
snapshot ?
Thanks,
Chathuri
On Wed, Mar 30, 2016 at 10:01 AM, Ted Yu <yu...@gmail.com> wrote:
> You can also snapshot each of the 647 tables.
> In case something goes unexpected, you can restore any of them.
>
> FYI
>
> On Wed, Mar 30, 2016 at 6:46 AM, Chathuri Wimalasena <kamalasini@gmail.com
> >
> wrote:
>
> > Hi All,
> >
> > We have production system using hadoop 2.5.1 and HBase 0.94.23. We have
> > nearly around 200 TB of data in HDFS and we are planning to upgrade to
> > newer hadoop version 2.7.2. In HBase we have roughly 647 tables. Before
> the
> > upgrade, we want to back up HBase tables in case of data loss or
> corruption
> > while upgrade. We are thinking of using export and import functionality
> to
> > export each table. Is there any other recommended way to back up hbase
> > tables ?
> >
> > Thanks,
> > Chathuri
> >
>
Re: Back up HBase tables before hadoop upgrade
Posted by Ted Yu <yu...@gmail.com>.
You can also snapshot each of the 647 tables.
In case something goes unexpected, you can restore any of them.
FYI
On Wed, Mar 30, 2016 at 6:46 AM, Chathuri Wimalasena <ka...@gmail.com>
wrote:
> Hi All,
>
> We have production system using hadoop 2.5.1 and HBase 0.94.23. We have
> nearly around 200 TB of data in HDFS and we are planning to upgrade to
> newer hadoop version 2.7.2. In HBase we have roughly 647 tables. Before the
> upgrade, we want to back up HBase tables in case of data loss or corruption
> while upgrade. We are thinking of using export and import functionality to
> export each table. Is there any other recommended way to back up hbase
> tables ?
>
> Thanks,
> Chathuri
>