Re: Incremental snapshot export

[Manjeet Singh <ma...@gmail.com>]

Hi All

Does incremental snapshot export from source cluster to destination cluster
is available..?
Can anyone suggest me the best way to export/import entire table from
source cluster to destination cluster (its live system)

Thanks
Manjeet singh

On Thu, 19 Jan 2017, 06:31 Neelesh, <ne...@gmail.com> wrote:

> Thanks Ted!
>
> On Wed, Jan 18, 2017 at 9:11 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > Currently ExportSnapshot utility doesn't support incremental export.
> > Here is the help message for overwrite:
> >
> >     static final Option OVERWRITE = new Option(null, "overwrite", false,
> >
> >         "Rewrite the snapshot manifest if already exists.");
> >
> > Managing dependencies across snapshots may not be trivial (considering
> > region split / merge in between snapshots).
> >
> > If you are interested, you can watch HBASE-14123 where incremental
> backup /
> > restore has solved this problem.
> >
> > Cheers
> >
> > On Wed, Jan 18, 2017 at 9:04 AM, Neelesh <ne...@gmail.com> wrote:
> >
> > > Hi,
> > >   Does the ExportSnapshot utility incrementally export HFiles ? From
> the
> > > code, it looks like I can specify an overwrite flag to delete and
> > recreate
> > > the output dir, but there is no control on individual HFiles.  This is
> on
> > > HBase 1.1.2.
> > >
> > > I was wondering how difficult would it be to extend ExportSnapshot to
> > > optionally skip copying HFiles if it already exists, given that HFiles
> in
> > > the context of snapshots are immutable.
> > >
> > >
> > > Thanks!
> > > -neelesh
> > >
> >
>

Re: Incremental snapshot export

[Ted Yu <yu...@gmail.com>]

See previous reply.

HBASE-14123 has been integrated to master branch which corresponds to hbase
3.0

FYI

On Tue, May 29, 2018 at 9:02 PM, Manjeet Singh <ma...@gmail.com>
wrote:

> Hi All
>
> Does incremental snapshot export from source cluster to destination cluster
> is available..?
> Can anyone suggest me the best way to export/import entire table from
> source cluster to destination cluster (its live system)
>
> Thanks
> Manjeet singh
>
> On Thu, 19 Jan 2017, 06:31 Neelesh, <ne...@gmail.com> wrote:
>
> > Thanks Ted!
> >
> > On Wed, Jan 18, 2017 at 9:11 AM, Ted Yu <yu...@gmail.com> wrote:
> >
> > > Currently ExportSnapshot utility doesn't support incremental export.
> > > Here is the help message for overwrite:
> > >
> > >     static final Option OVERWRITE = new Option(null, "overwrite",
> false,
> > >
> > >         "Rewrite the snapshot manifest if already exists.");
> > >
> > > Managing dependencies across snapshots may not be trivial (considering
> > > region split / merge in between snapshots).
> > >
> > > If you are interested, you can watch HBASE-14123 where incremental
> > backup /
> > > restore has solved this problem.
> > >
> > > Cheers
> > >
> > > On Wed, Jan 18, 2017 at 9:04 AM, Neelesh <ne...@gmail.com> wrote:
> > >
> > > > Hi,
> > > >   Does the ExportSnapshot utility incrementally export HFiles ? From
> > the
> > > > code, it looks like I can specify an overwrite flag to delete and
> > > recreate
> > > > the output dir, but there is no control on individual HFiles.  This
> is
> > on
> > > > HBase 1.1.2.
> > > >
> > > > I was wondering how difficult would it be to extend ExportSnapshot to
> > > > optionally skip copying HFiles if it already exists, given that
> HFiles
> > in
> > > > the context of snapshots are immutable.
> > > >
> > > >
> > > > Thanks!
> > > > -neelesh
> > > >
> > >
> >
>