You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by anil gupta <an...@gmail.com> on 2015/10/14 18:38:02 UTC
Export Snapshot to remote cluster and then Clone_Snapshot from
exported data
Hi,
I exported snapshot of a table to remote cluster. Now, i want to create
table on remote cluster using that exported snapshot. I have done this
around 2 years ago(on 0.94) but unfortunately, i dont remember steps now.
I tried to search mailing list archive and HBase documentation but i can
find steps to accomplish my task. Can anyone provide me the steps or point
me to documentation?
--
Thanks & Regards,
Anil Gupta
Re: Export Snapshot to remote cluster and then Clone_Snapshot from
exported data
Posted by anil gupta <an...@gmail.com>.
Created this: https://issues.apache.org/jira/browse/HBASE-14612
On Wed, Oct 14, 2015 at 10:18 PM, anil gupta <an...@gmail.com> wrote:
> Hi Samir,
>
> You are right. But, HBase documentation didnt mention strict requirement
> of correct hbase directory. So, i have to do few more trials to come up
> with correct destination directory. As per my analysis, export directory
> should be <hbase.rootdir>.
>
> In cdh, rootdir is "/hbase" while in HDP, its "/apps/hbase/data". Hence, i
> ran into this problem.
> I am going to open documentation bug in HBase.
> Thanks for your help.
> Anil
>
> On Wed, Oct 14, 2015 at 1:27 PM, Samir Ahmic <ah...@gmail.com>
> wrote:
>
>> If you exported snapshot with ExportSnapshot tool you shoud have "archive"
>> and ".hbase-snapshot" directories on destination cluster in
>> hbase.root.dir(usually /hbase). Inside ".hbase-snapshot" directory you
>> should see your snapshot. If your snapshot data is copied somewhere else
>> you will not see snapshots with list_snapshots command. Try to locate
>> snapshot directories on destination cluster and move data to correct
>> locations.
>>
>> Regards
>> Samir
>>
>> On Wed, Oct 14, 2015 at 9:10 PM, anil gupta <an...@gmail.com>
>> wrote:
>>
>> > I am using 0.98. I used that doc instructions to export the snapshot.
>> What
>> > do you mean by not exporting it to correct directory?
>> > I am using HDP. Do you mean to that i just need to copy this exported in
>> > same directory structure as other snapshots?
>> >
>> > > On Wed, Oct 14, 2015 at 11:36 AM, Samir Ahmic <ah...@gmail.com>
>> > wrote:
>> > > What version of hbase you are using ? What did you use to export
>> > snapshots
>> > > to remote cluster? Please take look
>> > > http://hbase.apache.org/book.html#ops.snapshots. Maybe you did not
>> > exported
>> > > snapshots to correct directory. Check your hdfs directories to locate
>> > > snapshots.
>> > >
>> > > Regards
>> > > Samir
>> > >
>> > > On Wed, Oct 14, 2015 at 8:25 PM, anil gupta <an...@gmail.com>
>> > wrote:
>> > >
>> > > > I dont see the snapshot when i run "list_snapshot" on destination
>> > > > cluster.(i checked that initially but forgot to mention in my post)
>> > > > Is it supposed to be listed in output of "list_snapshots" command?
>> > > >
>> > > > On Wed, Oct 14, 2015 at 11:19 AM, Samir Ahmic <
>> ahmic.samir@gmail.com>
>> > > > wrote:
>> > > >
>> > > > > Hi,
>> > > > > Can you see snapshot on remote cluster? If you can see snapshot
>> you
>> > can
>> > > > use
>> > > > > clone snapshot command from hbase shell to create table.
>> > > > > Regards
>> > > > > Samir
>> > > > > On Oct 14, 2015 6:38 PM, "anil gupta" <an...@gmail.com>
>> wrote:
>> > > > >
>> > > > > > Hi,
>> > > > > >
>> > > > > > I exported snapshot of a table to remote cluster. Now, i want to
>> > create
>> > > > > > table on remote cluster using that exported snapshot. I have
>> done
>> > this
>> > > > > > around 2 years ago(on 0.94) but unfortunately, i dont remember
>> > steps
>> > > > now.
>> > > > > >
>> > > > > > I tried to search mailing list archive and HBase documentation
>> but
>> > i
>> > > > can
>> > > > > > find steps to accomplish my task. Can anyone provide me the
>> steps
>> > or
>> > > > > point
>> > > > > > me to documentation?
>> > > > > >
>> > > > > > --
>> > > > > > Thanks & Regards,
>> > > > > > Anil Gupta
>> > > > > >
>> > > > >
>> > > >
>> > > >
>> > > >
>> > > > --
>> > > > Thanks & Regards,
>> > > > Anil Gupta
>> > > >
>> >
>> >
>> >
>> > --
>> > Thanks & Regards,
>> > Anil Gupta
>> >
>>
>
>
>
> --
> Thanks & Regards,
> Anil Gupta
>
--
Thanks & Regards,
Anil Gupta
Re: Export Snapshot to remote cluster and then Clone_Snapshot from
exported data
Posted by anil gupta <an...@gmail.com>.
Hi Samir,
You are right. But, HBase documentation didnt mention strict requirement of
correct hbase directory. So, i have to do few more trials to come up with
correct destination directory. As per my analysis, export directory should
be <hbase.rootdir>.
In cdh, rootdir is "/hbase" while in HDP, its "/apps/hbase/data". Hence, i
ran into this problem.
I am going to open documentation bug in HBase.
Thanks for your help.
Anil
On Wed, Oct 14, 2015 at 1:27 PM, Samir Ahmic <ah...@gmail.com> wrote:
> If you exported snapshot with ExportSnapshot tool you shoud have "archive"
> and ".hbase-snapshot" directories on destination cluster in
> hbase.root.dir(usually /hbase). Inside ".hbase-snapshot" directory you
> should see your snapshot. If your snapshot data is copied somewhere else
> you will not see snapshots with list_snapshots command. Try to locate
> snapshot directories on destination cluster and move data to correct
> locations.
>
> Regards
> Samir
>
> On Wed, Oct 14, 2015 at 9:10 PM, anil gupta <an...@gmail.com> wrote:
>
> > I am using 0.98. I used that doc instructions to export the snapshot.
> What
> > do you mean by not exporting it to correct directory?
> > I am using HDP. Do you mean to that i just need to copy this exported in
> > same directory structure as other snapshots?
> >
> > > On Wed, Oct 14, 2015 at 11:36 AM, Samir Ahmic <ah...@gmail.com>
> > wrote:
> > > What version of hbase you are using ? What did you use to export
> > snapshots
> > > to remote cluster? Please take look
> > > http://hbase.apache.org/book.html#ops.snapshots. Maybe you did not
> > exported
> > > snapshots to correct directory. Check your hdfs directories to locate
> > > snapshots.
> > >
> > > Regards
> > > Samir
> > >
> > > On Wed, Oct 14, 2015 at 8:25 PM, anil gupta <an...@gmail.com>
> > wrote:
> > >
> > > > I dont see the snapshot when i run "list_snapshot" on destination
> > > > cluster.(i checked that initially but forgot to mention in my post)
> > > > Is it supposed to be listed in output of "list_snapshots" command?
> > > >
> > > > On Wed, Oct 14, 2015 at 11:19 AM, Samir Ahmic <ahmic.samir@gmail.com
> >
> > > > wrote:
> > > >
> > > > > Hi,
> > > > > Can you see snapshot on remote cluster? If you can see snapshot you
> > can
> > > > use
> > > > > clone snapshot command from hbase shell to create table.
> > > > > Regards
> > > > > Samir
> > > > > On Oct 14, 2015 6:38 PM, "anil gupta" <an...@gmail.com>
> wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > I exported snapshot of a table to remote cluster. Now, i want to
> > create
> > > > > > table on remote cluster using that exported snapshot. I have done
> > this
> > > > > > around 2 years ago(on 0.94) but unfortunately, i dont remember
> > steps
> > > > now.
> > > > > >
> > > > > > I tried to search mailing list archive and HBase documentation
> but
> > i
> > > > can
> > > > > > find steps to accomplish my task. Can anyone provide me the steps
> > or
> > > > > point
> > > > > > me to documentation?
> > > > > >
> > > > > > --
> > > > > > Thanks & Regards,
> > > > > > Anil Gupta
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Thanks & Regards,
> > > > Anil Gupta
> > > >
> >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
> >
>
--
Thanks & Regards,
Anil Gupta
Re: Export Snapshot to remote cluster and then Clone_Snapshot from
exported data
Posted by Samir Ahmic <ah...@gmail.com>.
If you exported snapshot with ExportSnapshot tool you shoud have "archive"
and ".hbase-snapshot" directories on destination cluster in
hbase.root.dir(usually /hbase). Inside ".hbase-snapshot" directory you
should see your snapshot. If your snapshot data is copied somewhere else
you will not see snapshots with list_snapshots command. Try to locate
snapshot directories on destination cluster and move data to correct
locations.
Regards
Samir
On Wed, Oct 14, 2015 at 9:10 PM, anil gupta <an...@gmail.com> wrote:
> I am using 0.98. I used that doc instructions to export the snapshot. What
> do you mean by not exporting it to correct directory?
> I am using HDP. Do you mean to that i just need to copy this exported in
> same directory structure as other snapshots?
>
> > On Wed, Oct 14, 2015 at 11:36 AM, Samir Ahmic <ah...@gmail.com>
> wrote:
> > What version of hbase you are using ? What did you use to export
> snapshots
> > to remote cluster? Please take look
> > http://hbase.apache.org/book.html#ops.snapshots. Maybe you did not
> exported
> > snapshots to correct directory. Check your hdfs directories to locate
> > snapshots.
> >
> > Regards
> > Samir
> >
> > On Wed, Oct 14, 2015 at 8:25 PM, anil gupta <an...@gmail.com>
> wrote:
> >
> > > I dont see the snapshot when i run "list_snapshot" on destination
> > > cluster.(i checked that initially but forgot to mention in my post)
> > > Is it supposed to be listed in output of "list_snapshots" command?
> > >
> > > On Wed, Oct 14, 2015 at 11:19 AM, Samir Ahmic <ah...@gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > > Can you see snapshot on remote cluster? If you can see snapshot you
> can
> > > use
> > > > clone snapshot command from hbase shell to create table.
> > > > Regards
> > > > Samir
> > > > On Oct 14, 2015 6:38 PM, "anil gupta" <an...@gmail.com> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I exported snapshot of a table to remote cluster. Now, i want to
> create
> > > > > table on remote cluster using that exported snapshot. I have done
> this
> > > > > around 2 years ago(on 0.94) but unfortunately, i dont remember
> steps
> > > now.
> > > > >
> > > > > I tried to search mailing list archive and HBase documentation but
> i
> > > can
> > > > > find steps to accomplish my task. Can anyone provide me the steps
> or
> > > > point
> > > > > me to documentation?
> > > > >
> > > > > --
> > > > > Thanks & Regards,
> > > > > Anil Gupta
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Thanks & Regards,
> > > Anil Gupta
> > >
>
>
>
> --
> Thanks & Regards,
> Anil Gupta
>
Re: Export Snapshot to remote cluster and then Clone_Snapshot from exported data
Posted by anil gupta <an...@gmail.com>.
I am using 0.98. I used that doc instructions to export the snapshot. What do you mean by not exporting it to correct directory?
I am using HDP. Do you mean to that i just need to copy this exported in same directory structure as other snapshots?
> On Wed, Oct 14, 2015 at 11:36 AM, Samir Ahmic <ah...@gmail.com> wrote:
> What version of hbase you are using ? What did you use to export snapshots
> to remote cluster? Please take look
> http://hbase.apache.org/book.html#ops.snapshots. Maybe you did not exported
> snapshots to correct directory. Check your hdfs directories to locate
> snapshots.
>
> Regards
> Samir
>
> On Wed, Oct 14, 2015 at 8:25 PM, anil gupta <an...@gmail.com> wrote:
>
> > I dont see the snapshot when i run "list_snapshot" on destination
> > cluster.(i checked that initially but forgot to mention in my post)
> > Is it supposed to be listed in output of "list_snapshots" command?
> >
> > On Wed, Oct 14, 2015 at 11:19 AM, Samir Ahmic <ah...@gmail.com>
> > wrote:
> >
> > > Hi,
> > > Can you see snapshot on remote cluster? If you can see snapshot you can
> > use
> > > clone snapshot command from hbase shell to create table.
> > > Regards
> > > Samir
> > > On Oct 14, 2015 6:38 PM, "anil gupta" <an...@gmail.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > I exported snapshot of a table to remote cluster. Now, i want to create
> > > > table on remote cluster using that exported snapshot. I have done this
> > > > around 2 years ago(on 0.94) but unfortunately, i dont remember steps
> > now.
> > > >
> > > > I tried to search mailing list archive and HBase documentation but i
> > can
> > > > find steps to accomplish my task. Can anyone provide me the steps or
> > > point
> > > > me to documentation?
> > > >
> > > > --
> > > > Thanks & Regards,
> > > > Anil Gupta
> > > >
> > >
> >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
> >
--
Thanks & Regards,
Anil Gupta
Re: Export Snapshot to remote cluster and then Clone_Snapshot from
exported data
Posted by Samir Ahmic <ah...@gmail.com>.
What version of hbase you are using ? What did you use to export snapshots
to remote cluster? Please take look
http://hbase.apache.org/book.html#ops.snapshots. Maybe you did not exported
snapshots to correct directory. Check your hdfs directories to locate
snapshots.
Regards
Samir
On Wed, Oct 14, 2015 at 8:25 PM, anil gupta <an...@gmail.com> wrote:
> I dont see the snapshot when i run "list_snapshot" on destination
> cluster.(i checked that initially but forgot to mention in my post)
> Is it supposed to be listed in output of "list_snapshots" command?
>
> On Wed, Oct 14, 2015 at 11:19 AM, Samir Ahmic <ah...@gmail.com>
> wrote:
>
> > Hi,
> > Can you see snapshot on remote cluster? If you can see snapshot you can
> use
> > clone snapshot command from hbase shell to create table.
> > Regards
> > Samir
> > On Oct 14, 2015 6:38 PM, "anil gupta" <an...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > I exported snapshot of a table to remote cluster. Now, i want to create
> > > table on remote cluster using that exported snapshot. I have done this
> > > around 2 years ago(on 0.94) but unfortunately, i dont remember steps
> now.
> > >
> > > I tried to search mailing list archive and HBase documentation but i
> can
> > > find steps to accomplish my task. Can anyone provide me the steps or
> > point
> > > me to documentation?
> > >
> > > --
> > > Thanks & Regards,
> > > Anil Gupta
> > >
> >
>
>
>
> --
> Thanks & Regards,
> Anil Gupta
>
Re: Export Snapshot to remote cluster and then Clone_Snapshot from
exported data
Posted by anil gupta <an...@gmail.com>.
I dont see the snapshot when i run "list_snapshot" on destination
cluster.(i checked that initially but forgot to mention in my post)
Is it supposed to be listed in output of "list_snapshots" command?
On Wed, Oct 14, 2015 at 11:19 AM, Samir Ahmic <ah...@gmail.com> wrote:
> Hi,
> Can you see snapshot on remote cluster? If you can see snapshot you can use
> clone snapshot command from hbase shell to create table.
> Regards
> Samir
> On Oct 14, 2015 6:38 PM, "anil gupta" <an...@gmail.com> wrote:
>
> > Hi,
> >
> > I exported snapshot of a table to remote cluster. Now, i want to create
> > table on remote cluster using that exported snapshot. I have done this
> > around 2 years ago(on 0.94) but unfortunately, i dont remember steps now.
> >
> > I tried to search mailing list archive and HBase documentation but i can
> > find steps to accomplish my task. Can anyone provide me the steps or
> point
> > me to documentation?
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
> >
>
--
Thanks & Regards,
Anil Gupta
Re: Export Snapshot to remote cluster and then Clone_Snapshot from
exported data
Posted by Samir Ahmic <ah...@gmail.com>.
Hi,
Can you see snapshot on remote cluster? If you can see snapshot you can use
clone snapshot command from hbase shell to create table.
Regards
Samir
On Oct 14, 2015 6:38 PM, "anil gupta" <an...@gmail.com> wrote:
> Hi,
>
> I exported snapshot of a table to remote cluster. Now, i want to create
> table on remote cluster using that exported snapshot. I have done this
> around 2 years ago(on 0.94) but unfortunately, i dont remember steps now.
>
> I tried to search mailing list archive and HBase documentation but i can
> find steps to accomplish my task. Can anyone provide me the steps or point
> me to documentation?
>
> --
> Thanks & Regards,
> Anil Gupta
>