You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Karthik Ranganathan <kr...@fb.com> on 2011/10/19 17:34:25 UTC
HBase backups
Hey guys,
There seemed to be a fair amount of interest in the Hbase backup solution, so I created HBASE-4618 as an umbrella task for figuring out how to opensource the backup solution we are building internally, and continue building the rest of it in opensource itself.
One small question: There is a fair bit of definitions, architecture overview, setup instructions, etc that we put in an internal wiki… wondering what is a good place to put them? The purpose of this is for people newly wanting to investigate Hbase backups (what they are, how to setup, etc) as well as a reference location for people who already know about Hbase backups but want to lookup the steps to set them up. Javadoc may not be the ideal location for this.
Thanks
Karthik
Re: HBase backups
Posted by Andrew Purtell <ap...@apache.org>.
Nice!
> There is a fair bit of definitions, architecture overview, setup
instructions, etc that we put in an internal wiki… wondering what is a
good place to put them?
The site docs (book.xml) seem a good place for them after commit, and the HBase wiki before.
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)
>________________________________
>From: Karthik Ranganathan <kr...@fb.com>
>To: "dev@hbase.apache.org" <de...@hbase.apache.org>
>Sent: Wednesday, October 19, 2011 8:34 AM
>Subject: HBase backups
>
>
>Hey guys,
>
>There seemed to be a fair amount of interest in the Hbase backup solution, so I created HBASE-4618 as an umbrella task for figuring out how to opensource the backup solution we are building internally, and continue building the rest of it in opensource itself.
>
>One small question: There is a fair bit of definitions, architecture overview, setup instructions, etc that we put in an internal wiki… wondering what is a good place to put them? The purpose of this is for people newly wanting to investigate Hbase backups (what they are, how to setup, etc) as well as a reference location for people who already know about Hbase backups but want to lookup the steps to set them up. Javadoc may not be the ideal location for this.
>
>Thanks
>Karthik
>
>
>
>
Re: HBase backups
Posted by Doug Meil <do...@explorysmedical.com>.
Through this year I've been retiring wiki pages and porting the content to
the book (e.g., performance, architecture, etc.). If at all possible, I'd
like to avoid adding new wiki content and prefer adding to the book.
On 10/19/11 1:27 PM, "Doug Meil" <do...@explorysmedical.com> wrote:
>
>I updated the book recently with a fair amount of backup info.
>
>http://hbase.apache.org/book.html#ops.backup
>
>Can you add a patch to this section?
>
>
>
>On 10/19/11 12:23 PM, "Ted Yu" <yu...@gmail.com> wrote:
>
>>My first edit didn't go in either.
>>Then I noted the question above the Edit area I must have forgotten to
>>answer. I think spam was reported on the Apache wiki site so now there is
>>tighter control.
>>
>>I created http://wiki.apache.org/hadoop/HBase/Backups
>>If you cannot edit it, here are the admins:
>>ChrisHutton, commit_mailer, TomWhite, johanoskarsson, KonstantinShvachko,
>>tuxracer69
>>
>>Cheers
>>
>>On Wed, Oct 19, 2011 at 9:09 AM, Karthik Ranganathan
>><kr...@fb.com>wrote:
>>
>>> Would totally work, Ted. I am not able to create the page
>>>(HBase/Backups)
>>> in order to put any content there - wondering how I should go about
>>> getting this done?
>>>
>>> Thanks
>>> Karthik
>>>
>>>
>>> On 10/19/11 9:00 AM, "Ted Yu" <yu...@gmail.com> wrote:
>>>
>>> >We have:
>>> >http://wiki.apache.org/hadoop/Hbase
>>> >
>>> >where http://wiki.apache.org/hadoop/Hbase/MigrationToNewCluster is
>>> related
>>> >to backup/restore but the content is very old.
>>> >
>>> >Maybe a new topic can be created under
>>> http://wiki.apache.org/hadoop/Hbase
>>> >
>>> >Cheers
>>> >
>>> >On Wed, Oct 19, 2011 at 8:34 AM, Karthik Ranganathan
>>> ><kr...@fb.com>wrote:
>>> >
>>> >>
>>> >> Hey guys,
>>> >>
>>> >> There seemed to be a fair amount of interest in the Hbase backup
>>> >>solution,
>>> >> so I created HBASE-4618 as an umbrella task for figuring out how to
>>> >> opensource the backup solution we are building internally, and
>>>continue
>>> >> building the rest of it in opensource itself.
>>> >>
>>> >> One small question: There is a fair bit of definitions, architecture
>>> >> overview, setup instructions, etc that we put in an internal wikiŠ
>>> >>wondering
>>> >> what is a good place to put them? The purpose of this is for people
>>> >>newly
>>> >> wanting to investigate Hbase backups (what they are, how to setup,
>>>etc)
>>> >>as
>>> >> well as a reference location for people who already know about Hbase
>>> >>backups
>>> >> but want to lookup the steps to set them up. Javadoc may not be the
>>> >>ideal
>>> >> location for this.
>>> >>
>>> >> Thanks
>>> >> Karthik
>>> >>
>>> >>
>>>
>>>
>
Re: HBase backups
Posted by Doug Meil <do...@explorysmedical.com>.
I updated the book recently with a fair amount of backup info.
http://hbase.apache.org/book.html#ops.backup
Can you add a patch to this section?
On 10/19/11 12:23 PM, "Ted Yu" <yu...@gmail.com> wrote:
>My first edit didn't go in either.
>Then I noted the question above the Edit area I must have forgotten to
>answer. I think spam was reported on the Apache wiki site so now there is
>tighter control.
>
>I created http://wiki.apache.org/hadoop/HBase/Backups
>If you cannot edit it, here are the admins:
>ChrisHutton, commit_mailer, TomWhite, johanoskarsson, KonstantinShvachko,
>tuxracer69
>
>Cheers
>
>On Wed, Oct 19, 2011 at 9:09 AM, Karthik Ranganathan
><kr...@fb.com>wrote:
>
>> Would totally work, Ted. I am not able to create the page
>>(HBase/Backups)
>> in order to put any content there - wondering how I should go about
>> getting this done?
>>
>> Thanks
>> Karthik
>>
>>
>> On 10/19/11 9:00 AM, "Ted Yu" <yu...@gmail.com> wrote:
>>
>> >We have:
>> >http://wiki.apache.org/hadoop/Hbase
>> >
>> >where http://wiki.apache.org/hadoop/Hbase/MigrationToNewCluster is
>> related
>> >to backup/restore but the content is very old.
>> >
>> >Maybe a new topic can be created under
>> http://wiki.apache.org/hadoop/Hbase
>> >
>> >Cheers
>> >
>> >On Wed, Oct 19, 2011 at 8:34 AM, Karthik Ranganathan
>> ><kr...@fb.com>wrote:
>> >
>> >>
>> >> Hey guys,
>> >>
>> >> There seemed to be a fair amount of interest in the Hbase backup
>> >>solution,
>> >> so I created HBASE-4618 as an umbrella task for figuring out how to
>> >> opensource the backup solution we are building internally, and
>>continue
>> >> building the rest of it in opensource itself.
>> >>
>> >> One small question: There is a fair bit of definitions, architecture
>> >> overview, setup instructions, etc that we put in an internal wikiŠ
>> >>wondering
>> >> what is a good place to put them? The purpose of this is for people
>> >>newly
>> >> wanting to investigate Hbase backups (what they are, how to setup,
>>etc)
>> >>as
>> >> well as a reference location for people who already know about Hbase
>> >>backups
>> >> but want to lookup the steps to set them up. Javadoc may not be the
>> >>ideal
>> >> location for this.
>> >>
>> >> Thanks
>> >> Karthik
>> >>
>> >>
>>
>>
Re: HBase backups
Posted by Ted Yu <yu...@gmail.com>.
My first edit didn't go in either.
Then I noted the question above the Edit area I must have forgotten to
answer. I think spam was reported on the Apache wiki site so now there is
tighter control.
I created http://wiki.apache.org/hadoop/HBase/Backups
If you cannot edit it, here are the admins:
ChrisHutton, commit_mailer, TomWhite, johanoskarsson, KonstantinShvachko,
tuxracer69
Cheers
On Wed, Oct 19, 2011 at 9:09 AM, Karthik Ranganathan <kr...@fb.com>wrote:
> Would totally work, Ted. I am not able to create the page (HBase/Backups)
> in order to put any content there - wondering how I should go about
> getting this done?
>
> Thanks
> Karthik
>
>
> On 10/19/11 9:00 AM, "Ted Yu" <yu...@gmail.com> wrote:
>
> >We have:
> >http://wiki.apache.org/hadoop/Hbase
> >
> >where http://wiki.apache.org/hadoop/Hbase/MigrationToNewCluster is
> related
> >to backup/restore but the content is very old.
> >
> >Maybe a new topic can be created under
> http://wiki.apache.org/hadoop/Hbase
> >
> >Cheers
> >
> >On Wed, Oct 19, 2011 at 8:34 AM, Karthik Ranganathan
> ><kr...@fb.com>wrote:
> >
> >>
> >> Hey guys,
> >>
> >> There seemed to be a fair amount of interest in the Hbase backup
> >>solution,
> >> so I created HBASE-4618 as an umbrella task for figuring out how to
> >> opensource the backup solution we are building internally, and continue
> >> building the rest of it in opensource itself.
> >>
> >> One small question: There is a fair bit of definitions, architecture
> >> overview, setup instructions, etc that we put in an internal wikiŠ
> >>wondering
> >> what is a good place to put them? The purpose of this is for people
> >>newly
> >> wanting to investigate Hbase backups (what they are, how to setup, etc)
> >>as
> >> well as a reference location for people who already know about Hbase
> >>backups
> >> but want to lookup the steps to set them up. Javadoc may not be the
> >>ideal
> >> location for this.
> >>
> >> Thanks
> >> Karthik
> >>
> >>
>
>
Re: HBase backups
Posted by Karthik Ranganathan <kr...@fb.com>.
Would totally work, Ted. I am not able to create the page (HBase/Backups)
in order to put any content there - wondering how I should go about
getting this done?
Thanks
Karthik
On 10/19/11 9:00 AM, "Ted Yu" <yu...@gmail.com> wrote:
>We have:
>http://wiki.apache.org/hadoop/Hbase
>
>where http://wiki.apache.org/hadoop/Hbase/MigrationToNewCluster is related
>to backup/restore but the content is very old.
>
>Maybe a new topic can be created under http://wiki.apache.org/hadoop/Hbase
>
>Cheers
>
>On Wed, Oct 19, 2011 at 8:34 AM, Karthik Ranganathan
><kr...@fb.com>wrote:
>
>>
>> Hey guys,
>>
>> There seemed to be a fair amount of interest in the Hbase backup
>>solution,
>> so I created HBASE-4618 as an umbrella task for figuring out how to
>> opensource the backup solution we are building internally, and continue
>> building the rest of it in opensource itself.
>>
>> One small question: There is a fair bit of definitions, architecture
>> overview, setup instructions, etc that we put in an internal wikiŠ
>>wondering
>> what is a good place to put them? The purpose of this is for people
>>newly
>> wanting to investigate Hbase backups (what they are, how to setup, etc)
>>as
>> well as a reference location for people who already know about Hbase
>>backups
>> but want to lookup the steps to set them up. Javadoc may not be the
>>ideal
>> location for this.
>>
>> Thanks
>> Karthik
>>
>>
Re: HBase backups
Posted by Ted Yu <yu...@gmail.com>.
We have:
http://wiki.apache.org/hadoop/Hbase
where http://wiki.apache.org/hadoop/Hbase/MigrationToNewCluster is related
to backup/restore but the content is very old.
Maybe a new topic can be created under http://wiki.apache.org/hadoop/Hbase
Cheers
On Wed, Oct 19, 2011 at 8:34 AM, Karthik Ranganathan <kr...@fb.com>wrote:
>
> Hey guys,
>
> There seemed to be a fair amount of interest in the Hbase backup solution,
> so I created HBASE-4618 as an umbrella task for figuring out how to
> opensource the backup solution we are building internally, and continue
> building the rest of it in opensource itself.
>
> One small question: There is a fair bit of definitions, architecture
> overview, setup instructions, etc that we put in an internal wiki… wondering
> what is a good place to put them? The purpose of this is for people newly
> wanting to investigate Hbase backups (what they are, how to setup, etc) as
> well as a reference location for people who already know about Hbase backups
> but want to lookup the steps to set them up. Javadoc may not be the ideal
> location for this.
>
> Thanks
> Karthik
>
>
Re: HBase backups
Posted by Stack <st...@duboce.net>.
On Wed, Oct 19, 2011 at 4:30 PM, Karthik Ranganathan
<kr...@fb.com> wrote:
> How do I put stuff into the book? Is html code for the book in the svn
> repo somewhere? If its easier as text in a jira or ms-word doc, that works
> too.
>
Book is done up as docbook (see docbook.org). It can take a little
while to get into so if you'd rather pass, attach exported pages from
wiki to a JIRA and I can have a go at convertion (some structure is
probably better than plain text though that'll work as last resort).
Source is at src/docbkx.
St.Ack
Re: HBase backups
Posted by Karthik Ranganathan <kr...@fb.com>.
@Ted - awesome, I can edit now (havent tried saving anything yet though).
@Andrew, @Stack - no worries, we can put it into the book, whatever works.
I can make it plain-text if needed. Some of the stuff will be long-lived
(architecture, etc) and some will change with the versions (the scripts
and the params, etc).
@Doug - That works, thanks for the pointer.
How do I put stuff into the book? Is html code for the book in the svn
repo somewhere? If its easier as text in a jira or ms-word doc, that works
too.
On 10/19/11 3:38 PM, "Stack" <st...@duboce.net> wrote:
>On Wed, Oct 19, 2011 at 8:34 AM, Karthik Ranganathan
><kr...@fb.com> wrote:
>> There seemed to be a fair amount of interest in the Hbase backup
>>solution, so I created HBASE-4618 as an umbrella task for figuring out
>>how to opensource the backup solution we are building internally, and
>>continue building the rest of it in opensource itself.
>>
>
>Sweet.
>
>> One small question: There is a fair bit of definitions, architecture
>>overview, setup instructions, etc that we put in an internal wikiŠ
>>wondering what is a good place to put them? The purpose of this is for
>>people newly wanting to investigate Hbase backups (what they are, how to
>>setup, etc) as well as a reference location for people who already know
>>about Hbase backups but want to lookup the steps to set them up. Javadoc
>>may not be the ideal location for this.
>>
>
>What are the export options on your wiki Karthick? If plain text or
>xml or something structured -- even msword -- we can hack it into
>docbook with find/replace/openoffice, etc (I volunteer). As Doug
>says, we've been trying to get stuff into the book rather than up on
>wiki; wiki for transient stuff, book for stuff we need to keep up with
>the releases.
>
>Good stuff,
>St.Ack
Re: HBase backups
Posted by Stack <st...@duboce.net>.
On Wed, Oct 19, 2011 at 8:34 AM, Karthik Ranganathan
<kr...@fb.com> wrote:
> There seemed to be a fair amount of interest in the Hbase backup solution, so I created HBASE-4618 as an umbrella task for figuring out how to opensource the backup solution we are building internally, and continue building the rest of it in opensource itself.
>
Sweet.
> One small question: There is a fair bit of definitions, architecture overview, setup instructions, etc that we put in an internal wiki… wondering what is a good place to put them? The purpose of this is for people newly wanting to investigate Hbase backups (what they are, how to setup, etc) as well as a reference location for people who already know about Hbase backups but want to lookup the steps to set them up. Javadoc may not be the ideal location for this.
>
What are the export options on your wiki Karthick? If plain text or
xml or something structured -- even msword -- we can hack it into
docbook with find/replace/openoffice, etc (I volunteer). As Doug
says, we've been trying to get stuff into the book rather than up on
wiki; wiki for transient stuff, book for stuff we need to keep up with
the releases.
Good stuff,
St.Ack