You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Marc Harris <mh...@jumptap.com> on 2008/01/23 23:31:13 UTC
Backing up hbase (or maybe "making a check-point")
What is needed to back up an hbase "instance"?
I am working on a project and I want to add things to my code
incrementally. When something works, I want to be able to take the
entire hbase database, copy it somewhere else, and continue my work. If
I messed up, I want to be able to go back to that "checkpoint". I am
using HDFS with everything one one server. Is it just a matter of
shutting down the hbase and hadoop servers, and then copying the "dfs"
and "mapred" folders somewhere else? And then moving them back into
place if I need to revert to that state. Or are there other files that
need to be copied too?
Thanks
- Marc
Re: Backing up hbase (or maybe "making a check-point")
Posted by Aaron Kimball <ak...@cs.washington.edu>.
Thanks
Jim Kellerman wrote:
> HADOOP-2496
>
> ---
> Jim Kellerman, Senior Engineer; Powerset
>
>
>
>> -----Original Message-----
>> From: Aaron Kimball [mailto:ak@cs.washington.edu]
>> Sent: Wednesday, January 23, 2008 2:59 PM
>> To: core-user@hadoop.apache.org
>> Subject: Re: Backing up hbase (or maybe "making a check-point")
>>
>> Is there a hot backup capability in the works?
>> - Aaron
>>
>> stack wrote:
>>
>>> Marc Harris wrote:
>>>
>>>> Is it just a matter of
>>>> shutting down the hbase and hadoop servers, and then
>>>>
>> copying the "dfs"
>>
>>>> and "mapred" folders somewhere else? And then moving them
>>>>
>> back into
>>
>>>> place if I need to revert to that state. Or are there other files
>>>> that need to be copied too?
>>>>
>>>>
>>>>
>>> You need to shutdown hbase so it will dump whats in memory
>>>
>> out to the
>>
>>> filesystem. Then it should just be a matter of copying the
>>> hbase.rootdir elsewhere. If that doesn't work, its a bug.
>>>
>>> St.Ack
>>>
>>>
>> No virus found in this incoming message.
>> Checked by AVG Free Edition.
>> Version: 7.5.516 / Virus Database: 269.19.9/1239 - Release
>> Date: 1/23/2008 10:24 AM
>>
>>
>>
>
> No virus found in this outgoing message.
> Checked by AVG Free Edition.
> Version: 7.5.516 / Virus Database: 269.19.9/1239 - Release Date: 1/23/2008 10:24 AM
>
>
RE: Backing up hbase (or maybe "making a check-point")
Posted by Jim Kellerman <ji...@powerset.com>.
HADOOP-2496
---
Jim Kellerman, Senior Engineer; Powerset
> -----Original Message-----
> From: Aaron Kimball [mailto:ak@cs.washington.edu]
> Sent: Wednesday, January 23, 2008 2:59 PM
> To: core-user@hadoop.apache.org
> Subject: Re: Backing up hbase (or maybe "making a check-point")
>
> Is there a hot backup capability in the works?
> - Aaron
>
> stack wrote:
> > Marc Harris wrote:
> >> Is it just a matter of
> >> shutting down the hbase and hadoop servers, and then
> copying the "dfs"
> >> and "mapred" folders somewhere else? And then moving them
> back into
> >> place if I need to revert to that state. Or are there other files
> >> that need to be copied too?
> >>
> >>
> > You need to shutdown hbase so it will dump whats in memory
> out to the
> > filesystem. Then it should just be a matter of copying the
> > hbase.rootdir elsewhere. If that doesn't work, its a bug.
> >
> > St.Ack
> >
>
> No virus found in this incoming message.
> Checked by AVG Free Edition.
> Version: 7.5.516 / Virus Database: 269.19.9/1239 - Release
> Date: 1/23/2008 10:24 AM
>
>
No virus found in this outgoing message.
Checked by AVG Free Edition.
Version: 7.5.516 / Virus Database: 269.19.9/1239 - Release Date: 1/23/2008 10:24 AM
Re: Backing up hbase (or maybe "making a check-point")
Posted by Aaron Kimball <ak...@cs.washington.edu>.
Is there a hot backup capability in the works?
- Aaron
stack wrote:
> Marc Harris wrote:
>> Is it just a matter of
>> shutting down the hbase and hadoop servers, and then copying the "dfs"
>> and "mapred" folders somewhere else? And then moving them back into
>> place if I need to revert to that state. Or are there other files that
>> need to be copied too?
>>
>>
> You need to shutdown hbase so it will dump whats in memory out to the
> filesystem. Then it should just be a matter of copying the
> hbase.rootdir elsewhere. If that doesn't work, its a bug.
>
> St.Ack
>
Re: Backing up hbase (or maybe "making a check-point")
Posted by stack <st...@duboce.net>.
Marc Harris wrote:
> Is it just a matter of
> shutting down the hbase and hadoop servers, and then copying the "dfs"
> and "mapred" folders somewhere else? And then moving them back into
> place if I need to revert to that state. Or are there other files that
> need to be copied too?
>
>
You need to shutdown hbase so it will dump whats in memory out to the
filesystem. Then it should just be a matter of copying the
hbase.rootdir elsewhere. If that doesn't work, its a bug.
St.Ack