You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by 段洪义 <du...@doopai.com> on 2013/05/02 14:53:59 UTC
How to restore HDFS data
Datanode error, and then I run hadoop fsck /-delete.Lost a lot of data,
Later, these datanode recovery, Is there any way to restore the fsck
command to delete the data.
Re: How to restore HDFS data
Posted by 段洪义 <du...@doopai.com>.
Thank you, I use rsync to backup every day, so I lost a day of data.
于 2013年05月02日 21:19, Harsh J 写道:
> If you've already run -delete (-move is a better choice if you know DN
> fault is temporary), then the missing blocks are already deleted from
> the namespace permanently. No way to recover the data since the blocks
> have also been invalidated by now.
>
> A HDFS Snapshots feature will arrive in near future to cover the
> backup scenarios that may prove useful in cases such as this.
>
>
> On Thu, May 2, 2013 at 6:23 PM, 段洪义 <duanhongyi@doopai.com
> <ma...@doopai.com>> wrote:
>
> Datanode error, and then I run hadoop fsck /-delete.Lost a lot of
> data,
> Later, these datanode recovery, Is there any way to restore the fsck
> command to delete the data.
>
>
>
>
> --
> Harsh J
Re: How to restore HDFS data
Posted by 段洪义 <du...@doopai.com>.
Thank you, I use rsync to backup every day, so I lost a day of data.
于 2013年05月02日 21:19, Harsh J 写道:
> If you've already run -delete (-move is a better choice if you know DN
> fault is temporary), then the missing blocks are already deleted from
> the namespace permanently. No way to recover the data since the blocks
> have also been invalidated by now.
>
> A HDFS Snapshots feature will arrive in near future to cover the
> backup scenarios that may prove useful in cases such as this.
>
>
> On Thu, May 2, 2013 at 6:23 PM, 段洪义 <duanhongyi@doopai.com
> <ma...@doopai.com>> wrote:
>
> Datanode error, and then I run hadoop fsck /-delete.Lost a lot of
> data,
> Later, these datanode recovery, Is there any way to restore the fsck
> command to delete the data.
>
>
>
>
> --
> Harsh J
Re: How to restore HDFS data
Posted by 段洪义 <du...@doopai.com>.
Thank you, I use rsync to backup every day, so I lost a day of data.
于 2013年05月02日 21:19, Harsh J 写道:
> If you've already run -delete (-move is a better choice if you know DN
> fault is temporary), then the missing blocks are already deleted from
> the namespace permanently. No way to recover the data since the blocks
> have also been invalidated by now.
>
> A HDFS Snapshots feature will arrive in near future to cover the
> backup scenarios that may prove useful in cases such as this.
>
>
> On Thu, May 2, 2013 at 6:23 PM, 段洪义 <duanhongyi@doopai.com
> <ma...@doopai.com>> wrote:
>
> Datanode error, and then I run hadoop fsck /-delete.Lost a lot of
> data,
> Later, these datanode recovery, Is there any way to restore the fsck
> command to delete the data.
>
>
>
>
> --
> Harsh J
Re: How to restore HDFS data
Posted by 段洪义 <du...@doopai.com>.
Thank you, I use rsync to backup every day, so I lost a day of data.
于 2013年05月02日 21:19, Harsh J 写道:
> If you've already run -delete (-move is a better choice if you know DN
> fault is temporary), then the missing blocks are already deleted from
> the namespace permanently. No way to recover the data since the blocks
> have also been invalidated by now.
>
> A HDFS Snapshots feature will arrive in near future to cover the
> backup scenarios that may prove useful in cases such as this.
>
>
> On Thu, May 2, 2013 at 6:23 PM, 段洪义 <duanhongyi@doopai.com
> <ma...@doopai.com>> wrote:
>
> Datanode error, and then I run hadoop fsck /-delete.Lost a lot of
> data,
> Later, these datanode recovery, Is there any way to restore the fsck
> command to delete the data.
>
>
>
>
> --
> Harsh J
Re: How to restore HDFS data
Posted by Harsh J <ha...@cloudera.com>.
If you've already run -delete (-move is a better choice if you know DN
fault is temporary), then the missing blocks are already deleted from the
namespace permanently. No way to recover the data since the blocks have
also been invalidated by now.
A HDFS Snapshots feature will arrive in near future to cover the backup
scenarios that may prove useful in cases such as this.
On Thu, May 2, 2013 at 6:23 PM, 段洪义 <du...@doopai.com> wrote:
> Datanode error, and then I run hadoop fsck /-delete.Lost a lot of data,
> Later, these datanode recovery, Is there any way to restore the fsck
> command to delete the data.
>
--
Harsh J
Re: How to restore HDFS data
Posted by Harsh J <ha...@cloudera.com>.
If you've already run -delete (-move is a better choice if you know DN
fault is temporary), then the missing blocks are already deleted from the
namespace permanently. No way to recover the data since the blocks have
also been invalidated by now.
A HDFS Snapshots feature will arrive in near future to cover the backup
scenarios that may prove useful in cases such as this.
On Thu, May 2, 2013 at 6:23 PM, 段洪义 <du...@doopai.com> wrote:
> Datanode error, and then I run hadoop fsck /-delete.Lost a lot of data,
> Later, these datanode recovery, Is there any way to restore the fsck
> command to delete the data.
>
--
Harsh J
Re: How to restore HDFS data
Posted by Harsh J <ha...@cloudera.com>.
If you've already run -delete (-move is a better choice if you know DN
fault is temporary), then the missing blocks are already deleted from the
namespace permanently. No way to recover the data since the blocks have
also been invalidated by now.
A HDFS Snapshots feature will arrive in near future to cover the backup
scenarios that may prove useful in cases such as this.
On Thu, May 2, 2013 at 6:23 PM, 段洪义 <du...@doopai.com> wrote:
> Datanode error, and then I run hadoop fsck /-delete.Lost a lot of data,
> Later, these datanode recovery, Is there any way to restore the fsck
> command to delete the data.
>
--
Harsh J
Re: How to restore HDFS data
Posted by Harsh J <ha...@cloudera.com>.
If you've already run -delete (-move is a better choice if you know DN
fault is temporary), then the missing blocks are already deleted from the
namespace permanently. No way to recover the data since the blocks have
also been invalidated by now.
A HDFS Snapshots feature will arrive in near future to cover the backup
scenarios that may prove useful in cases such as this.
On Thu, May 2, 2013 at 6:23 PM, 段洪义 <du...@doopai.com> wrote:
> Datanode error, and then I run hadoop fsck /-delete.Lost a lot of data,
> Later, these datanode recovery, Is there any way to restore the fsck
> command to delete the data.
>
--
Harsh J