You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by ch huang <ju...@gmail.com> on 2014/05/29 02:34:42 UTC

how to save dead node when it's disk is full?

hi,maillist:
                 one of my datanode is full ,so dead in cluster ,how can i
do to let it live again?

Re: how to save dead node when it's disk is full?

Posted by Shumin Guo <gs...@gmail.com>.
If the datanode is dead, block replications will be re-replicated on other
datanodes automatically. So, after a while, when those blocks have been
re-replicated, you should be able to delete the data on the dead nodes and
restart it. Here, I am assuming your cluster have enough space on other
live nodes for the block replications.


On Wed, May 28, 2014 at 7:34 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                  one of my datanode is full ,so dead in cluster ,how can i
> do to let it live again?
>

Re: how to save dead node when it's disk is full?

Posted by ch huang <ju...@gmail.com>.
thanks for reply ,but my situaction is different , all the dead node disk
is full,i can not move data to another empty disk

On Thu, May 29, 2014 at 8:55 AM, Ted Yu <yu...@gmail.com> wrote:

> Cycling old bits:
>
> http://search-hadoop.com/m/uMDyU1bxBJS/datanode+disk+full&subj=Re+Disk+on+data+node+full
>
>
> On Wed, May 28, 2014 at 5:34 PM, ch huang <ju...@gmail.com> wrote:
>
>> hi,maillist:
>>                  one of my datanode is full ,so dead in cluster ,how can
>> i do to let it live again?
>>
>
>

Re: how to save dead node when it's disk is full?

Posted by ch huang <ju...@gmail.com>.
thanks for reply ,but my situaction is different , all the dead node disk
is full,i can not move data to another empty disk

On Thu, May 29, 2014 at 8:55 AM, Ted Yu <yu...@gmail.com> wrote:

> Cycling old bits:
>
> http://search-hadoop.com/m/uMDyU1bxBJS/datanode+disk+full&subj=Re+Disk+on+data+node+full
>
>
> On Wed, May 28, 2014 at 5:34 PM, ch huang <ju...@gmail.com> wrote:
>
>> hi,maillist:
>>                  one of my datanode is full ,so dead in cluster ,how can
>> i do to let it live again?
>>
>
>

Re: how to save dead node when it's disk is full?

Posted by ch huang <ju...@gmail.com>.
thanks for reply ,but my situaction is different , all the dead node disk
is full,i can not move data to another empty disk

On Thu, May 29, 2014 at 8:55 AM, Ted Yu <yu...@gmail.com> wrote:

> Cycling old bits:
>
> http://search-hadoop.com/m/uMDyU1bxBJS/datanode+disk+full&subj=Re+Disk+on+data+node+full
>
>
> On Wed, May 28, 2014 at 5:34 PM, ch huang <ju...@gmail.com> wrote:
>
>> hi,maillist:
>>                  one of my datanode is full ,so dead in cluster ,how can
>> i do to let it live again?
>>
>
>

Re: how to save dead node when it's disk is full?

Posted by ch huang <ju...@gmail.com>.
thanks for reply ,but my situaction is different , all the dead node disk
is full,i can not move data to another empty disk

On Thu, May 29, 2014 at 8:55 AM, Ted Yu <yu...@gmail.com> wrote:

> Cycling old bits:
>
> http://search-hadoop.com/m/uMDyU1bxBJS/datanode+disk+full&subj=Re+Disk+on+data+node+full
>
>
> On Wed, May 28, 2014 at 5:34 PM, ch huang <ju...@gmail.com> wrote:
>
>> hi,maillist:
>>                  one of my datanode is full ,so dead in cluster ,how can
>> i do to let it live again?
>>
>
>

Re: how to save dead node when it's disk is full?

Posted by Ted Yu <yu...@gmail.com>.
Cycling old bits:
http://search-hadoop.com/m/uMDyU1bxBJS/datanode+disk+full&subj=Re+Disk+on+data+node+full


On Wed, May 28, 2014 at 5:34 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                  one of my datanode is full ,so dead in cluster ,how can i
> do to let it live again?
>

Re: how to save dead node when it's disk is full?

Posted by Shumin Guo <gs...@gmail.com>.
If the datanode is dead, block replications will be re-replicated on other
datanodes automatically. So, after a while, when those blocks have been
re-replicated, you should be able to delete the data on the dead nodes and
restart it. Here, I am assuming your cluster have enough space on other
live nodes for the block replications.


On Wed, May 28, 2014 at 7:34 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                  one of my datanode is full ,so dead in cluster ,how can i
> do to let it live again?
>

Re: how to save dead node when it's disk is full?

Posted by Ted Yu <yu...@gmail.com>.
Cycling old bits:
http://search-hadoop.com/m/uMDyU1bxBJS/datanode+disk+full&subj=Re+Disk+on+data+node+full


On Wed, May 28, 2014 at 5:34 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                  one of my datanode is full ,so dead in cluster ,how can i
> do to let it live again?
>

Re: how to save dead node when it's disk is full?

Posted by Shumin Guo <gs...@gmail.com>.
If the datanode is dead, block replications will be re-replicated on other
datanodes automatically. So, after a while, when those blocks have been
re-replicated, you should be able to delete the data on the dead nodes and
restart it. Here, I am assuming your cluster have enough space on other
live nodes for the block replications.


On Wed, May 28, 2014 at 7:34 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                  one of my datanode is full ,so dead in cluster ,how can i
> do to let it live again?
>

Re: how to save dead node when it's disk is full?

Posted by Ted Yu <yu...@gmail.com>.
Cycling old bits:
http://search-hadoop.com/m/uMDyU1bxBJS/datanode+disk+full&subj=Re+Disk+on+data+node+full


On Wed, May 28, 2014 at 5:34 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                  one of my datanode is full ,so dead in cluster ,how can i
> do to let it live again?
>

Re: how to save dead node when it's disk is full?

Posted by Ted Yu <yu...@gmail.com>.
Cycling old bits:
http://search-hadoop.com/m/uMDyU1bxBJS/datanode+disk+full&subj=Re+Disk+on+data+node+full


On Wed, May 28, 2014 at 5:34 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                  one of my datanode is full ,so dead in cluster ,how can i
> do to let it live again?
>

Re: how to save dead node when it's disk is full?

Posted by Shumin Guo <gs...@gmail.com>.
If the datanode is dead, block replications will be re-replicated on other
datanodes automatically. So, after a while, when those blocks have been
re-replicated, you should be able to delete the data on the dead nodes and
restart it. Here, I am assuming your cluster have enough space on other
live nodes for the block replications.


On Wed, May 28, 2014 at 7:34 PM, ch huang <ju...@gmail.com> wrote:

> hi,maillist:
>                  one of my datanode is full ,so dead in cluster ,how can i
> do to let it live again?
>