You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by ch huang <ju...@gmail.com> on 2013/11/18 10:06:21 UTC

what is different between CorruptBlocks and MissingBlocks in NN FSNamesystem metrics?

hi,all:

          CorruptBlocks  is "Number of blocks with corrupt replicas" ,but
the MissingBlocks is also from
this.neededReplications.getCorruptBlockSize() ,any difference?

Re: what is different between CorruptBlocks and MissingBlocks in NN FSNamesystem metrics?

Posted by ch huang <ju...@gmail.com>.
thank you !

On Mon, Nov 18, 2013 at 11:48 PM, Kihwal Lee <ki...@yahoo-inc.com> wrote:

> Missing blocks are the blocks with no valid replicas. I.e. data is not
> available. Corrupt blocks are the ones with at least one corrupt replica.
> They may have healthy live replicas that are not corrupt, which can be read
> by users or replicated by the system to replace the corrupt replicas.
>  "Missing blocks" is a subset of "Corrupt blocks".
>
> Kihwal
>
>
>
> On Monday, November 18, 2013 3:07 AM, ch huang <ju...@gmail.com>
> wrote:
>
> hi,all:
>
>           CorruptBlocks  is "Number of blocks with corrupt replicas" ,but
> the MissingBlocks is also from
> this.neededReplications.getCorruptBlockSize() ,any difference?
>

Re: what is different between CorruptBlocks and MissingBlocks in NN FSNamesystem metrics?

Posted by Kihwal Lee <ki...@yahoo-inc.com>.
Missing blocks are the blocks with no valid replicas. I.e. data is not available. Corrupt blocks are the ones with at least one corrupt replica. They may have healthy live replicas that are not corrupt, which can be read by users or replicated by the system to replace the corrupt replicas.  "Missing blocks" is a subset of "Corrupt blocks".

Kihwal 



On Monday, November 18, 2013 3:07 AM, ch huang <ju...@gmail.com> wrote:
 
hi,all:

          CorruptBlocks  is "Number of blocks with corrupt replicas" ,but
the MissingBlocks is also from
this.neededReplications.getCorruptBlockSize() ,any difference?