You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Walter Su (JIRA)" <ji...@apache.org> on 2016/04/20 07:33:25 UTC

[jira] [Created] (HDFS-10316) revisit corrupt replicas count

Walter Su created HDFS-10316:
--------------------------------

             Summary: revisit corrupt replicas count
                 Key: HDFS-10316
                 URL: https://issues.apache.org/jira/browse/HDFS-10316
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Walter Su


A DN has 4 types of storages:
1. NORMAL
2. READ_ONLY
3. FAILED
4. (missing/pruned)

blocksMap.numNodes(blk) counts 1,2,3
blocksMap.getStorages(blk) counts 1,2,3

countNodes(blk).corruptReplicas() counts 1,2
corruptReplicas counts 1,2,3,4. Because findAndMarkBlockAsCorrupt(..) supports adding blk to the map even if the storage is not found.

The inconsistency causes bugs like HDFS-9958.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)