You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Eli Collins (JIRA)" <ji...@apache.org> on 2012/08/05 04:46:02 UTC

[jira] [Created] (HDFS-3764) Hadoop fsck reports files with blocks w/o live replicas as corrupt

Eli Collins created HDFS-3764:
---------------------------------

             Summary: Hadoop fsck reports files with blocks w/o live replicas as corrupt
                 Key: HDFS-3764
                 URL: https://issues.apache.org/jira/browse/HDFS-3764
             Project: Hadoop HDFS
          Issue Type: Bug
    Affects Versions: 2.0.0-alpha
            Reporter: Eli Collins


fsck calls FSN#listCorruptFileBlocks, this returns info for files where there's no live replicas, which doesn't necessarily indicate the file is "corrupt". Let's make fsck distinguish between:
- Blocks w/o any lives replicas (mostly the case when repl=1 and a DN goes down)
- Blocks where are live replicas are/were corrupt

Perhaps this could leverage the stats from HDFS-2554.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (HDFS-3764) Hadoop fsck reports files with blocks w/o live replicas as corrupt

Posted by "Andy Isaacson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andy Isaacson reassigned HDFS-3764:
-----------------------------------

    Assignee: Andy Isaacson
    
> Hadoop fsck reports files with blocks w/o live replicas as corrupt
> ------------------------------------------------------------------
>
>                 Key: HDFS-3764
>                 URL: https://issues.apache.org/jira/browse/HDFS-3764
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.0.0-alpha
>            Reporter: Eli Collins
>            Assignee: Andy Isaacson
>
> fsck calls FSN#listCorruptFileBlocks, this returns info for files where there's no live replicas, which doesn't necessarily indicate the file is "corrupt". Let's make fsck distinguish between:
> - Blocks w/o any lives replicas (mostly the case when repl=1 and a DN goes down)
> - Blocks where are live replicas are/were corrupt
> Perhaps this could leverage the stats from HDFS-2554.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira