You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Konstantin Shvachko (JIRA)" <ji...@apache.org> on 2006/03/24 11:42:28 UTC

[jira] Updated: (HADOOP-95) dfs validation

     [ http://issues.apache.org/jira/browse/HADOOP-95?page=all ]

Konstantin Shvachko updated HADOOP-95:
--------------------------------------

    Attachment: TestReadFS.java
                IOMapperAdapter.java
                AccumulatingReducer.java

This map-reduce test reads all blocks of all files, and detects which of them are missing or corrupted.
See HADOOP-101 discussion.


> dfs validation
> --------------
>
>          Key: HADOOP-95
>          URL: http://issues.apache.org/jira/browse/HADOOP-95
>      Project: Hadoop
>         Type: Improvement
>   Components: dfs
>     Versions: 0.1
>     Reporter: Hairong Kuang
>  Attachments: AccumulatingReducer.java, IOMapperAdapter.java, TestReadFS.java
>
> Dfs needs a validation operation similiar to fsck, so that we get to know the files that are corrupted and which data blocks are missing.
> Dfs namenode also needs to log more specific information such as which block is replication or is deleted. So when something goes wrong, we have a clue what has happened.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira