You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Lohit Vijayarenu (JIRA)" <ji...@apache.org> on 2008/08/20 19:27:16 UTC

[jira] Commented: (HADOOP-3980) SecondaryNameNode should validate the downloaded files.

    [ https://issues.apache.org/jira/browse/HADOOP-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12624059#action_12624059 ] 

Lohit Vijayarenu commented on HADOOP-3980:
------------------------------------------

We saw a case where local disk was corrupt and we were unable to read edits from the disk. We used to hit Input/Output error while reading the edits midway. SecondaryNameNode pulls fsimage,edits and it has to make sure we got all of the bytes. One way is to make sure the file size matches as expected. 

> SecondaryNameNode should validate the downloaded files.
> -------------------------------------------------------
>
>                 Key: HADOOP-3980
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3980
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.19.0
>            Reporter: Lohit Vijayarenu
>             Fix For: 0.19.0
>
>
> SecondaryNameNode should make sure it has downloaded complete edits/fsimage files before starting merge.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.