You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Raghu Angadi (JIRA)" <ji...@apache.org> on 2008/10/01 01:59:44 UTC

[jira] Commented: (HADOOP-4314) TestReplication fails quite often

    [ https://issues.apache.org/jira/browse/HADOOP-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12635911#action_12635911 ] 

Raghu Angadi commented on HADOOP-4314:
--------------------------------------


This affects only simulated datanodes.

When a SimulatedDataNode sends block report, it includes the blocks that are currently being written. The reported size of such blocks is the default blocks size (64MB). NameNode assumes it is a real block. When the datanodes report the block when the writing finishes, NameNode rejects those blocks unless the size is same as 64MB. This bug always existed but only since 0.18, NameNode started rejecting blocks that are smaller than largest size reported by any datanode. Even replication attempts fail.

The fix is to exclude blocks that are not "finalized" at the datanode in the block report from simulated datanodes. I will attach a patch.

> TestReplication fails quite often
> ---------------------------------
>
>                 Key: HADOOP-4314
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4314
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs, test
>    Affects Versions: 0.18.0
>            Reporter: Raghu Angadi
>            Assignee: Raghu Angadi
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: TestReplication.txt
>
>
> TestReplication times out once every 5-6 attempts. I will attach log from a failed test.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.