You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Chris Douglas (JIRA)" <ji...@apache.org> on 2008/09/29 23:44:44 UTC

[jira] Commented: (HADOOP-4302) TestReduceFetch fails intermittently

    [ https://issues.apache.org/jira/browse/HADOOP-4302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12635549#action_12635549 ] 

Chris Douglas commented on HADOOP-4302:
---------------------------------------

The test is nondeterministic; though it sets mapred.inmem.merge.threshold to 2, the third may be fetched, closed, and included in the in-memory merge. In this case, all the outputs will be merged to disk. The test should probably set mapred.reduce.parallel.copies to 1 to avoid the race, here. Off-by-n misses on mapred.inmem.merge.threshold aren't a real bug, not even for the final outputs; it's a heuristic, not a contract.

> TestReduceFetch fails intermittently
> ------------------------------------
>
>                 Key: HADOOP-4302
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4302
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: Devaraj Das
>            Assignee: Chris Douglas
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: 0J5g5b71.html.part
>
>
> I see TestReduceFetch failing once in a while. Here is one such failure 
> http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3350/testReport/org.apache.hadoop.mapred/TestReduceFetch/testReduceFromPartialMem/
> Marking this as a blocker until we get to the root cause.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.