You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Chris Douglas (JIRA)" <ji...@apache.org> on 2008/12/03 10:51:44 UTC

[jira] Updated: (HADOOP-4699) Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in Reduce

     [ https://issues.apache.org/jira/browse/HADOOP-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Douglas updated HADOOP-4699:
----------------------------------

    Attachment: 4699-0.patch

Removes the checksum validation from MapOutputServlet

> Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in Reduce
> -----------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-4699
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4699
>             Project: Hadoop Core
>          Issue Type: Improvement
>            Reporter: Chris Douglas
>            Assignee: Chris Douglas
>             Fix For: 0.20.0
>
>         Attachments: 4699-0.patch
>
>
> Instead of validating the checksum of the IFile segment in MapOutputServlet, validation may be left to the reduce. While failures may not be detected until late in the reduce, the throughput and CPU improvements should make up for it in the average case.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.