You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Runping Qi (JIRA)" <ji...@apache.org> on 2007/03/28 18:51:25 UTC

[jira] Created: (HADOOP-1173) Mapper fail rate increases significantly as the number of reduces increase

Mapper fail rate increases significantly as the number of reduces increase
--------------------------------------------------------------------------

                 Key: HADOOP-1173
                 URL: https://issues.apache.org/jira/browse/HADOOP-1173
             Project: Hadoop
          Issue Type: Bug
            Reporter: Runping Qi



I ran a large sort job, with about 8400 mappers.
In the first run, I used 301 reducers. About 600 mapper tasks failed.
In another run, I used 607 reducers. More than 3800 mapper tasks failed.



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-1173) Mapper fail rate increases significantly as the number of reduces increase

Posted by "Sameer Paranjpye (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sameer Paranjpye updated HADOOP-1173:
-------------------------------------

    Component/s: mapred
    Description: 
I ran a large sort job, with about 8400 mappers.
In the first run, I used 301 reducers. About 600 mapper tasks failed.
In another run, I used 607 reducers. More than 3800 mapper tasks failed.



  was:

I ran a large sort job, with about 8400 mappers.
In the first run, I used 301 reducers. About 600 mapper tasks failed.
In another run, I used 607 reducers. More than 3800 mapper tasks failed.




> Mapper fail rate increases significantly as the number of reduces increase
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-1173
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1173
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Runping Qi
>
> I ran a large sort job, with about 8400 mappers.
> In the first run, I used 301 reducers. About 600 mapper tasks failed.
> In another run, I used 607 reducers. More than 3800 mapper tasks failed.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.