You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Matei Zaharia (JIRA)" <ji...@apache.org> on 2009/03/20 01:39:50 UTC

[jira] Updated: (HADOOP-4788) Set mapred.fairscheduler.assignmultiple to true by default

     [ https://issues.apache.org/jira/browse/HADOOP-4788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matei Zaharia updated HADOOP-4788:
----------------------------------

    Attachment: hadoop-4788-v0.patch

Here's a patch that fixes this. It leaves assignmultiple off in the unit tests for ease of testing however.

> Set mapred.fairscheduler.assignmultiple to true by default
> ----------------------------------------------------------
>
>                 Key: HADOOP-4788
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4788
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: contrib/fair-share
>            Reporter: Matei Zaharia
>            Priority: Trivial
>         Attachments: hadoop-4788-v0.patch
>
>
> Pretty much all users of the fair scheduler are using the "assignmultiple" feature which lets it launch reduce tasks at the same time as map tasks (on the same heartbeats), leading to reduces starting faster. This is also going to happen in Hadoop by default in HADOOP-3136. So we should set it to true by default and perhaps even remove the config parameter.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.