You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Kevin Peterson (JIRA)" <ji...@apache.org> on 2009/10/20 01:52:59 UTC

[jira] Updated: (MAPREDUCE-698) Per-pool task limits for the fair scheduler

     [ https://issues.apache.org/jira/browse/MAPREDUCE-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kevin Peterson updated MAPREDUCE-698:
-------------------------------------

    Attachment: MAPREDUCE-698-prelim.patch

Attached patch works for me, but I think I need to make some changes for interaction with the multiple-assign before it's ready to commit. Patch is relative to 0.20 branch.

It allows two new fields in the pools definition, "maxMaps" and "maxReduces".

My need for this is interacting with outside services (in this case, an HBase cluster that's significantly smaller than my Hadoop cluster).

> Per-pool task limits for the fair scheduler
> -------------------------------------------
>
>                 Key: MAPREDUCE-698
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-698
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: contrib/fair-share
>            Reporter: Matei Zaharia
>             Fix For: 0.21.0
>
>         Attachments: MAPREDUCE-698-prelim.patch
>
>
> The fair scheduler could use a way to cap the share of a given pool similar to MAPREDUCE-532.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.