You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Arun C Murthy (Issue Comment Edited) (JIRA)" <ji...@apache.org> on 2012/02/16 16:55:00 UTC

[jira] [Issue Comment Edited] (MAPREDUCE-3859) CapacityScheduler incorrectly utilizes extra-resources of queue for high-memory jobs

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209461#comment-13209461 ] 

Arun C Murthy edited comment on MAPREDUCE-3859 at 2/16/12 3:54 PM:
-------------------------------------------------------------------

Thanks, I'll run the test.

Also, maybe the fix would be better expressed as:

{code}
    int currentCapacity = max(queueSlotsOccupied, queueCapacity) + numSlotsRequested;
{code}    
                
      was (Author: acmurthy):
    Thanks, I'll run the test.

Also, maybe the fix would be better expressed as:

{code}
    int currentCapacity = min(queueSlotsOccupied, queueCapacity) + numSlotsRequested;
{code}    
                  
> CapacityScheduler incorrectly utilizes extra-resources of queue for high-memory jobs
> ------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3859
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3859
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/capacity-sched
>    Affects Versions: 1.0.0
>         Environment: CDH3u1
>            Reporter: Sergey Tryuber
>         Attachments: test-to-fail.patch.txt
>
>
> Imagine, we have a queue A with capacity 10 slots and 20 as extra-capacity, jobs which use 3 map slots will never consume more than 9 slots, regardless how many free slots on a cluster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira