[jira] [Commented] (SLIDER-955) fail to track the outstandingRequest when submit an application that yarn.memory is not a multiple of minimum-allocation-mb

["Steve Loughran (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SLIDER-955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14984356#comment-14984356 ] 

Steve Loughran commented on SLIDER-955:
---------------------------------------

I don't think that'll work, as its just a bool. But you have pointed me at the area which includes {{ResourceCalculator.normalize()}}, which looks like it is exactly what we want. 

We'll need to create a normalized resource template for cancel requests, and use that as the basis for new allocation requests; something like
# include minimum resource values in app state construction
# build this with a modified {{AppState.buildResourceRequirements(}}
# put into {{RoleStatus}} at setup/modified resources.json events
# copy for new resource/cancel requests

> fail to track the outstandingRequest when submit an application that yarn.memory is not a multiple of minimum-allocation-mb
> ---------------------------------------------------------------------------------------------------------------------------
>
>                 Key: SLIDER-955
>                 URL: https://issues.apache.org/jira/browse/SLIDER-955
>             Project: Slider
>          Issue Type: Improvement
>          Components: appmaster
>    Affects Versions: Slider 0.80
>            Reporter: kyungwan nam
>
> "yarn.scheduler.minimum-allocation-mb” is set to 256 in my cluster.
> I submit an application that “yarn.memory” is set to 7169 (not a multiple of 256)
> the resource of allocated container will be 7424(256*29) memory because the resource requirement is normalized to a multiple of "yarn.scheduler.minimum-allocation-mb” by RM.
> the resource requirement of outstandingRequest that is tracked by Slider AM does not match the resource of the allocated container.
> therefore, Slider AM can’t clean up the outstandingRequest and requests in AMRMClient.
> I think it should fix as following 1 or 2
> 1. an application should be able to submit only if “yarn.memory” is a multiple of "yarn.scheduler.minimum-allocation-mb”
> 2. the resource requirement of outstandingRequest is normalized to a multiple of "yarn.scheduler.minimum-allocation-mb”



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)