[jira] [Commented] (YARN-10617) Fifo and Fair intra-queue preemption goes on indefinitely when apps are in pending state due to max AM limit reached

["VADAGA ANANYO RAO (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17281513#comment-17281513 ] 

VADAGA ANANYO RAO commented on YARN-10617:
------------------------------------------

Hi [~leftnoteasy] [~sunilg] , could you please review this jira? The fix is in proportional capacity preemption logic.

Basically, instead of considering all apps for preemption, we only consider apps which are schedulable by the scheduling logic we are using.

cc: [~epayne]

Thanks.

> Fifo and Fair intra-queue preemption goes on indefinitely when apps are in pending state due to max AM limit reached
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-10617
>                 URL: https://issues.apache.org/jira/browse/YARN-10617
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: capacity scheduler
>    Affects Versions: 3.1.1
>            Reporter: VADAGA ANANYO RAO
>            Assignee: VADAGA ANANYO RAO
>            Priority: Major
>         Attachments: YARN-10617.patch
>
>
> This case occurs when:
> 1. an application gets submitted in a cluster running at max-AM limit.
> 2. The new job requests AM resource. So it has 1 pending request.
> 3. To fulfil this request, the preemption logic preempts 1 resource from a running app.
> 4. Because the cluster is at max-AM limit, the scheduler re-assigns the preempted container back to the running app.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org