You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "KWON BYUNGCHANG (Jira)" <ji...@apache.org> on 2021/08/26 04:52:00 UTC

[jira] [Created] (YARN-10899) controll whether non-exclusive allocation is used

KWON BYUNGCHANG created YARN-10899:
--------------------------------------

             Summary: controll whether non-exclusive allocation is used
                 Key: YARN-10899
                 URL: https://issues.apache.org/jira/browse/YARN-10899
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: KWON BYUNGCHANG


A non-exclusive partition has the advantage of increasing resource utilization.
But, it is not useful in all use cases.

In the case of a long-running container,
if it is allocated with non-exclusive allocation, it is more likely to be preempted and the overhead of repeating the same operation occurs.


A function that can control whether non-exclusive allocation is used from the user's point of view is required.

I suggest:
When node label expression is empty string, only default partition without non-exclusive partition is used,
when node label expression is null, only it allowed non-exclusive allocation.

I will attach patch.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org