You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Weiwei Yang (Jira)" <ji...@apache.org> on 2021/09/17 22:20:00 UTC
[jira] [Resolved] (YUNIKORN-847) Use resource weighting for node
sorting
[ https://issues.apache.org/jira/browse/YUNIKORN-847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Weiwei Yang resolved YUNIKORN-847.
----------------------------------
Fix Version/s: 1.0.0
Resolution: Fixed
> Use resource weighting for node sorting
> ---------------------------------------
>
> Key: YUNIKORN-847
> URL: https://issues.apache.org/jira/browse/YUNIKORN-847
> Project: Apache YuniKorn
> Issue Type: Improvement
> Components: core - scheduler
> Reporter: Craig Condit
> Assignee: Craig Condit
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
>
> After YUNIKORN-807, node sorting uses a scoring algorithm which uses the largest resource share to determine priority. However, resource units are not taken into account, and consequently, either fair or binpacking tends to look almost exclusively at the largest absolute values for units. In some environments this can lead to priority inversions.
> We should instead calculate in-use percentages for each resource, and then weight them to arrive at an overall usage percentage, which can then be used for scoring. Weights can be controlled at the partition level.
> Configuration is as follows:
> {code:java}
> partitions:
> - name: default
> nodesortpolicy:
> type: fair
> resourceweights:
> vcore: 4.0
> memory: 1.0
> queues:
> - name: root
> submitacl: '*'
> {code}
> In this example, *vcore* is weighted double what memory is. If *resourceweights* is not specified, the configuration is equivalent to:
> {code}
> { vcore: 1, memory: 1}
> {code}
>
> For example, in the default configuration, if a node has 60% of its vcores in use, and 20% of its memory in use, node usage would be calculated at 40% using equal weights. In the example given above, usage would be calculated as 52%.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org