You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@yunikorn.apache.org by "Craig Condit (Jira)" <ji...@apache.org> on 2021/08/19 15:03:00 UTC

[jira] [Created] (YUNIKORN-807) Improve performance of node sorting

Craig Condit created YUNIKORN-807:
-------------------------------------

             Summary: Improve performance of node sorting
                 Key: YUNIKORN-807
                 URL: https://issues.apache.org/jira/browse/YUNIKORN-807
             Project: Apache YuniKorn
          Issue Type: Improvement
          Components: core - scheduler
            Reporter: Craig Condit
            Assignee: Craig Condit
         Attachments: Node Sorting Performance Improvement.pdf

YuniKorn currently sorts all nodes on demand whenever scheduling of a container occurs. This causes significant performance degradation as the number of nodes increases.

If we replace the on-demand sorting with a B-Tree sorted proactively, we can improve performance considerably.

This is a similar approach to YUNIKORN-21, but without the associated behavioral changes.

I've attached a design document with the details of the approach and the performance improvement gained.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org