[jira] [Commented] (YUNIKORN-876) Optimize scheduler memory consumption

["Weiwei Yang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YUNIKORN-876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444075#comment-17444075 ] 

Weiwei Yang commented on YUNIKORN-876:
--------------------------------------

hi [~Yukali] could you pls check if this is still an issue after YUNIKORN-872? In YUNIKORN-872, we have changed the way of implementing predicates, which might remove some deepCopy from the code (I haven't checked, pls take a look). Pls take a look and let me know your findings. thanks!

> Optimize scheduler memory consumption 
> --------------------------------------
>
>                 Key: YUNIKORN-876
>                 URL: https://issues.apache.org/jira/browse/YUNIKORN-876
>             Project: Apache YuniKorn
>          Issue Type: Improvement
>          Components: core - cache, shim - kubernetes
>            Reporter: Weiwei Yang
>            Assignee: Chen Yu Teng
>            Priority: Critical
>              Labels: performance
>         Attachments: profile001.pdf
>
>
> On a cluster with about 500 nodes, we've seen the memory consumption goes over 12GB. This is not optimal. Using http://yunikorn.apache.org/docs/next/performance/profiling#memory-profiling, we got the memory footprint dump as attached in the JIRA. We need to optimize resource consumption and reduce the memory usage. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org