You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Brandon Grams (Jira)" <ji...@apache.org> on 2022/12/01 20:10:00 UTC
[jira] [Comment Edited] (YUNIKORN-1440) Completed applications are indefinitely retained in-memory
[ https://issues.apache.org/jira/browse/YUNIKORN-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17642146#comment-17642146 ]
Brandon Grams edited comment on YUNIKORN-1440 at 12/1/22 8:09 PM:
------------------------------------------------------------------
With these changes, cleanup would become subject to the cleanupExpiredApps loop on an interval defined [here|https://github.com/apache/yunikorn-core/blob/339cc04bfe3dd9eedb386a6f040500d53bea8a46/pkg/scheduler/partition_manager.go#L32]. Apps are eventually expired after 3 days ([link|https://github.com/apache/yunikorn-core/blob/master/pkg/scheduler/objects/application.go#L48]), so worst case these will hang around for 4 days.
I'd love to externalize these parameters as we'd prefer the most aggressive setting possible. Will open separate tickets for those.
was (Author: JIRAUSER298471):
With these changes, cleanup would become subject to the cleanupExpiredApps loop on an interval defined [here|https://github.com/apache/yunikorn-core/blob/339cc04bfe3dd9eedb386a6f040500d53bea8a46/pkg/scheduler/partition_manager.go#L32]. Apps are eventually expired after 3 days ([link|https://github.com/apache/yunikorn-core/blob/master/pkg/scheduler/objects/application.go#L48]), so worst case these will hang around for 4 days.
I'd love to externalize these parameters as we'd prefer the most aggressive setting possible. Can open separate tickets for those.
> Completed applications are indefinitely retained in-memory
> ----------------------------------------------------------
>
> Key: YUNIKORN-1440
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1440
> Project: Apache YuniKorn
> Issue Type: Bug
> Components: core - scheduler
> Affects Versions: 1.1.0
> Reporter: Brandon Grams
> Assignee: Brandon Grams
> Priority: Major
> Labels: pull-request-available
>
> Terminated applications are not considered in the [expired apps cleanup procedure|https://github.com/apache/yunikorn-core/blob/c61511fe84a1ae211046aa58f156ac2185892e8f/pkg/scheduler/partition.go#L1425], leading to indefinite retention of application objects and eventual memory pressure in the scheduler.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org