You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Wilfred Spiegelenburg (Jira)" <ji...@apache.org> on 2023/06/08 07:24:00 UTC
[jira] [Updated] (YUNIKORN-1777) State initialisation simplification (recovery)
[ https://issues.apache.org/jira/browse/YUNIKORN-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wilfred Spiegelenburg updated YUNIKORN-1777:
--------------------------------------------
Issue Type: Task (was: Improvement)
> State initialisation simplification (recovery)
> ----------------------------------------------
>
> Key: YUNIKORN-1777
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1777
> Project: Apache YuniKorn
> Issue Type: Task
> Components: core - scheduler, shim - kubernetes
> Reporter: Wilfred Spiegelenburg
> Assignee: Craig Condit
> Priority: Critical
>
> Startup rebuilds all state of the cluster. This is called recovery. The name is a bit misleading as it is not really recovery as it is loading the current state. State initialisation is a better term to use.
> The current recovery code links the loading of applications and tasks (pods) to node loading. This makes the recovery code complex and thus fragile. It could, in a worst case scenario, lead to a pod not being recovered correctly.
> Recovery should be a step by step process that has boundaries and steps:
> * load node
> ** register nodes with the core
> * load pods
> ** create applications in core
> ** register running pods as allocations with the core
> ** register pending pods as asks with the core
> * process changes for nodes and pods
> * start scheduling
> No nodes, applications or asks on existing apps should be declined. Even if the queue does not exist a running application must be added and handled. The current rejection of an application if it cannot be placed in the queue is an incorrect behaviour.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org