You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Weiwei Yang (Jira)" <ji...@apache.org> on 2020/12/11 20:34:00 UTC
[jira] [Comment Edited] (YUNIKORN-484) Handle the app completion in
the core side
[ https://issues.apache.org/jira/browse/YUNIKORN-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247690#comment-17247690 ]
Weiwei Yang edited comment on YUNIKORN-484 at 12/11/20, 8:33 PM:
-----------------------------------------------------------------
Hi [~wilfreds]
How we handle the placeholder cleanup when an app is completed?
We haven't covered the details, I just thought about this,
# when the core sees there are no pending ask and running containers, the app is moved to the "Waiting" state
# after a short period of time, the core moves the app to the "Competed" state
# before entering the "Complete" state, we probably need a "Completing" state.
# within Completing, the core will need to send {{UpdateResponse#AllocationRelease}} to the shim and ask the shim to release all placeholders
# when the core gets the confirmation from the shim, then transit the app to the "Complete" state
# the core sends the {{UpdateResponse#UpdatedApplications}} message to the shim to notify app completion
# the core deletes the app from the queues and the partition
is this workflow making sense to you or you have something else? Please let us know. cc [~Huang Ting Yao].
I suggest we use a separate ticket to handle the placeholder cleanup. Let's get the app completion handler done first.
was (Author: wwei):
Hi [~wilfreds]
How we handle the placeholder cleanup when an app is completed?
We haven't covered the details, I just thought about this,
# when the core sees there is no pending ask and running containers, it moves the app to the "Competed" state
# before entering the "Complete" state, we probably need a "Completing" state.
# within Completing, the core will need to send {{UpdateResponse#AllocationRelease}} to the shim and ask the shim to release all placeholders
# when the core gets the confirmation from the shim, then transit the app to the "Complete" state
# the core sends the {{UpdateResponse#UpdatedApplications}} message to the shim to notify app completion
# the core deletes the app from the queues and the partition
is this workflow making sense to you or you have something else? Please let us know. cc [~Huang Ting Yao].
I suggest we use a separate ticket to handle the placeholder cleanup. Let's get the app completion handler done first.
> Handle the app completion in the core side
> ------------------------------------------
>
> Key: YUNIKORN-484
> URL: https://issues.apache.org/jira/browse/YUNIKORN-484
> Project: Apache YuniKorn
> Issue Type: Sub-task
> Components: core - scheduler
> Reporter: Weiwei Yang
> Assignee: Wilfred Spiegelenburg
> Priority: Major
>
> Currently, if there is no pending ask or running container for an app, we transmit it to the "Waiting" state. To step further, we keep the "Waiting" state for a short period of time and then transit the state to "Completed".
> Before YUNIKORN-2 is done, this is to track the core side changes to do the state transition. When the app moves to the completed state, the core needs to send a "UpdateResponse#UpdatedApplication" so the shim can do proper cleanup.
> After YUNIKORN-2 is done, when the app is "Completed", core needs to ask the shim to release all the placeholder pods.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org