[jira] [Commented] (YUNIKORN-998) expose gang related info in application REST info

["Wilfred Spiegelenburg (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YUNIKORN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502684#comment-17502684 ] 

Wilfred Spiegelenburg commented on YUNIKORN-998:
------------------------------------------------

This Jira is looking at exposing gang related info on the application (i.e names config etc). It does not look at the allocation and placeholder interaction.

Based on some questions in slack there is some clarification needed:
{quote}Do I have to send all the type TaskGroup struct information in the shim to core?
{quote}
What about a much simpler approach: when we add an ask to an application we pull out the placeholder information from the ask.
Add the detail based on the {{taskGroupName}} to the application if placeholder is {_}True{_}, we have the node already in {{requiredNode}}  and we know the MinResources also as that is the {{AllocatedResource}} of the ask. Other details are not really relevant 
{quote}stats on placeholder usage (optional)
{quote}
If we want to know how many placeholder for that task group we can keep a count which increases for every ask that mentioned the same task group name. A second counter {{replaced}} could be maintained for all placeholders that are replaced when the allocation is confirmed. We can store all that in a {{map[string]placeholderData}} the placeholderData can be a struct with string for node, resource for size and an int64 for the count and replaced for now.

As the last point to make: in the ApplicationDAOInfo we already expose all allocations. We just cannot distinguish between “normal” and “placeholder” allocations as we do not have that detail n the AllocationDAOInfo. So as soon as we add that detail in the allocation DAO we have fixed that gap too. We'll cover that under YUNIKORN-1087 as we make more changes to that object there.

> expose gang related info in application REST info
> -------------------------------------------------
>
>                 Key: YUNIKORN-998
>                 URL: https://issues.apache.org/jira/browse/YUNIKORN-998
>             Project: Apache YuniKorn
>          Issue Type: Improvement
>          Components: core - common
>            Reporter: Wilfred Spiegelenburg
>            Assignee: ted
>            Priority: Major
>
> None of the gang related information is exposed in the application REST info.
> We should add a new {{gang}} blob to the application that shows the following info:
>  * list of task groups with task group definitions
>  * list of allocated placeholders
>  * stats on placeholder usage (optional)



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org