You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Manikandan R (Jira)" <ji...@apache.org> on 2023/09/07 06:12:00 UTC
[jira] [Updated] (YUNIKORN-1943) [Yunikorn] Logging Enhancement for Quota Enforcement checks
[ https://issues.apache.org/jira/browse/YUNIKORN-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Manikandan R updated YUNIKORN-1943:
-----------------------------------
Description:
Hi Team,
Currently, there is indefinite logging when we have quota enforcement checks for max application. When the App or User is not satisfying the max application setting which was set in Yunikorn-Config we are observing indefinite logging of the below warning.
{code:java}
2023-08-31T07:32:25.922Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}
2023-08-31T07:32:25.922Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}
2023-08-31T07:32:26.023Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}
2023-08-31T07:32:26.023Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}{code}
The warning will keep coming in the logs until the pod/Application is either scheduled or removed.
{code:java}
{key:\"memory\" value:{value:50000000}} resources:{key:\"pods\" value:{value:1}} resources:{key:\"vcore\" value:{value:50}}}"}
2023-08-29T08:35:15.935Z WARN shim.context cache/context.go:952 task event is not published because task is not found {"appID": "830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a", "taskID": "testkk", "event": "type:REQUEST objectID:\"830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a\" message:\"Application testkk does not fit into root.default queue\" timestampNano:1693298115801596877 referenceID:\"testkk\" resource:{resources:{key:\"memory\" value:{value:50000000}} resources:{key:\"pods\" value:{value:1}} resources:{key:\"vcore\" value:{value:50}}}"}
2023-08-29T08:35:15.935Z WARN shim.context cache/context.go:952 task event is not published because task is not found {"appID": "830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a", "taskID": "testkk", "event": "type:REQUEST objectID:\"830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a\" message:\"Application testkk does not fit into root.default queue\" timestampNano:1693298115902320752 referenceID:\"testkk\" resource:{resources:{key:\"memory\" value:{value:50000000}} resources:{key:\"pods\" value:{value:1}} resources:{key:\"vcore\" value:{value:50}}}"} {code}
Also if you check the logs it's not very clearly formatted, Need some better formatting as well.
Please let me know if something is required.
was:
Hi Team,
Currently, there is indefinite logging when we have quota enforcement checks for max application. When the App or User is not satisfying the max application setting which was set in Yunikorn-Config we are observing indefinite logging of the below warning.
{code:java}
2023-08-31T07:32:25.922Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}
2023-08-31T07:32:25.922Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}
2023-08-31T07:32:26.023Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}
2023-08-31T07:32:26.023Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}{code}
The warning will keep coming in the logs until the pod/Application is either scheduled or removed.
{code:java}
{key:\"memory\" value:{value:50000000}} resources:{key:\"pods\" value:{value:1}} resources:{key:\"vcore\" value:{value:50}}}"}
2023-08-29T08:35:15.935Z WARN shim.context cache/context.go:952 task event is not published because task is not found {"appID": "830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a", "taskID": "testkk", "event": "type:REQUEST objectID:\"830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a\" message:\"Application testkk does not fit into root.default queue\" timestampNano:1693298115801596877 referenceID:\"testkk\" resource:{resources:{key:\"memory\" value:{value:50000000}} resources:{key:\"pods\" value:{value:1}} resources:{key:\"vcore\" value:{value:50}}}"}
2023-08-29T08:35:15.935Z WARN shim.context cache/context.go:952 task event is not published because task is not found {"appID": "830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a", "taskID": "testkk", "event": "type:REQUEST objectID:\"830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a\" message:\"Application testkk does not fit into root.default queue\" timestampNano:1693298115902320752 referenceID:\"testkk\" resource:{resources:{key:\"memory\" value:{value:50000000}} resources:{key:\"pods\" value:{value:1}} resources:{key:\"vcore\" value:{value:50}}}"} {code}
Also if you check the logs it's not very clearly formatted, Need some better formatting as well.
Build Yunikorn-1.3.1-b11
Please let me know if something is required.
> [Yunikorn] Logging Enhancement for Quota Enforcement checks
> -----------------------------------------------------------
>
> Key: YUNIKORN-1943
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1943
> Project: Apache YuniKorn
> Issue Type: Bug
> Components: shim - kubernetes
> Reporter: Rajesh Kanhaiya Lal
> Assignee: Manikandan R
> Priority: Minor
>
> Hi Team,
> Currently, there is indefinite logging when we have quota enforcement checks for max application. When the App or User is not satisfying the max application setting which was set in Yunikorn-Config we are observing indefinite logging of the below warning.
> {code:java}
> 2023-08-31T07:32:25.922Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}
> 2023-08-31T07:32:25.922Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}
> 2023-08-31T07:32:26.023Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}
> 2023-08-31T07:32:26.023Z WARN core.scheduler.ugm ugm/queue_tracker.go:428 can't run app as allowing new application to run would exceed configured max applications limit of specific user/group {"tracking type": 2, "queue path": "test3", "current running applications": 1, "max running applications": 1}{code}
> The warning will keep coming in the logs until the pod/Application is either scheduled or removed.
> {code:java}
> {key:\"memory\" value:{value:50000000}} resources:{key:\"pods\" value:{value:1}} resources:{key:\"vcore\" value:{value:50}}}"}
> 2023-08-29T08:35:15.935Z WARN shim.context cache/context.go:952 task event is not published because task is not found {"appID": "830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a", "taskID": "testkk", "event": "type:REQUEST objectID:\"830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a\" message:\"Application testkk does not fit into root.default queue\" timestampNano:1693298115801596877 referenceID:\"testkk\" resource:{resources:{key:\"memory\" value:{value:50000000}} resources:{key:\"pods\" value:{value:1}} resources:{key:\"vcore\" value:{value:50}}}"}
> 2023-08-29T08:35:15.935Z WARN shim.context cache/context.go:952 task event is not published because task is not found {"appID": "830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a", "taskID": "testkk", "event": "type:REQUEST objectID:\"830c91f6-d89b-4c2a-8e9a-5c9ece9fd83a\" message:\"Application testkk does not fit into root.default queue\" timestampNano:1693298115902320752 referenceID:\"testkk\" resource:{resources:{key:\"memory\" value:{value:50000000}} resources:{key:\"pods\" value:{value:1}} resources:{key:\"vcore\" value:{value:50}}}"} {code}
> Also if you check the logs it's not very clearly formatted, Need some better formatting as well.
> Please let me know if something is required.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org