You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Weijie Guo (Jira)" <ji...@apache.org> on 2023/03/23 03:25:00 UTC

[jira] [Commented] (FLINK-31498) DeclartiveSlotManager always request redundant task manager when resource is not enough

    [ https://issues.apache.org/jira/browse/FLINK-31498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703850#comment-17703850 ] 

Weijie Guo commented on FLINK-31498:
------------------------------------

Thanks [~huwh] for reporting this, you are assigned.

> DeclartiveSlotManager always request redundant task manager when resource is not enough
> ---------------------------------------------------------------------------------------
>
>                 Key: FLINK-31498
>                 URL: https://issues.apache.org/jira/browse/FLINK-31498
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Coordination
>            Reporter: Weihua Hu
>            Assignee: Weihua Hu
>            Priority: Major
>         Attachments: image-2023-03-17-18-05-43-088.png
>
>
> Currently redundant task manager check in DeclarativeSlotManager only compare free slots with required redundant slots. 
> when there are no enough resources in YARN/Kubernetes, this mechanism will always try to request new task manager. 
> there are two way to address this.
> 1. maintain the state of redundant workers to avoid request twice
> 2. only try to request redundant workers when there is no pending worker
> The first way will make the logic of redundant worker too complicated, I would like to choose the second way
> Looking forward to any suggestion.
>  !image-2023-03-17-18-05-43-088.png! 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)