You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Till Rohrmann (JIRA)" <ji...@apache.org> on 2018/09/28 09:41:00 UTC

[jira] [Closed] (FLINK-9455) Make SlotManager aware of multi slot TaskManagers

     [ https://issues.apache.org/jira/browse/FLINK-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Till Rohrmann closed FLINK-9455.
--------------------------------
      Resolution: Fixed
    Release Note: Flink now properly supports TaskExecutors with multiple slots. Consequently, TaskExecutors can now be started with an arbitrary number of slots and it is no longer recommended to start them with a single slot. 

Fixed via 771277b42427d55b52a28d5893c71c3b8de97807

> Make SlotManager aware of multi slot TaskManagers
> -------------------------------------------------
>
>                 Key: FLINK-9455
>                 URL: https://issues.apache.org/jira/browse/FLINK-9455
>             Project: Flink
>          Issue Type: Improvement
>          Components: Distributed Coordination, ResourceManager
>    Affects Versions: 1.5.0
>            Reporter: Till Rohrmann
>            Assignee: Till Rohrmann
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.7.0
>
>
> The {{SlotManager}} responsible for managing all available slots of a Flink cluster can request to start new {{TaskManagers}} if it cannot fulfill a slot request. The started {{TaskManager}} can be started with multiple slots configured but currently, the {{SlotManager}} thinks that it will be started with a single slot. As a consequence, it might issue multiple requests to start new TaskManagers even though a single one would be sufficient to fulfill all pending slot requests.
> In order to avoid requesting unnecessary resources which are freed after the idle timeout, I suggest to make the {{SlotManager}} aware of how many slots a {{TaskManager}} is started with. That way the SlotManager only needs to request a new {{TaskManager}} if all of the previously started slots (potentially not yet registered and, thus, future slots) are being assigned to slot requests.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)