You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Tony Xintong Song (JIRA)" <ji...@apache.org> on 2019/06/10 03:45:00 UTC
[jira] [Updated] (FLINK-12765) Bookkeeping of available resources
of allocated slots in SlotPool.
[ https://issues.apache.org/jira/browse/FLINK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tony Xintong Song updated FLINK-12765:
--------------------------------------
Summary: Bookkeeping of available resources of allocated slots in SlotPool. (was: JobMaster calculates resource needs and requests slot for the entire slot sharing group.)
> Bookkeeping of available resources of allocated slots in SlotPool.
> ------------------------------------------------------------------
>
> Key: FLINK-12765
> URL: https://issues.apache.org/jira/browse/FLINK-12765
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
> Affects Versions: 1.8.0, 1.9.0
> Reporter: Tony Xintong Song
> Assignee: Yun Gao
> Priority: Major
> Fix For: 1.9.0
>
>
> In this version, a task will always requests slot with its own resource need. If the resource need is less than the default slot resource, it will always be allocated to a default sized slot.
>
> The extra resources in the slot leaves chances for other tasks within the same slot sharing group to fit in. To take these chance, SlotPool will maintain available resources of each allocated slot. Available resource of an allocated slot should always be the total resource of the slot minus resources of tasks already assigned onto the slot. In this way, the SlotPool would be able to determine whether another task can fit into the slot. If a task cannot fit into the slot, for slot sharing group the SlotPool should request another slot from the ResourceManager, and for colocation group it should fail the job.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)