You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Shahid Chohan (Jira)" <ji...@apache.org> on 2019/11/11 20:23:00 UTC
[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all
available registered TaskManagers
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971832#comment-16971832 ]
Shahid Chohan commented on FLINK-12122:
---------------------------------------
[~trohrmann] I noticed that you implemented `cluster.evenly-spread-out-slots`, but is there also a way to choose a random distribution? Also, does `cluster.evenly-spread-out-slots` give any weight to spreading out tasks from the same operator evenly? For example, one of my jobs would benefit from isolating the source subtasks from each other but I don't think I have a way to control that today.
> Spread out tasks evenly across all available registered TaskManagers
> --------------------------------------------------------------------
>
> Key: FLINK-12122
> URL: https://issues.apache.org/jira/browse/FLINK-12122
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
> Affects Versions: 1.6.4, 1.7.2, 1.8.0
> Reporter: Till Rohrmann
> Assignee: Till Rohrmann
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.10.0, 1.9.2
>
> Attachments: image-2019-05-21-12-28-29-538.png, image-2019-05-21-13-02-50-251.png
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> With Flip-6, we changed the default behaviour how slots are assigned to {{TaskManages}}. Instead of evenly spreading it out over all registered {{TaskManagers}}, we randomly pick slots from {{TaskManagers}} with a tendency to first fill up a TM before using another one. This is a regression wrt the pre Flip-6 code.
> I suggest to change the behaviour so that we try to evenly distribute slots across all available {{TaskManagers}} by considering how many of their slots are already allocated.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)