You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Yingjie Cao (Jira)" <ji...@apache.org> on 2021/03/15 06:38:00 UTC

[jira] [Created] (FLINK-21790) Shuffle data directories to make data directory section of different TaskManagers fairer

Yingjie Cao created FLINK-21790:
-----------------------------------

             Summary: Shuffle data directories to make data directory section of different TaskManagers fairer
                 Key: FLINK-21790
                 URL: https://issues.apache.org/jira/browse/FLINK-21790
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Network
            Reporter: Yingjie Cao
             Fix For: 1.13.0


Currently, different TaskManagers select data directory in the same order and if there are multiple disk, some disks may stores more data than others which is bad for performance. A simple improvement is that each TaskManager shuffles the given data directories randomly and select the data directory in different order.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)