You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Yingjie Cao (Jira)" <ji...@apache.org> on 2020/12/24 04:00:00 UTC

[jira] [Created] (FLINK-20758) Use region file mechanism for shuffle data reading before we switch to managed memory

Yingjie Cao created FLINK-20758:
-----------------------------------

             Summary: Use region file mechanism for shuffle data reading before we switch to managed memory
                 Key: FLINK-20758
                 URL: https://issues.apache.org/jira/browse/FLINK-20758
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Network
    Affects Versions: 1.12.0
            Reporter: Yingjie Cao
             Fix For: 1.12.2


FLINK-15981 implemented region file based data reader to solve the direct memory OOM issue introduced by usage of unmanaged direct memory, however only for BoundedBlockingResultPartition. We can introduce it to sort-merge based blocking shuffle to avoid the similar direct memory OOM problem which can improve the usability a lot.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)