You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Yingjie Cao (Jira)" <ji...@apache.org> on 2022/09/14 03:22:00 UTC

[jira] [Created] (FLINK-29299) Fix the network memory size calculation issue in fine-grained resource mode

Yingjie Cao created FLINK-29299:
-----------------------------------

             Summary: Fix the network memory size calculation issue in fine-grained resource mode
                 Key: FLINK-29299
                 URL: https://issues.apache.org/jira/browse/FLINK-29299
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Network
    Affects Versions: 1.16.0
            Reporter: Yingjie Cao
             Fix For: 1.16.0


After FLINK-28663, one intermediate dataset can be consumed by multiple consumers, there is a case where one vertex can consume one intermediate dataset multiple times. However, currently in fine-grained resource mode, when computing the required network buffer size, the intermediate dataset is used as key to record the size of network buffer per input gate, which means it may allocate less network buffers than needed if two input gate of the same vertex consumes the same intermediate dataset.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)