You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Yingjie Cao (Jira)" <ji...@apache.org> on 2022/09/14 03:22:00 UTC
[jira] [Created] (FLINK-29299) Fix the network memory size calculation issue in fine-grained resource mode
Yingjie Cao created FLINK-29299:
-----------------------------------
Summary: Fix the network memory size calculation issue in fine-grained resource mode
Key: FLINK-29299
URL: https://issues.apache.org/jira/browse/FLINK-29299
Project: Flink
Issue Type: Improvement
Components: Runtime / Network
Affects Versions: 1.16.0
Reporter: Yingjie Cao
Fix For: 1.16.0
After FLINK-28663, one intermediate dataset can be consumed by multiple consumers, there is a case where one vertex can consume one intermediate dataset multiple times. However, currently in fine-grained resource mode, when computing the required network buffer size, the intermediate dataset is used as key to record the size of network buffer per input gate, which means it may allocate less network buffers than needed if two input gate of the same vertex consumes the same intermediate dataset.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)