You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Weijie Guo (Jira)" <ji...@apache.org> on 2023/03/27 09:01:00 UTC

[jira] [Updated] (FLINK-31626) HsSubpartitionFileReaderImpl should recycle skipped read buffers.

     [ https://issues.apache.org/jira/browse/FLINK-31626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Weijie Guo updated FLINK-31626:
-------------------------------
    Description: In FLINK-30189, {{HsSubpartitionFileReaderImpl}} will skip the buffer has been consumed from memory to avoid double-consumption. But these buffers were not returned to the {{BatchShuffleReadBufferPool}}, resulting in read buffer leaks. In addition, all loaded buffers should also be recycled after data view released.  (was: In FLINK-30189, {{HsSubpartitionFileReaderImpl}} will skip the buffer has been consumed from memory to avoid double-consumption. But these buffers were not returned to the {{BatchShuffleReadBufferPool}}, resulting in read buffer leaks.)

> HsSubpartitionFileReaderImpl should recycle skipped read buffers.
> -----------------------------------------------------------------
>
>                 Key: FLINK-31626
>                 URL: https://issues.apache.org/jira/browse/FLINK-31626
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Network
>    Affects Versions: 1.17.1
>            Reporter: Weijie Guo
>            Assignee: Weijie Guo
>            Priority: Major
>
> In FLINK-30189, {{HsSubpartitionFileReaderImpl}} will skip the buffer has been consumed from memory to avoid double-consumption. But these buffers were not returned to the {{BatchShuffleReadBufferPool}}, resulting in read buffer leaks. In addition, all loaded buffers should also be recycled after data view released.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)