You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ratis.apache.org by "ChenXi (Jira)" <ji...@apache.org> on 2024/12/17 08:57:00 UTC
[jira] [Updated] (RATIS-2213) Memory leak of DataStreamMapImpl when Streaming write
[ https://issues.apache.org/jira/browse/RATIS-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ChenXi updated RATIS-2213:
--------------------------
Description:
h2. Phenomenon
During our online test of Streaming writing, we found some memory leaks. When a DN write traffic exceeds 1GB/s ~ 2GB/s, Netty's Direct memory will continue to grow.
h2. Version
Ozone-1.4.1 based internal build, use the Ratis version 3.1.1
h2. Reproduce Way
I found two ways to reproduce the DataStreamMapImpl#
map and DataStreamManagement#streams leaks.
For the detail we can refer to https://issues.apache.org/jira/browse/HDDS-11939
h2. screenshot
!image-2024-12-17-16-44-13-020.png!
!image-2024-12-15-22-21-26-187.png|width=993,height=758!
!image-2024-12-15-21-14-27-612.png!
was:
h2. Phenomenon
During our online test of Streaming writing, we found some memory leaks. When a DN write traffic exceeds 1GB/s ~ 2GB/s, Netty's Direct memory will continue to grow.
h2. Version
Ozone-1.4.1 based internal build, use the Ratis version 3.1.1
h2. Reproduce Way
I found two ways to reproduce the DataStreamMapImpl#
map and DataStreamManagement#streams leaks.
For the detail we can refer to https://issues.apache.org/jira/browse/HDDS-11939
h2. screenshot
!image-2024-12-17-16-44-13-020.png!
!image-2024-12-15-22-21-26-187.png!
!image-2024-12-15-21-14-27-612.png!
> Memory leak of DataStreamMapImpl when Streaming write
> -----------------------------------------------------
>
> Key: RATIS-2213
> URL: https://issues.apache.org/jira/browse/RATIS-2213
> Project: Ratis
> Issue Type: Bug
> Components: Streaming
> Reporter: ChenXi
> Priority: Critical
> Attachments: image-2024-12-17-16-44-13-020.png
>
>
> h2. Phenomenon
> During our online test of Streaming writing, we found some memory leaks. When a DN write traffic exceeds 1GB/s ~ 2GB/s, Netty's Direct memory will continue to grow.
> h2. Version
> Ozone-1.4.1 based internal build, use the Ratis version 3.1.1
> h2. Reproduce Way
> I found two ways to reproduce the DataStreamMapImpl#
> map and DataStreamManagement#streams leaks.
> For the detail we can refer to https://issues.apache.org/jira/browse/HDDS-11939
> h2. screenshot
> !image-2024-12-17-16-44-13-020.png!
>
>
>
> !image-2024-12-15-22-21-26-187.png|width=993,height=758!
>
> !image-2024-12-15-21-14-27-612.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)