[jira] [Resolved] (RATIS-2213) Memory leak of DataStreamMapImpl when Streaming write

["Tsz-wo Sze (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/RATIS-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz-wo Sze resolved RATIS-2213.
-------------------------------
    Fix Version/s: 3.3.1
       Resolution: Fixed

The pull request is now merged.  Thanks, [~rich7420]!

> Memory leak of DataStreamMapImpl when Streaming write
> -----------------------------------------------------
>
>                 Key: RATIS-2213
>                 URL: https://issues.apache.org/jira/browse/RATIS-2213
>             Project: Ratis
>          Issue Type: Bug
>          Components: Streaming
>            Reporter: ChenXi
>            Assignee: Huang Kuan Hao
>            Priority: Critical
>             Fix For: 3.3.1
>
>         Attachments: image-2024-12-17-16-44-13-020.png, image-2024-12-17-17-03-19-819.png, image-2024-12-17-17-03-24-737.png
>
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> h2. Phenomenon
> During our online test of Streaming writing, we found some memory leaks. When a DN write traffic exceeds 1GB/s ~ 2GB/s, Netty's Direct memory will continue to grow.
> h2. Version
> Ozone-1.4.1 based internal  build, use the Ratis version 3.1.1
> h2. Reproduce Way
> To reproduce the DataStreamMapImpl#map and DataStreamManagement#streams leaks.
> For the detail we can refer to https://issues.apache.org/jira/browse/HDDS-11939
> h2. screenshot
> Direct memory increase
> !image-2024-12-17-16-44-13-020.png!
> This is a mat analysis of a memory dump of a DN long after it has stopped writing.
> !image-2024-12-17-17-03-19-819.png!
> !image-2024-12-17-17-03-24-737.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)