[jira] [Created] (HDDS-4553) ChunkInputStream should release buffer as soon as last byte in the buffer is read

["Hanisha Koneru (Jira)" <ji...@apache.org>]

Hanisha Koneru created HDDS-4553:
------------------------------------

             Summary: ChunkInputStream should release buffer as soon as last byte in the buffer is read
                 Key: HDDS-4553
                 URL: https://issues.apache.org/jira/browse/HDDS-4553
             Project: Hadoop Distributed Data Store
          Issue Type: Improvement
            Reporter: Shashikant Banerjee
            Assignee: Hanisha Koneru


We currently wait for reading up till the Chunk EOF before releasing the buffers in ChunkInputStream (or when the stream is closed). Let's say a client reads first 3 MB of a chunk  of size 4MB and does not close the stream immediately. This would lead to the 3MB of data being cached in the ChunkInputStream buffers till the stream is closed.

Once HDDS-4552 is resolved, a chunk read from DN would return the chunk data as an array of ByteBuffers. After each ByteBuffer is read, it can be released. This would greatly help with optimizing memory usage of ChunkInputStream.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org