[jira] [Created] (HBASE-28840) Optimise memory utilisation retrieval of bucket-cache from persistence.

["Janardhan Hungund (Jira)" <ji...@apache.org>]

Janardhan Hungund created HBASE-28840:
-----------------------------------------

             Summary: Optimise memory utilisation retrieval of bucket-cache from persistence.
                 Key: HBASE-28840
                 URL: https://issues.apache.org/jira/browse/HBASE-28840
             Project: HBase
          Issue Type: Bug
          Components: BucketCache
            Reporter: Janardhan Hungund
            Assignee: Janardhan Hungund


During the persistence of bucket-cache backing map to a file, the backing map is divided into multiple smaller chunks and persisted to the file. This chunking avoids the high memory utilisation of during persistence, since only a small subset of backing map entries need to persisted in one chunk.

However, during the retrieval of the backing map during the server startup, we accumulate all these chunks into a list and then process each chunk to recreate the in-memory backing map. Since, all the chunks are fetched from the persistence file and then processed, the memory requirement is higher.

The retrieval of bucket-cache from persistence file can be optimised to enable the processing of one chunk at a time to avoid high memory utilisation.

Thanks,

Janardhan 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)