You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Yutong Xiao (Jira)" <ji...@apache.org> on 2022/01/18 12:06:00 UTC

[jira] [Created] (HBASE-26681) Introduce a little RAMBuffer for bucketcache to reduce gc and improve throughput

Yutong Xiao created HBASE-26681:
-----------------------------------

             Summary: Introduce a little RAMBuffer for bucketcache to reduce gc and improve throughput
                 Key: HBASE-26681
                 URL: https://issues.apache.org/jira/browse/HBASE-26681
             Project: HBase
          Issue Type: Improvement
          Components: BucketCache, Performance
            Reporter: Yutong Xiao
            Assignee: Yutong Xiao
             Fix For: 1.7.2


In branch-1, BucketCache just allocate new onheap bytebuffer to construct new HFileBlock when get cached blocks. This rough allocation increases the GC pressure for those "hot" blocks. 
Here introduce a RAMBuffer for those "hot" blocks in BucketCache. The thought is simple. The RAMBuffer is an timeout expiring cache. When a Multi-level block is read twice, we cache it in the RAMBuffer. When the block timeout in the cache (e.g. 60s), that means the block is not being accessed in 60s, we evict it. Not like LRU, we do not cache block when the whole RAMBuffer size reaches to a threshold (to fit different workload, the threshold is dynamic). This will prevent the RAMBuffer from being churned.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)