You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Rajeshbabu Chintaguntla (Jira)" <ji...@apache.org> on 2022/09/12 17:40:00 UTC

[jira] [Created] (HBASE-27365) Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time

Rajeshbabu Chintaguntla created HBASE-27365:
-----------------------------------------------

             Summary: Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time
                 Key: HBASE-27365
                 URL: https://issues.apache.org/jira/browse/HBASE-27365
             Project: HBase
          Issue Type: Improvement
          Components: BucketCache
            Reporter: Rajeshbabu Chintaguntla
            Assignee: Rajeshbabu Chintaguntla


Currently in bucket cache asynchronous caching mechanism introduced where initially the blocks to be cached will be added to queue and writer threads consume the blocks from the queue and write to bucket cache. In case if block writing to bucket cache is slow then there is a chance that  queue of writer threads become full  and following block additions will be failed. In case of slower storages like s3 might introduce latencies even if we enable bigger sizes of bucket cache using ephemeral storages. So we can allow configurable wait time while adding blocks to queue so that chances of queue free up is possible during the wait time and block addition failures can be minimised.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)