You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Andrew Kyle Purtell (Jira)" <ji...@apache.org> on 2022/06/16 17:48:00 UTC

[jira] [Resolved] (HBASE-9102) HFile block pre-loading for large sequential scan

     [ https://issues.apache.org/jira/browse/HBASE-9102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Kyle Purtell resolved HBASE-9102.
----------------------------------------
      Assignee:     (was: Liyin Tang)
    Resolution: Incomplete

> HFile block pre-loading for large sequential scan
> -------------------------------------------------
>
>                 Key: HBASE-9102
>                 URL: https://issues.apache.org/jira/browse/HBASE-9102
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.89-fb
>            Reporter: Liyin Tang
>            Priority: Major
>
> The current HBase scan model cannot take full advantage of the aggrediate disk throughput, especially for the large sequential scan cases. And for the large sequential scan, it is easy to predict what the next block to read in advance so that it can pre-load and decompress/decoded these data blocks from HDFS into block cache right before the current read point. 
> Therefore, this jira is to optimized the large sequential scan performance by pre-loading the HFile blocks into the block cache in a stream fashion so that the scan query can read from the cache directly.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)