You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2025/08/05 03:34:00 UTC

[jira] [Updated] (HUDI-7219) Implement storage and HFile block cache in the same JVM

     [ https://issues.apache.org/jira/browse/HUDI-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinoth Chandar updated HUDI-7219:
---------------------------------
    Description: 
Goal and impact: reading HFile using the same Avro HFile reader instance is faster

Approach:
* Reuse the HFile reader instance in Avro HFile reader
* Cache HFile blocks that have been read in the same HFile reader
* Control size of HFile blocks to cache, use LRU algorithm to evict cached data

> Implement storage and HFile block cache in the same JVM
> -------------------------------------------------------
>
>                 Key: HUDI-7219
>                 URL: https://issues.apache.org/jira/browse/HUDI-7219
>             Project: Apache Hudi
>          Issue Type: New Feature
>            Reporter: Ethan Guo (this is the old account; please use "yihua")
>            Assignee: Ethan Guo (this is the old account; please use "yihua")
>            Priority: Blocker
>             Fix For: 1.1.0
>
>
> Goal and impact: reading HFile using the same Avro HFile reader instance is faster
> Approach:
> * Reuse the HFile reader instance in Avro HFile reader
> * Cache HFile blocks that have been read in the same HFile reader
> * Control size of HFile blocks to cache, use LRU algorithm to evict cached data



--
This message was sent by Atlassian Jira
(v8.20.10#820010)