You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Shuo Cheng (Jira)" <ji...@apache.org> on 2025/05/27 12:22:00 UTC

[jira] [Updated] (HUDI-9469) Refactor getting hoodieRecord iterator for file group reader

     [ https://issues.apache.org/jira/browse/HUDI-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shuo Cheng updated HUDI-9469:
-----------------------------
    Description: Currently, `getClosableHoodieRecordIterator` and `getClosableKeyIterator` will incur redundant record conversion from `BufferedRecord` <--> engine record. We can make a minor refactor to get the iterator more efficiently, e.g., providing a method `getBufferedRecordIterator`, then implement `getClosableIterator`, `getClosableHoodieRecordIterator` and `getClosableKeyIterator` based on it.  (was: Currently, `getClosableHoodieRecordIterator` and `getClosableKeyIterator` will incur redundant record conversion from `BufferedRecord` <--> engine record. We can make some minor refactor to get the iterator more efficiently, e.g., providing an method `getBufferedRecordIterator`, then implement `getClosableIterator`, `getClosableHoodieRecordIterator` and `getClosableKeyIterator` based on it.)

> Refactor getting hoodieRecord iterator for file group reader
> ------------------------------------------------------------
>
>                 Key: HUDI-9469
>                 URL: https://issues.apache.org/jira/browse/HUDI-9469
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: core
>            Reporter: Shuo Cheng
>            Assignee: Shuo Cheng
>            Priority: Minor
>             Fix For: 1.1.0
>
>
> Currently, `getClosableHoodieRecordIterator` and `getClosableKeyIterator` will incur redundant record conversion from `BufferedRecord` <--> engine record. We can make a minor refactor to get the iterator more efficiently, e.g., providing a method `getBufferedRecordIterator`, then implement `getClosableIterator`, `getClosableHoodieRecordIterator` and `getClosableKeyIterator` based on it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)