You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Rahil Chertara (Jira)" <ji...@apache.org> on 2025/08/23 16:54:00 UTC

[jira] [Created] (HUDI-9739) Avoid using meta client in FGReader to avoid performance degradation

Rahil Chertara created HUDI-9739:
------------------------------------

             Summary: Avoid using meta client in FGReader to avoid performance degradation
                 Key: HUDI-9739
                 URL: https://issues.apache.org/jira/browse/HUDI-9739
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: Rahil Chertara


{*}Goal{*}: FGReader should take necessary information from the constructor/builder without having to do additional FS calls and scanning on the executor (e.g., loading table config, scanning timeline, reading schema, etc.) before reading the records.
 
Constructing meta client incurs loading table config, scanning timeline, reading schema, etc., which are very expensive operations, which must not happen per file group.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)