You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 09:07:41 UTC

[I] Use FileGroupReader in table services [hudi]

hudi-bot opened a new issue, #16259:
URL: https://github.com/apache/hudi/issues/16259

   Table services such as compaction and clustering can read files using alternatives to the primary read path. All reading should go through the FileGroupReader
   
   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-6934
   - Type: Improvement
   - Epic: https://issues.apache.org/jira/browse/HUDI-6243
   - Fix version(s):
     - 1.1.0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Use FileGroupReader in table services [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #16259:
URL: https://github.com/apache/hudi/issues/16259#issuecomment-4795565441

   This appears to be addressed on `master` (targeted at fix version 1.1.0). Both table services now read through `HoodieFileGroupReader`:
   
   - **Compaction**: Standardized via [HUDI-8286] (#13411, commit `f8219428`) — `HoodieCompactor` now uses `FileGroupReaderBasedAppendHandle` and `FileGroupReaderBasedMergeHandle`. Flink compaction migrated in [HUDI-9147] (#13078) and [HUDI-9727] (#13734).
   - **Clustering**: Spark execution migrated in [HUDI-8552] (#12426) — `MultipleSparkJobExecutionStrategy` reads input file slices via `HoodieFileGroupReader`. Flink clustering followups via #13344.
   - **Stats / schema-on-read** for FG-reader based compaction/clustering tracked via [HUDI-8634] (#12586) and [HUDI-8635] (#13556).
   
   Closing as completed unless there are remaining call sites you'd like specifically tracked — please reopen with the specific path if so.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Use FileGroupReader in table services [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #16259: Use FileGroupReader in table services
URL: https://github.com/apache/hudi/issues/16259


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org