You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 13:41:54 UTC

[I] Support file group reader-based compaction for MDT [hudi]

hudi-bot opened a new issue, #17321:
URL: https://github.com/apache/hudi/issues/17321

   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-8636
   - Type: Sub-task
   - Parent: https://issues.apache.org/jira/browse/HUDI-9107
   - Fix version(s):
     - 1.1.0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Support file group reader-based compaction for MDT [hudi]

Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #17321:
URL: https://github.com/apache/hudi/issues/17321#issuecomment-5365822929

   This issue was reviewed as part of the JIRA-migrated backlog triage (HUDI-8636).
   
   **Findings: not done, and it is blocked on a sibling.**
   
   The body is JIRA boilerplate only, and no reference to HUDI-8636 exists anywhere in the tree.
   
   Context that scopes the work: metadata-table reads now go through `HoodieFileGroupReader` / `HoodieLsmFileGroupReader`, but only for **key lookups** (`HoodieBackedTableMetadata:617`, `:629`, via PR #13544 under HUDI-9592). Compaction needs to read an entire file slice, and there is no such path - `readSliceAndFilterByKeysIntoList` returns early with an `EmptyIterator` when given no keys, with the comment *"otherwise, the hfile lookup will return all records"*.
   
   That full-file-slice read capability is exactly what #17393 (HUDI-9130) tracks, and it is still open. So this ticket cannot be implemented until that lands, and the two should be linked so it does not get picked up in the wrong order.
   
   Keeping this open.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org