You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 13:41:38 UTC
[I] Support bootstrap files in file group reader-based compaction [hudi]
hudi-bot opened a new issue, #17320:
URL: https://github.com/apache/hudi/issues/17320
testMetadataBootstrapMORPartitionedInlineCompactionOn fails with file group reader-based compaction (HoodieSparkMergeHandleV2). Currently if the compaction plan and operations contain bootstrap files, the compaction goes through the old flow using the regular HoodieMergeHandle. We should support bootstrap files in file group reader-based compaction in HoodieSparkMergeHandleV2.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-8632
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-9107
- Fix version(s):
- 1.1.0
---
## Comments
22/Jan/25 05:52;yihua;Found another issue: HUDI-8896. Right now reading partition columns for bootstrapped table (bootstrap skeleton + data file) relies on engine-specific handling, not in the file group reader. So compaction and clustering using the file group reader to read out records from metadata-only bootstrapped table can encounter nulls in the partition columns, causing the new base file written to have nulls in the partition columns.;;;
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support bootstrap files in file group reader-based compaction [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on issue #17320:
URL: https://github.com/apache/hudi/issues/17320#issuecomment-3630296138
### Linked PR(s)
- https://github.com/apache/hudi/pull/12490
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support bootstrap files in file group reader-based compaction [hudi]
Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #17320:
URL: https://github.com/apache/hudi/issues/17320#issuecomment-4900630249
This issue was reviewed as part of the JIRA-migrated backlog triage.
Findings: this describes an incomplete feature, not a bug. Currently supported: the file group reader can read bootstrap tables, and partition-column reading for bootstrapped tables was added via HUDI-8896 (#13223, merged). Pending: wiring bootstrap-file support into file-group-reader-based compaction/clustering (HoodieSparkMergeHandleV2) - PR #12490 is in flight (open, unmerged); until it lands, compaction with bootstrap files falls back to the legacy HoodieMergeHandle.
Keeping open. Will be scoped into a future feature-completion effort.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org