You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 03:35:55 UTC
[I] Refactor: Metadata various partitions payload merging using delegation pattern [hudi]
hudi-bot opened a new issue, #14672:
URL: https://github.com/apache/hudi/issues/14672
With the introduction of new partitions under metadata table, payload merging part needs to more organized - like merging for each partition type in its own payload class and the metadata table metadata payload class can just be a delegator.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-3323
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-1822
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Refactor: Metadata various partitions payload merging using delegation pattern [hudi]
Posted by "deepakpanda93 (via GitHub)" <gi...@apache.org>.
deepakpanda93 commented on issue #14672:
URL: https://github.com/apache/hudi/issues/14672#issuecomment-4893279054
This issue was reviewed as part of the JIRA-migrated backlog triage.
Findings: This delegation refactor was implemented by #11597 ([HUDI-7692] Extract metadata record type to MetadataPartitionType enum, merged 2024-08-06, shipped in 1.0.0). HoodieMetadataPayload no longer carries the monolithic per-type merge logic — its preCombine now delegates via `MetadataPartitionType.get(type).combineMetadataPayloads(previousRecord, this)`, and each partition type (FILES, COLUMN_STATS, BLOOM_FILTERS, RECORD_INDEX, SECONDARY_INDEX, ...) implements its own `combineMetadataPayloads` override. This removed ~315 lines of inline `switch(type)` code from the payload class, making it a delegator exactly as proposed here.
If you're still hitting this on a recent version, please reopen with details.
Closing as fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Refactor: Metadata various partitions payload merging using delegation pattern [hudi]
Posted by "deepakpanda93 (via GitHub)" <gi...@apache.org>.
deepakpanda93 closed issue #14672: Refactor: Metadata various partitions payload merging using delegation pattern
URL: https://github.com/apache/hudi/issues/14672
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Refactor: Metadata various partitions payload merging using delegation pattern [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on issue #14672:
URL: https://github.com/apache/hudi/issues/14672#issuecomment-3593826586
This issue belongs to a closed JIRA Epic: https://issues.apache.org/jira/browse/HUDI-1822
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org