You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 08:07:02 UTC
[I] SparkMetadataTableRecordIndex does not support fix update partition path = true. [hudi]
hudi-bot opened a new issue, #16024:
URL: https://github.com/apache/hudi/issues/16024
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-6373
- Type: Bug
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SparkMetadataTableRecordIndex does not support fix update partition path = true. [hudi]
Posted by "deepakpanda93 (via GitHub)" <gi...@apache.org>.
deepakpanda93 commented on issue #16024:
URL: https://github.com/apache/hudi/issues/16024#issuecomment-4852133020
This is fixed as of Hudi 0.14.0.
Update-partition-path support was added to the record-level index in HUDI-6431 / [#9041](https://github.com/apache/hudi/pull/9041) ("Support update partition path in record-level index"), which introduced the hoodie.record.index.update.partition.path config — the RLI equivalent of hoodie.bloom.index.update.partition.path. Deletes handling when the partition path changes was fixed in HUDI-6467 / [#9114](https://github.com/apache/hudi/pull/9114). (The SparkMetadataTableRecordIndex class has since been refactored into HoodieRecordIndex.)
To use it: with hoodie.index.type=RECORD_INDEX, set hoodie.record.index.update.partition.path=true, and records whose partition value changes will be moved (deleted from the old partition, inserted into the new) rather than duplicated.
Both fixes are in 0.14.0 and all later releases including 1.x. Closing as fixed — please reopen if you still see incorrect behavior with hoodie.record.index.update.partition.path=true on a recent 1.x release. Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SparkMetadataTableRecordIndex does not support fix update partition path = true. [hudi]
Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #16024:
URL: https://github.com/apache/hudi/issues/16024#issuecomment-5031509592
This issue was reviewed as part of the JIRA-migrated backlog triage.
Findings: verified both fix PRs are merged - #9041 (HUDI-6431, merge commit 0a3a58ee, 2023-06-30) added record-level-index support for updating the partition path via hoodie.record.index.update.partition.path, and #9114 (HUDI-6467, merge commit c5b5953b) fixed delete handling in the RLI when the partition path changes. The config key is present on master at HoodieIndexConfig.java:248 and shipped in 0.14.0+. With hoodie.index.type=RECORD_INDEX and hoodie.record.index.update.partition.path=true, records whose partition value changes are moved rather than duplicated.
Issue is already closed, and correctly so.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SparkMetadataTableRecordIndex does not support fix update partition path = true. [hudi]
Posted by "deepakpanda93 (via GitHub)" <gi...@apache.org>.
deepakpanda93 closed issue #16024: SparkMetadataTableRecordIndex does not support fix update partition path = true.
URL: https://github.com/apache/hudi/issues/16024
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org