You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 10:51:12 UTC
[I] Clustering with spark records does not work for bootstrap tables with partition columns not written to files [hudi]
hudi-bot opened a new issue, #16660:
URL: https://github.com/apache/hudi/issues/16660
Spark readers will read as UnsafeRow. When we try to add in the partition column values, an UnsupportedOperationException will be thrown because updateValue is not supported for UnsafeRow.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-8318
- Type: Bug
- Fix version(s):
- 1.1.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Clustering with spark records does not work for bootstrap tables with partition columns not written to files [hudi]
Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #16660:
URL: https://github.com/apache/hudi/issues/16660#issuecomment-5066293895
This issue was reviewed as part of the JIRA-migrated backlog triage.
Confirmed as a valid, still-open bug (HUDI-8318). Root cause: for bootstrap tables whose partition columns are not written into the base files, clustering with the Spark record merger reads rows as `UnsafeRow`, and injecting the partition-column values calls `updateValue`, which `UnsafeRow` does not support, throwing `UnsupportedOperationException`. This is a child of HUDI-8317 (Spark record / merger gaps).
No fix has merged yet (the target fixVersion 1.1.0 is not yet released). Fix scope touches the row-copy / partition-value injection path in the file group reader, which is larger than a local patch. Tracking as `stream:fix` (clustering + bootstrap). Keeping open.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org