You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 08:30:00 UTC
[I] Fix write failure for Avro enum type [hudi]
hudi-bot opened a new issue, #16113:
URL: https://github.com/apache/hudi/issues/16113
When the input records have a enum field in the Avro schema, the write fails due to:
{code:java}
29542 [Executor task launch worker for task 2.0 in stage 35.0 (TID 56)] ERROR org.apache.hudi.io.HoodieCreateHandle [] - Error writing record HoodieRecord{key=HoodieKey { recordKey=09959033-0742-4638-aca4-44162efa4b27 partitionPath=2015/03/17}, currentLocation='null', newLocation='null'}
org.apache.avro.AvroRuntimeException: Unknown schema type: ENUM
at org.apache.hudi.avro.HoodieAvroUtils.rewritePrimaryType(HoodieAvroUtils.java:948) ~[classes/:?]
at org.apache.hudi.avro.HoodieAvroUtils.rewriteRecordWithNewSchemaInternal(HoodieAvroUtils.java:895) ~[classes/:?]
at org.apache.hudi.avro.HoodieAvroUtils.rewriteRecordWithNewSchema(HoodieAvroUtils.java:830) ~[classes/:?]
at org.apache.hudi.avro.HoodieAvroUtils.rewriteRecordWithNewSchemaInternal(HoodieAvroUtils.java:851) ~[classes/:?]
at org.apache.hudi.avro.HoodieAvroUtils.rewriteRecordWithNewSchema(HoodieAvroUtils.java:830) ~[classes/:?]
at org.apache.hudi.avro.HoodieAvroUtils.rewriteRecordWithNewSchema(HoodieAvroUtils.java:800) ~[classes/:?]
at org.apache.hudi.avro.HoodieAvroUtils.rewriteRecordWithNewSchema(HoodieAvroUtils.java:784) ~[classes/:?]
at org.apache.hudi.common.model.HoodieAvroRecord.prependMetaFields(HoodieAvroRecord.java:132) ~[classes/:?]
at org.apache.hudi.io.HoodieCreateHandle.doWrite(HoodieCreateHandle.java:144) ~[classes/:?]
at org.apache.hudi.io.HoodieWriteHandle.write(HoodieWriteHandle.java:182) ~[classes/:?]
at org.apache.hudi.execution.CopyOnWriteInsertHandler.consume(CopyOnWriteInsertHandler.java:98) ~[classes/:?]
at org.apache.hudi.execution.CopyOnWriteInsertHandler.consume(CopyOnWriteInsertHandler.java:42) ~[classes/:?]
at org.apache.hudi.common.util.queue.SimpleExecutor.execute(SimpleExecutor.java:68) ~[classes/:?]
at org.apache.hudi.execution.SparkLazyInsertIterable.computeNext(SparkLazyInsertIterable.java:80) ~[classes/:?]
at org.apache.hudi.execution.SparkLazyInsertIterable.computeNext(SparkLazyInsertIterable.java:39) ~[classes/:?]
at org.apache.hudi.client.utils.LazyIterableIterator.next(LazyIterableIterator.java:119) ~[classes/:?] {code}
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-6569
- Type: Bug
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Fix write failure for Avro enum type [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #16113:
URL: https://github.com/apache/hudi/issues/16113#issuecomment-4795536521
Closing as resolved. Tracked in [HUDI-6569](https://issues.apache.org/jira/browse/HUDI-6569). The change landed in PR [#9237](https://github.com/apache/hudi/pull/9237) (commit `4017b96fb1bf`). Please reopen if you can still reproduce on the latest release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Fix write failure for Avro enum type [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #16113: Fix write failure for Avro enum type
URL: https://github.com/apache/hudi/issues/16113
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Fix write failure for Avro enum type [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on issue #16113:
URL: https://github.com/apache/hudi/issues/16113#issuecomment-3630126500
### Linked PR(s)
- https://github.com/apache/hudi/pull/9237
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org