You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2025/02/01 05:11:02 UTC
[jira] [Updated] (HUDI-8660) Revisit ENUM handling in Spark parquet reader and writer
[ https://issues.apache.org/jira/browse/HUDI-8660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
sivabalan narayanan updated HUDI-8660:
--------------------------------------
Fix Version/s: 1.0.2
> Revisit ENUM handling in Spark parquet reader and writer
> --------------------------------------------------------
>
> Key: HUDI-8660
> URL: https://issues.apache.org/jira/browse/HUDI-8660
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Y Ethan Guo
> Priority: Blocker
> Fix For: 1.0.1, 1.0.2
>
>
> Spark Avro reader logic treats Avro ENUM type as String when converted to Spark StructType schema, which is converted back to Avro String type if it goes through Row to GenericRecord conversion. This is different from our previous logic where the record is directly read out as Avro GenericRecord.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)