You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Sean Busbey (Jira)" <ji...@apache.org> on 2021/12/07 18:33:00 UTC

[jira] [Updated] (HBASE-16247) SparkSQL Avro serialization doesn't handle enums correctly

     [ https://issues.apache.org/jira/browse/HBASE-16247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Busbey updated HBASE-16247:
--------------------------------
    Fix Version/s:     (was: hbase-connectors-1.0.1)
                       (was: 3.0.0-alpha-2)

> SparkSQL Avro serialization doesn't handle enums correctly
> ----------------------------------------------------------
>
>                 Key: HBASE-16247
>                 URL: https://issues.apache.org/jira/browse/HBASE-16247
>             Project: HBase
>          Issue Type: Bug
>          Components: hbase-connectors, spark
>    Affects Versions: 2.0.0
>            Reporter: Sean Busbey
>            Priority: Major
>
> Avro's generic api expects GenericEnumSymbol as the runtime type for instances of fields that are of Avro type ENUM. The Avro 1.7 libraries are lax in some cases for handling this, but the 1.8 libraries are strict. We should proactively fix our serialization.
> (the lax serialization in 1.7 fails for some nested use in unions, see AVRO-997 for details)



--
This message was sent by Atlassian Jira
(v8.20.1#820001)