[jira] [Updated] (HUDI-1694) Preparation for Avro update

["sivabalan narayanan (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan updated HUDI-1694:
--------------------------------------
        Parent: HUDI-2668
    Issue Type: Sub-task  (was: Task)

> Preparation for Avro update
> ---------------------------
>
>                 Key: HUDI-1694
>                 URL: https://issues.apache.org/jira/browse/HUDI-1694
>             Project: Apache Hudi
>          Issue Type: Sub-task
>          Components: Code Cleanup
>            Reporter: Sebastian Bernauer
>            Priority: Minor
>              Labels: pull-request-available
>
> We need to upgrade to at least Avro 1.9.x in production so i tried upgrading the avro version in the pom.xml of Hudi. Doing so i noticed some problems:
> Upgrade to Avro 1.9.2:
>  * Renamed method defaultValue to defaultVal
>  * Moved NullNode.getInstance() to JsonProperties.NULL_VALUE
>  * Avro complains about invalid schemas/default values in hudi-common/src/main/avro/
>  * The shaded guava libs from Avro have been removed
> Upgrade to Avro 1.10.1:
>  * Some more stuff (Not handled in this PR)
> Spark 3.2.0 (we currently use 3.1.1) will contain Avro 1.10.1 (https://issues.apache.org/jira/browse/SPARK-27733).
>  Ín order to reduce the effort switching to a newer Avro version in the future i provided a patch that fixes the above mentioned issues.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)