You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2022/09/13 15:44:00 UTC

[jira] [Assigned] (HUDI-4806) Use Avro version from root pom file for Flink bundle

     [ https://issues.apache.org/jira/browse/HUDI-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo reassigned HUDI-4806:
-------------------------------

    Assignee: Shawn Chang

> Use Avro version from root pom file for Flink bundle
> ----------------------------------------------------
>
>                 Key: HUDI-4806
>                 URL: https://issues.apache.org/jira/browse/HUDI-4806
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Shawn Chang
>            Assignee: Shawn Chang
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.12.1
>
>
> In pom of flink bundle it specifically defines avro 1.10.0 as its dependency, but this will cause conflicts with some avro generated classes if the project was built with spark3 profile which uses avro 1.11.0.
> Example exception:
> {{}}
> {code:java}
> Caused by: java.lang.NoSuchMethodError: org.apache.hudi.org.apache.avro.specific.SpecificRecordBuilderBase.<init>(Lorg/apache/hudi/org/apache/avro/Schema;Lorg/apache/hudi/org/apache/avro/specific/SpecificData;)V{code}
> {{}}
>  
> We should make avro version consistent across the whole project
>  
> Also, in flink bundle we are shading avro version so it doesn't matter which avro Flink is using.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)