You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xinli Shang (Jira)" <ji...@apache.org> on 2020/09/22 18:58:00 UTC

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.0

    [ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17200307#comment-17200307 ] 

Xinli Shang commented on SPARK-27733:
-------------------------------------

We talked about the Parquet 1.11.0 adoption in Spark in today's Parquet community sync meeting. The Parquet community would like to help if there is any way to move faster. [~csun][~smilegator][~dongjoon][~iemejia] and others, are you interested in joining our next Parquet meeting to brainstorm solutions to move forward? 

> Upgrade to Avro 1.10.0
> ----------------------
>
>                 Key: SPARK-27733
>                 URL: https://issues.apache.org/jira/browse/SPARK-27733
>             Project: Spark
>          Issue Type: Improvement
>          Components: Build, SQL
>    Affects Versions: 3.1.0
>            Reporter: Ismaël Mejía
>            Priority: Minor
>
> Avro 1.9.2 was released with many nice features including reduced size (1MB less), and removed dependencies, no paranamer, no shaded guava, security updates, so probably a worth upgrade.
> Avro 1.10.0 was released and this is still not done.
> There is at the moment (2020/08) still a blocker because of Hive related transitive dependencies bringing older versions of Avro, so we could say that this is somehow still blocked until HIVE-21737 is solved.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org