[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.0

["Chao Sun (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185293#comment-17185293 ] 

Chao Sun commented on SPARK-27733:
----------------------------------

bq. Apache Spark 3.0 will ship both Hive 1.2.1 built-in and Hive 2.3.6 built-in.

Do we still need to get this in Hive 1.2.1? it will be more promising for Hive 2.3.x once we have jenkins ready for the branch (see [PR|https://github.com/apache/hive/pull/1398]). Without CI it is hard to commit any change there.

> Upgrade to Avro 1.10.0
> ----------------------
>
>                 Key: SPARK-27733
>                 URL: https://issues.apache.org/jira/browse/SPARK-27733
>             Project: Spark
>          Issue Type: Improvement
>          Components: Build, SQL
>    Affects Versions: 3.1.0
>            Reporter: Ismaël Mejía
>            Priority: Minor
>
> Avro 1.9.2 was released with many nice features including reduced size (1MB less), and removed dependencies, no paranamer, no shaded guava, security updates, so probably a worth upgrade.
> Avro 1.10.0 was released and this is still not done.
> There is at the moment (2020/08) still a blocker because of Hive related transitive dependencies bringing older versions of Avro, so we could say that this is somehow still blocked until HIVE-21737 is solved.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org