You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Michael Heuer (JIRA)" <ji...@apache.org> on 2017/02/22 23:07:44 UTC

[jira] [Commented] (SPARK-16617) Upgrade to Avro 1.8.x

    [ https://issues.apache.org/jira/browse/SPARK-16617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15879431#comment-15879431 ] 

Michael Heuer commented on SPARK-16617:
---------------------------------------

Any thoughts as to what the Fix Version/s for this should be?

From what I can see Apache Spark git HEAD has already bumped to parquet version 1.8.2, and this may force the issue, since parquet 1.8.2 calls the new method Schema.getLogicalType not present in 1.7.x versions of avro.

> Upgrade to Avro 1.8.x
> ---------------------
>
>                 Key: SPARK-16617
>                 URL: https://issues.apache.org/jira/browse/SPARK-16617
>             Project: Spark
>          Issue Type: Improvement
>            Reporter: Ben McCann
>
> Avro 1.8 makes Avro objects serializable so that you can easily have an RDD containing Avro objects.
> See https://issues.apache.org/jira/browse/AVRO-1502



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org