You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2015/06/04 21:13:38 UTC

[jira] [Resolved] (SPARK-7743) Upgrade Parquet to 1.7

     [ https://issues.apache.org/jira/browse/SPARK-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Reynold Xin resolved SPARK-7743.
--------------------------------
       Resolution: Fixed
    Fix Version/s: 1.5.0

> Upgrade Parquet to 1.7
> ----------------------
>
>                 Key: SPARK-7743
>                 URL: https://issues.apache.org/jira/browse/SPARK-7743
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>            Reporter: Thomas Omans
>             Fix For: 1.5.0
>
>
> There are many outstanding issues with the parquet format that have been resolved between the version depended on by spark (1.6.0rc3 as of spark 1.3.1) and the most recent parquet release (1.6.0).
> Some of these are things include not supporting schema migration when using parquet with avro, not supporting summary metadata in the parquet footers causing null pointer exceptions reading, and many others.
> See https://github.com/apache/parquet-mr/blob/master/CHANGES.md#version-160 for the full list of fixes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org