You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/06/03 00:28:51 UTC

[jira] [Assigned] (SPARK-7743) Upgrade parquet dependency

     [ https://issues.apache.org/jira/browse/SPARK-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-7743:
-----------------------------------

    Assignee: Apache Spark

> Upgrade parquet dependency
> --------------------------
>
>                 Key: SPARK-7743
>                 URL: https://issues.apache.org/jira/browse/SPARK-7743
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Thomas Omans
>            Assignee: Apache Spark
>
> There are many outstanding issues with the parquet format that have been resolved between the version depended on by spark (1.6.0rc3 as of spark 1.3.1) and the most recent parquet release (1.6.0).
> Some of these are things include not supporting schema migration when using parquet with avro, not supporting summary metadata in the parquet footers causing null pointer exceptions reading, and many others.
> See https://github.com/apache/parquet-mr/blob/master/CHANGES.md#version-160 for the full list of fixes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org