You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2014/11/24 22:02:12 UTC

[jira] [Resolved] (SPARK-4522) Failure to read parquet schema with missing metadata.

     [ https://issues.apache.org/jira/browse/SPARK-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Armbrust resolved SPARK-4522.
-------------------------------------
    Resolution: Fixed

> Failure to read parquet schema with missing metadata.
> -----------------------------------------------------
>
>                 Key: SPARK-4522
>                 URL: https://issues.apache.org/jira/browse/SPARK-4522
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Michael Armbrust
>            Assignee: Michael Armbrust
>            Priority: Critical
>
> Our JSON parsing code is very strict and will fail, even if optional fields like metadata are missing.  This means that people who are reading parquet files written with code from between 1.1 and 1.2 might loose type information for no reason.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org