You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Deepak Majeti (JIRA)" <ji...@apache.org> on 2017/06/13 18:18:00 UTC
[jira] [Resolved] (PARQUET-1012) parquet-cpp and parquet-mr version
parse inconsistent
[ https://issues.apache.org/jira/browse/PARQUET-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Deepak Majeti resolved PARQUET-1012.
------------------------------------
Resolution: Fixed
Fix Version/s: 1.9.0
> parquet-cpp and parquet-mr version parse inconsistent
> -----------------------------------------------------
>
> Key: PARQUET-1012
> URL: https://issues.apache.org/jira/browse/PARQUET-1012
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-cpp
> Reporter: Xianjin YE
> Assignee: Deepak Majeti
> Fix For: 1.9.0
>
>
> Spark 2.1 uses parquet-mr(common) 1.8.2 which requires created_by to match certain pattern. I found the following exception when using spark to read parquet file generated by parquet-cpp.
> 17/05/31 16:33:53 WARN CorruptStatistics: Ignoring statistics because created_by could not be parsed (see PARQUET-251): parquet-cpp version 1.0.0
> org.apache.parquet.VersionParser$VersionParseException: Could not parse created_by: parquet-cpp version 1.0.0 using format: (.+) version ((.*) )?\(build ?(.*)\)
> Proposal to fix this issue: set created_by to the certain pattern.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)