[jira] [Comment Edited] (PARQUET-1012) parquet-cpp and parquet-mr version parse inconsistent

["Xianjin YE (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PARQUET-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035787#comment-16035787 ] 

Xianjin YE edited comment on PARQUET-1012 at 6/3/17 3:52 AM:
-------------------------------------------------------------

[~mdeepak] I think this issued is fixed by PARQUET-349, but only in parquet-mr 1.9.
We may need to add a build hash to make parquet-mr 1.8.2(Spark 2.1) happy.


was (Author: advancedxy):
[~mdeepak] I think this issued is fixed by PARQUET-349, but only in parquet-mr 1.9.
We may need to add a build hash yo make parquet-mr 1.8.2(Spark 2.1) happy.

> parquet-cpp and parquet-mr version parse inconsistent
> -----------------------------------------------------
>
>                 Key: PARQUET-1012
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1012
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-cpp
>            Reporter: Xianjin YE
>            Assignee: Deepak Majeti
>
> Spark 2.1 uses parquet-mr(common) 1.8.2 which requires created_by to match certain pattern.  I found the following exception when using spark to read parquet file generated by parquet-cpp.
> 17/05/31 16:33:53 WARN CorruptStatistics: Ignoring statistics because created_by could not be parsed (see PARQUET-251): parquet-cpp version 1.0.0
> org.apache.parquet.VersionParser$VersionParseException: Could not parse created_by: parquet-cpp version 1.0.0 using format: (.+) version ((.*) )?\(build ?(.*)\)
> Proposal to fix this issue:  set created_by to the certain pattern.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)