[jira] [Created] (ARROW-5915) [C++] [Python] Set up testing for backwards compatibility of the parquet reader

["Joris Van den Bossche (JIRA)" <ji...@apache.org>]

Joris Van den Bossche created ARROW-5915:
--------------------------------------------

             Summary: [C++] [Python] Set up testing for backwards compatibility of the parquet reader
                 Key: ARROW-5915
                 URL: https://issues.apache.org/jira/browse/ARROW-5915
             Project: Apache Arrow
          Issue Type: Test
          Components: C++, Python
            Reporter: Joris Van den Bossche


Given the recent parquet compat problems, we should have better testing for this.

For easy testing of backwards compatibility, we could add some files (with different types) written with older versions, add them to /pyarrow/tests/data/parquet (we already have some files from 0.7 there) and ensure they are read correctly with the current version.

Similarly as what Kartothek is doing: https://github.com/JDASoftwareGroup/kartothek/tree/master/reference-data/arrow-compat





--
This message was sent by Atlassian JIRA
(v7.6.14#76016)