You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Sergio Peña (JIRA)" <ji...@apache.org> on 2015/09/23 17:54:04 UTC

[jira] [Created] (PARQUET-378) Add thoroughly parquet test encodings

Sergio Peña created PARQUET-378:
-----------------------------------

             Summary: Add thoroughly parquet test encodings
                 Key: PARQUET-378
                 URL: https://issues.apache.org/jira/browse/PARQUET-378
             Project: Parquet
          Issue Type: Test
          Components: parquet-mr
    Affects Versions: 1.8.0
            Reporter: Sergio Peña
            Assignee: Sergio Peña


PARQUET-246 highlighted the need to have more thorough validation of the Parquet encodings. With the 2.0 encodings as high priority, we need to validate each encoding with its spec (and ensure there is a spec). 

We also need to add a suite of validations that are used for all encodings that test:
- Writing multiple pages (v1 and v2 pages) and multiple row groups
- Validating that each page can be read individually or with last-to-first page order and has the correct set of values (would have caught PARQUET-246).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)