You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Shan Huang (Jira)" <ji...@apache.org> on 2021/09/23 09:40:00 UTC

[jira] [Updated] (ARROW-14089) [C++] Read DELTA_BYTE_ARRAY data written with bug PARQUET-246

     [ https://issues.apache.org/jira/browse/ARROW-14089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shan Huang updated ARROW-14089:
-------------------------------
    Summary: [C++] Read DELTA_BYTE_ARRAY data written with bug PARQUET-246  (was: [C++] Correctly read DELTA_BYTE_ARRAY data written with bug PARQUET-246)

> [C++] Read DELTA_BYTE_ARRAY data written with bug PARQUET-246
> -------------------------------------------------------------
>
>                 Key: ARROW-14089
>                 URL: https://issues.apache.org/jira/browse/ARROW-14089
>             Project: Apache Arrow
>          Issue Type: Improvement
>            Reporter: Shan Huang
>            Priority: Major
>
> If a parquet file is written by parquet-mr before version 1.8.0, the bug [PARQUET-246|https://issues.apache.org/jira/browse/PARQUET-246] will produce data inconsistent with the encoding of DELTA_BYTE_ARRAY.
> There are two solutions:
> 1. We should update the read side to recover data written with this bug.
> 2. We need to throw an exception if the parquet file is written by parquet-mr before version 1.8.0 and has DELTA_BYTE_ARRAY encoding data.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)