You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Shan Huang (Jira)" <ji...@apache.org> on 2021/09/23 09:40:00 UTC
[jira] [Created] (ARROW-14089) [C++] Correctly read
DELTA_BYTE_ARRAY data written with bug PARQUET-246
Shan Huang created ARROW-14089:
----------------------------------
Summary: [C++] Correctly read DELTA_BYTE_ARRAY data written with bug PARQUET-246
Key: ARROW-14089
URL: https://issues.apache.org/jira/browse/ARROW-14089
Project: Apache Arrow
Issue Type: Improvement
Reporter: Shan Huang
If a parquet file is written by parquet-mr before version 1.8.0, the bug [PARQUET-246|https://issues.apache.org/jira/browse/PARQUET-246] will produce data inconsistent with the encoding of DELTA_BYTE_ARRAY.
There are two solutions:
1. We should update the read side to recover data written with this bug.
2. We need to throw an exception if the parquet file is written by parquet-mr before version 1.8.0 and has DELTA_BYTE_ARRAY encoding data.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)