You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2021/11/23 18:43:00 UTC

[jira] [Commented] (ARROW-14089) [C++] Read DELTA_BYTE_ARRAY data written with bug PARQUET-246

    [ https://issues.apache.org/jira/browse/ARROW-14089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17448212#comment-17448212 ] 

Antoine Pitrou commented on ARROW-14089:
----------------------------------------

Are such files still around? Otherwise we may not bother and spend development time on more useful tasks :)

> [C++] Read DELTA_BYTE_ARRAY data written with bug PARQUET-246
> -------------------------------------------------------------
>
>                 Key: ARROW-14089
>                 URL: https://issues.apache.org/jira/browse/ARROW-14089
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>            Reporter: Shan Huang
>            Priority: Major
>
> If a parquet file is written by parquet-mr before version 1.8.0, the bug [PARQUET-246|https://issues.apache.org/jira/browse/PARQUET-246] will produce data inconsistent with the encoding of DELTA_BYTE_ARRAY.
> There are two solutions:
> 1. We should update the read side to recover data written with this bug.
> 2. We need to throw an exception if the parquet file is written by parquet-mr before version 1.8.0 and has DELTA_BYTE_ARRAY encoding data.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)