You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2021/01/18 12:58:00 UTC
[jira] [Updated] (ARROW-11301) [C++] Fix reading LZ4-compressed
Parquet files produced by Java Parquet implementation
[ https://issues.apache.org/jira/browse/ARROW-11301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Antoine Pitrou updated ARROW-11301:
-----------------------------------
Description:
We slightly misunderstood the Hadoop LZ4 format. A compressed buffer can actually contain several "frames", each prefixed with (de)compressed size.
See https://issues.apache.org/jira/browse/ARROW-9177?focusedCommentId=17267058&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17267058
was:See https://issues.apache.org/jira/browse/ARROW-9177?focusedCommentId=17267058&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17267058
> [C++] Fix reading LZ4-compressed Parquet files produced by Java Parquet implementation
> --------------------------------------------------------------------------------------
>
> Key: ARROW-11301
> URL: https://issues.apache.org/jira/browse/ARROW-11301
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Reporter: Antoine Pitrou
> Assignee: Antoine Pitrou
> Priority: Blocker
> Fix For: 3.0.0
>
>
> We slightly misunderstood the Hadoop LZ4 format. A compressed buffer can actually contain several "frames", each prefixed with (de)compressed size.
> See https://issues.apache.org/jira/browse/ARROW-9177?focusedCommentId=17267058&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17267058
--
This message was sent by Atlassian Jira
(v8.3.4#803005)