[jira] [Created] (ARROW-15074) [C++] Support multiple frames in LZ4?

["Jorge Leitão (Jira)" <ji...@apache.org>]

Jorge Leitão created ARROW-15074:
------------------------------------

             Summary: [C++] Support multiple frames in LZ4?
                 Key: ARROW-15074
                 URL: https://issues.apache.org/jira/browse/ARROW-15074
             Project: Apache Arrow
          Issue Type: Improvement
            Reporter: Jorge Leitão
         Attachments: b.arrow

When reading an arrow file with buffers LZ4-compressed with multiple frames, we get

{code:java}
OSError: Lz4 compressed input contains more than one frame
{code}

Attached is an example of such a file, which can be opened with

{code:java}
import pyarrow.ipc
with pa.ipc.open_file("b.arrow") as reader:
    print(reader.get_batch(0))
{code}

that fails with the error above.

The LZ4 frame supports multiple frames and we do not refer that only one frame should be on a buffer as part of the spec.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)