[GitHub] [arrow] nevi-me commented on pull request #9137: ARROW-8676: [Rust] IPC RecordBatch body compression

[GitBox <gi...@apache.org>]

nevi-me commented on pull request #9137:
URL: https://github.com/apache/arrow/pull/9137#issuecomment-756815481


   For anyone who understands how LZ4 works, I need some help.
   I'm able to read LZ4 compressed data written in Python from Rust, but I get an error when trying to read a file written by the Rust writer from `pyarrow`.
   
   The error that I'm getting is:
   
   ```
   OSError: Lz4 compressed input contains more than one frame
   ```
   
   To reproduce the error, please:
   1. Run the `arrow` unit tests, so that a compressed file is created.
   2. Run the below to read the file in `pyarrow`
   
   ```python
   import pyarrow as pa
   file = pa.ipc.open_file("$ARROW_ROOT/rust/arrow/target/debug/testdata/primitive_lz4.arrow_file")
   batches = file.read_all()
   ```
   
   Thanks


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org