You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/04/12 14:45:05 UTC
[GitHub] [arrow-rs] dispanser opened a new issue, #1549: Read dictionary from nested struct in ipc stream reader panics
dispanser opened a new issue, #1549:
URL: https://github.com/apache/arrow-rs/issues/1549
**Describe the bug**
We have an application that reads ipc stream data, and it panicked while reading a record batch that contains a dictionary in a nested struct:
```
0: rust_begin_unwind
at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/panicking.rs:498:5
1: core::panicking::panic_fmt
at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/core/src/panicking.rs:116:14
2: core::panicking::panic_bounds_check
at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/core/src/panicking.rs:84:5
3: arrow::ipc::reader::read_dictionary
at /home/pi/src/github/dispanser/arrow-rs/arrow/src/ipc/reader.rs:573:13
4: arrow::ipc::reader::StreamReader<R>::maybe_next
at /home/pi/src/github/dispanser/arrow-rs/arrow/src/ipc/reader.rs:983:17
5: <arrow::ipc::reader::StreamReader<R> as core::iter::traits::iterator::Iterator>::next
at /home/pi/src/github/dispanser/arrow-rs/arrow/src/ipc/reader.rs:1004:9
```
This is caused by an incorrectly sized `dictionaries_by_field` in the stream reader. PR is ready, opening this for tracking purposes.
**To Reproduce**
Create a record batch containing a nested struct with a dictionary in last position, write to IPC and attempt to read back using `ipc::reader::StreamReader`.
**Expected behavior**
A record batch instead of a panic :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold closed issue #1549: Read dictionary from nested struct in ipc stream reader panics
Posted by GitBox <gi...@apache.org>.
tustvold closed issue #1549: Read dictionary from nested struct in ipc stream reader panics
URL: https://github.com/apache/arrow-rs/issues/1549
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org