You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/01/25 20:13:25 UTC
[GitHub] [arrow-datafusion] alamb opened a new issue #1676: Regression: Merge assertion: `'assertion failed: i < self.len()'` in array_primitive.rs while merging non overlapping streams
alamb opened a new issue #1676:
URL: https://github.com/apache/arrow-datafusion/issues/1676
**Describe the bug**
If we try to merge two streams that are non overlapping (e.g. `0..20` and `20..40`) then the following panic is produced:
```
thread 'test_merge_2_no_overlap' panicked at 'assertion failed: i < self.len()', /Users/alamb/.cargo/registry/src/github.com-1ecc6299db9ec823/arrow-8.0.0/src/array/array_primitive.rs:120:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
```
Note this won't affect any users of DataFusion unless they are using externalized sort that @yjshen has recently been working on.
**To Reproduce**
I have a fuzz tester I will contribute and link to this issue.
**Expected behavior**
Correct answers come out, with no panic
**Additional context**
Found in some of our tests in IOx: https://github.com/influxdata/influxdb_iox/issues/3530
I am fairly confident it is a corner case in the code from https://github.com/apache/arrow-datafusion/pull/1596
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] yjshen commented on issue #1676: Regression: Merge assertion: `'assertion failed: i < self.len()'` in array_primitive.rs while merging non overlapping streams
Posted by GitBox <gi...@apache.org>.
yjshen commented on issue #1676:
URL: https://github.com/apache/arrow-datafusion/issues/1676#issuecomment-1021794543
It's caused by inserting an empty record batch, I think. The current sort will not be affected since empty batches are eliminated while inserting. Proposed fix in https://github.com/alamb/arrow-datafusion/pull/4
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on issue #1676: Regression: Merge assertion: `'assertion failed: i < self.len()'` in array_primitive.rs while merging non overlapping streams
Posted by GitBox <gi...@apache.org>.
alamb commented on issue #1676:
URL: https://github.com/apache/arrow-datafusion/issues/1676#issuecomment-1022361593
I have incorporated https://github.com/alamb/arrow-datafusion/pull/4 into https://github.com/apache/arrow-datafusion/pull/1678
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb closed issue #1676: Regression: Merge assertion: `'assertion failed: i < self.len()'` in array_primitive.rs while merging non overlapping streams
Posted by GitBox <gi...@apache.org>.
alamb closed issue #1676:
URL: https://github.com/apache/arrow-datafusion/issues/1676
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org