[GitHub] [arrow-rs] alamb opened a new issue, #1547: Output of `filter` on UnionArrays fails validation

[GitBox <gi...@apache.org>]

alamb opened a new issue, #1547:
URL: https://github.com/apache/arrow-rs/issues/1547

   **Describe the bug**
   The `force_validate` check added in https://github.com/apache/arrow-rs/pull/1546 revealed that the `UnionArrays` produced from the `filter` kernel fails validation.
   
   It is not clear if the validation is incorrect or the filter kernel is incorrect
   
   **To Reproduce**
   Uncomment the
   ```rust
       #[cfg(not(feature = "force_validate"))]
   ``` 
   
   And then run the test like:
   ```shell
   cargo test --features=force_validate -p arrow
   ```
   
   lines for the following tests and the will fail:
   
   ```
   ---- compute::kernels::filter::tests::test_filter_union_array_sparse stdout ----
   thread 'compute::kernels::filter::tests::test_filter_union_array_sparse' panicked at 'called `Result::unwrap()` on an `Err` value: InvalidArgumentError("Expected 1 buffers in array of type Union([Field { name: \"A\", data_type: Int32, nullable: false, dict_id: 0, dict_is_ordered: false, metadata: None }, Field { name: \"B\", data_type: Float64, nullable: false, dict_id: 0, dict_is_ordered: false, metadata: None }], Sparse), got 2")', arrow/src/array/data.rs:301:34
   
   ---- compute::kernels::filter::tests::test_filter_union_array_sparse_with_nulls stdout ----
   thread 'compute::kernels::filter::tests::test_filter_union_array_sparse_with_nulls' panicked at 'called `Result::unwrap()` on an `Err` value: InvalidArgumentError("Expected 1 buffers in array of type Union([Field { name: \"A\", data_type: Int32, nullable: false, dict_id: 0, dict_is_ordered: false, metadata: None }, Field { name: \"B\", data_type: Float64, nullable: false, dict_id: 0, dict_is_ordered: false, metadata: None }], Sparse), got 2")', arrow/src/array/data.rs:301:34
   ```
   
   **Expected behavior**
   The tests should pass when force_validate is on
   
   **Additional context**
   Add any other context about the problem here.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] tustvold closed issue #1547: Output of `filter` on UnionArrays fails validation

[GitBox <gi...@apache.org>]

tustvold closed issue #1547: Output of `filter` on UnionArrays fails validation
URL: https://github.com/apache/arrow-rs/issues/1547


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org