You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Jörn Horstmann (Jira)" <ji...@apache.org> on 2020/09/16 15:59:00 UTC

[jira] [Updated] (ARROW-10025) [Rust] Filter kernel relies on bits outside of valid len of boolean array

     [ https://issues.apache.org/jira/browse/ARROW-10025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jörn Horstmann updated ARROW-10025:
-----------------------------------
    Summary: [Rust] Filter kernel relies on bits outside of valid len of boolean array  (was: [Rust] Filter kernel relies bits outside of valid len of boolean array)

> [Rust] Filter kernel relies on bits outside of valid len of boolean array
> -------------------------------------------------------------------------
>
>                 Key: ARROW-10025
>                 URL: https://issues.apache.org/jira/browse/ARROW-10025
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Rust, Rust - DataFusion
>    Affects Versions: 1.0.1
>            Reporter: Jörn Horstmann
>            Priority: Major
>
> The filter kernel accesses the filter array in chunks of u64 and tries to access elements if the corresponding bit is set. This assumes that bits outside of the valid len of that array have to be unset. That assumption is currently not correct for output of the NOT and the IS NULL kernels, which also operate on and negate a whole chunk of their input arrays.
> {code:java}
> #[test]
> fn csv_query_with_is_null_predicate() -> Result<()> {
>     let mut ctx = ExecutionContext::new();
>     register_aggregate_csv(&mut ctx)?;
>     let sql = "SELECT COUNT(1) FROM aggregate_test_100 WHERE c1 IS NULL";
>     let actual = execute(&mut ctx, sql).join("\n");
>     let expected = "0".to_string();
>     assert_eq!(expected, actual);
>     Ok(())
> }
> {code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)