[jira] [Updated] (ARROW-16275) [C++] Add support for pushdown filtering of nested references

["Weston Pace (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-16275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Weston Pace updated ARROW-16275:
--------------------------------
    Summary: [C++] Add support for pushdown filtering of nested references  (was: [C++] Add support for pushdown projection of nested references)

> [C++] Add support for pushdown filtering of nested references
> -------------------------------------------------------------
>
>                 Key: ARROW-16275
>                 URL: https://issues.apache.org/jira/browse/ARROW-16275
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>            Reporter: Weston Pace
>            Priority: Major
>
> Now that we support nested field references we should support pushdown predicates based on nested field references.  For example:
> {noformat}
> dataset.to_table(filter=ds.field('values', 'one') > 200)
> {noformat}
> {{file_parquet.cc}} tests which row groups to include when scanning a parquet fragment using parquet statistics.  At the moment it skips any non-leaf columns.  That will need to change.
> Second, even if we were able to detect and produce a guarantee based on nested references, it's not clear the simplification logic would be able to detect this and appropriately simplify.  So there may be changes needed there too.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)