[jira] [Updated] (IMPALA-12089) Be able to skip pushing down a subset of the predicates

["David Rorke (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

David Rorke updated IMPALA-12089:
---------------------------------
    Labels: impala-iceberg performance  (was: impala-iceberg)

> Be able to skip pushing down a subset of the predicates
> -------------------------------------------------------
>
>                 Key: IMPALA-12089
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12089
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Frontend
>            Reporter: Gabor Kaszab
>            Assignee: Peter Rozsa
>            Priority: Major
>              Labels: impala-iceberg, performance
>
> https://issues.apache.org/jira/browse/IMPALA-11701 introduced logic to skip pushing down predicates to Impala scanners if they are already applied by Iceberg and won't filter any further rows. This is an "all or nothing" approach where we either skip pushing down all the predicates or we push down all of them.
> As a more sophisticated approach we should be able to push down a subset of the predicates to Impala Scan nodes. For this we should be able to map Iceberg predicates (returned from residual()) to Impala predicates. This might not be that trivial as Iceberg sometimes doesn't return the exact same predicates as it received through planFiles(). E.g. the object ID might be different making the mapping more difficult.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org