[jira] [Updated] (IMPALA-10098) Runtime Filters for Set Exclusion or Compliment

["Tim Armstrong (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-10098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tim Armstrong updated IMPALA-10098:
-----------------------------------
    Component/s: Frontend
                 Backend

> Runtime Filters for Set Exclusion or Compliment
> -----------------------------------------------
>
>                 Key: IMPALA-10098
>                 URL: https://issues.apache.org/jira/browse/IMPALA-10098
>             Project: IMPALA
>          Issue Type: New Feature
>          Components: Backend, Frontend
>            Reporter: Shant Hovsepian
>            Priority: Major
>              Labels: runtime-filters
>
> It would be beneficial to extend runtime filters to push set exclusion down to scan nodes. This would be used to optimize NOT IN, EXCEPT style queries or more generally ANTI JOINS, as well as OUTER JOINs which filter out non null attributes from the nullable side.
> This is almost the inverse operation of a traditional bloom filter, other data structures might be more efficient.
> This would also compliment Impala's left deep pipelined query planning very well for what otherwise would require complex query plans due to reordering restrictions with ANTI/OUTER joins. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org