[jira] [Comment Edited] (SPARK-36665) Add more Not operator optimizations

["Anton Okolnychyi (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486819#comment-17486819 ] 

Anton Okolnychyi edited comment on SPARK-36665 at 2/4/22, 5:16 AM:
-------------------------------------------------------------------

The proposed logic seems to behave correctly for NOT IN predicates but I think NOT IN subqueries have to be treated differently.


was (Author: aokolnychyi):
The proposed logic seems to behave correctly for IN predicates but I think NOT IN subqueries have to be treated differently.

> Add more Not operator optimizations
> -----------------------------------
>
>                 Key: SPARK-36665
>                 URL: https://issues.apache.org/jira/browse/SPARK-36665
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.3.0
>            Reporter: Kazuyuki Tanimura
>            Assignee: Kazuyuki Tanimura
>            Priority: Major
>             Fix For: 3.3.0
>
>         Attachments: Pasted Graphic 3.png
>
>
> {{BooleanSimplification should be able to do more simplifications for Not operators applying following rules}}
>  # {{Not(null) == null}}
>  ## {{e.g. IsNull(Not(...)) can be IsNull(...)}}
>  # {{(Not(a) = b) == (a = Not(b))}}
>  ## {{e.g. Not(...) = true can be (...) = false}}
>  # {{(a != b) == (a = Not(b))}}
>  ## {{e.g. (...) != true can be (...) = false}}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org