You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "XiDuo You (Jira)" <ji...@apache.org> on 2022/07/20 09:43:00 UTC

[jira] [Created] (SPARK-39825) Fix PushDownLeftSemiAntiJoin push through project

XiDuo You created SPARK-39825:
---------------------------------

             Summary: Fix PushDownLeftSemiAntiJoin push through project
                 Key: SPARK-39825
                 URL: https://issues.apache.org/jira/browse/SPARK-39825
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.4.0
            Reporter: XiDuo You


Push LeftSemi/LeftAnti through project is not always effective

1. project is used to do column pruning, so it conflicts with ColumnPruning
2. if the project contains complex expression and join condition reference it, it can be regression since the complex expression will be evaluated more than once



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org