[jira] [Updated] (SPARK-34637) Support DPP in AQE when the broadcast exchange can be reused

["Eugene Koifman (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-34637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eugene Koifman updated SPARK-34637:
-----------------------------------
    Summary: Support DPP in AQE when the broadcast exchange can be reused  (was: Support DPP in AQE when the boradcast exchange can be reused)

> Support DPP in AQE when the broadcast exchange can be reused
> ------------------------------------------------------------
>
>                 Key: SPARK-34637
>                 URL: https://issues.apache.org/jira/browse/SPARK-34637
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 3.2.0
>            Reporter: Ke Jia
>            Assignee: Ke Jia
>            Priority: Major
>             Fix For: 3.2.0
>
>
> We have supported DPP in AQE when the join is Broadcast hash join before applying the AQE rules in SPARK-34168, which has some limitations. It only apply DPP when the small table side executed firstly and then the big table side can reuse the broadcast exchange in small table side. This Jira is to address the above limitations and can apply the DPP when the broadcast exchange can be reused.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org