You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2021/03/05 07:54:00 UTC

[jira] [Assigned] (SPARK-34637) Support DPP in AQE when the boradcast exchange can be reused

     [ https://issues.apache.org/jira/browse/SPARK-34637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-34637:
------------------------------------

    Assignee: Apache Spark

> Support DPP in AQE when the boradcast exchange can be reused
> ------------------------------------------------------------
>
>                 Key: SPARK-34637
>                 URL: https://issues.apache.org/jira/browse/SPARK-34637
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.1.1
>            Reporter: Ke Jia
>            Assignee: Apache Spark
>            Priority: Major
>
> We have supported DPP in AQE when the join is Broadcast hash join before applying the AQE rules in SPARK-34168, which has some limitations. It only apply DPP when the small table side executed firstly and then the big table side can reuse the broadcast exchange in small table side. This Jira is to address the above limitations and can apply the DPP when the broadcast exchange can be reused.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org