You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "mcdull_zhang (Jira)" <ji...@apache.org> on 2021/08/30 09:49:00 UTC
[jira] [Created] (SPARK-36612) Support left outer join build left
or right outer join build right in shuffled hash join
mcdull_zhang created SPARK-36612:
------------------------------------
Summary: Support left outer join build left or right outer join build right in shuffled hash join
Key: SPARK-36612
URL: https://issues.apache.org/jira/browse/SPARK-36612
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 3.2.0
Reporter: mcdull_zhang
Currently spark sql does not support build left side when left outer join (or build right side when right outer join).
However, in our production environment, there are a large number of scenarios where small tables are left join large tables, and many times, large tables have data skew (currently AQE can't handle this kind of skew).
Inspired by SPARK-32399, we can use similar ideas to realize left outer join build left.
I think this treatment is very meaningful, but I don’t know how members consider this matter?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org