You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2020/07/28 01:52:00 UTC

[jira] [Assigned] (SPARK-32464) Support skew handling on join that has one side with no query stage

     [ https://issues.apache.org/jira/browse/SPARK-32464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-32464:
------------------------------------

    Assignee: Apache Spark

> Support skew handling on join that has one side with no query stage
> -------------------------------------------------------------------
>
>                 Key: SPARK-32464
>                 URL: https://issues.apache.org/jira/browse/SPARK-32464
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Wang, Gang
>            Assignee: Apache Spark
>            Priority: Major
>
> In our production environment, there are many bucket tables, which are used to join with other tables. And there are some skewed joins now and then. While, in current implementation, the skew join handling can only applied when both sides of a SMJ are QueryStages. So skew join handling is not able to deal with such cases.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org