You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Wang, Gang (Jira)" <ji...@apache.org> on 2020/07/28 01:23:00 UTC

[jira] [Created] (SPARK-32464) Support skew handling on join with one side that has no query stage

Wang, Gang created SPARK-32464:
----------------------------------

             Summary: Support skew handling on join with one side that has no query stage
                 Key: SPARK-32464
                 URL: https://issues.apache.org/jira/browse/SPARK-32464
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Wang, Gang


In our production environment, there are many bucket tables, which are used to join with other tables. And there are some skewed joins now and then. While, in current implementation, the skew join handling can only applied when both sides of a SMJ are QueryStages. So skew join handling is not able to deal with such cases.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org