You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Imran Rashid (JIRA)" <ji...@apache.org> on 2016/02/29 20:58:18 UTC

[jira] [Closed] (SPARK-13213) BroadcastNestedLoopJoin is very slow

     [ https://issues.apache.org/jira/browse/SPARK-13213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Imran Rashid closed SPARK-13213.
--------------------------------
       Resolution: Fixed
         Assignee: Davies Liu
    Fix Version/s: 2.0.0

Looks like a typo in a commit msg got this fix miscategorized.  It was fixed by

Issue resolved by pull request 11328
https://github.com/apache/spark/pull/11328

commit:  https://github.com/apache/spark/commit/6df1e55a6594ae4bc7882f44af8d230aad9489b4

> BroadcastNestedLoopJoin is very slow
> ------------------------------------
>
>                 Key: SPARK-13213
>                 URL: https://issues.apache.org/jira/browse/SPARK-13213
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Davies Liu
>            Assignee: Davies Liu
>             Fix For: 2.0.0
>
>
> Since we have improve the performance of CartisianProduct, which should be faster and robuster than BroacastNestedLoopJoin, we should do CartisianProduct instead of BroacastNestedLoopJoin, especially  when the broadcasted table is not that small.
> Today, we hit a query that take very long time but still not finished, once decrease the threshold for broadcast (disable BroacastNestedLoopJoin), it just finished in seconds.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org