You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Imran Rashid (JIRA)" <ji...@apache.org> on 2016/02/29 20:58:18 UTC
[jira] [Closed] (SPARK-13213) BroadcastNestedLoopJoin is very slow
[ https://issues.apache.org/jira/browse/SPARK-13213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Imran Rashid closed SPARK-13213.
--------------------------------
Resolution: Fixed
Assignee: Davies Liu
Fix Version/s: 2.0.0
Looks like a typo in a commit msg got this fix miscategorized. It was fixed by
Issue resolved by pull request 11328
https://github.com/apache/spark/pull/11328
commit: https://github.com/apache/spark/commit/6df1e55a6594ae4bc7882f44af8d230aad9489b4
> BroadcastNestedLoopJoin is very slow
> ------------------------------------
>
> Key: SPARK-13213
> URL: https://issues.apache.org/jira/browse/SPARK-13213
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Davies Liu
> Assignee: Davies Liu
> Fix For: 2.0.0
>
>
> Since we have improve the performance of CartisianProduct, which should be faster and robuster than BroacastNestedLoopJoin, we should do CartisianProduct instead of BroacastNestedLoopJoin, especially when the broadcasted table is not that small.
> Today, we hit a query that take very long time but still not finished, once decrease the threshold for broadcast (disable BroacastNestedLoopJoin), it just finished in seconds.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org