You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2016/02/07 10:09:39 UTC

[jira] [Updated] (SPARK-13213) BroadcastNestedLoopJoin is very slow

     [ https://issues.apache.org/jira/browse/SPARK-13213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated SPARK-13213:
------------------------------
    Component/s: SQL

[~davies] again you'd be doing us a favor if you would set component on your JIRAs. I notice yours almost never do.

> BroadcastNestedLoopJoin is very slow
> ------------------------------------
>
>                 Key: SPARK-13213
>                 URL: https://issues.apache.org/jira/browse/SPARK-13213
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Davies Liu
>
> Since we have improve the performance of CartisianProduct, which should be faster and robuster than BroacastNestedLoopJoin, we should do CartisianProduct instead of BroacastNestedLoopJoin, especially  when the broadcasted table is not that small.
> Today, we hit a query that take very long time but still not finished, once decrease the threshold for broadcast (disable BroacastNestedLoopJoin), it just finished in seconds.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org