You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2014/05/19 10:16:38 UTC
[jira] [Updated] (SPARK-1880) Eliminate unnecessary job executions.
[ https://issues.apache.org/jira/browse/SPARK-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Takuya Ueshin updated SPARK-1880:
---------------------------------
Description:
There are unnecessary job executions in {{BroadcastNestedLoopJoin}}.
When {{Innner}} or {{LeftOuter}} join, preparation of {{rightOuterMatches}} for {{RightOuter}} or {{FullOuter}} join is not neccessary.
And when {{RightOuter}} or {{FullOuter}}, it should use not {{count}} and then {{reduce}} but {{fold}}.
was:
There are unnecessary job executions in {{BroadcastNestedLoopJoin}}.
When Innner or LeftOuter join, preparation of {{rightOuterMatches}} for {{RightOuter}} or {{FullOuter}} join is not neccessary.
And when {{RightOuter}} or {{FullOuter}}, it should use not {{count}} and then {{reduce}} but {{fold}}.
> Eliminate unnecessary job executions.
> -------------------------------------
>
> Key: SPARK-1880
> URL: https://issues.apache.org/jira/browse/SPARK-1880
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Takuya Ueshin
>
> There are unnecessary job executions in {{BroadcastNestedLoopJoin}}.
> When {{Innner}} or {{LeftOuter}} join, preparation of {{rightOuterMatches}} for {{RightOuter}} or {{FullOuter}} join is not neccessary.
> And when {{RightOuter}} or {{FullOuter}}, it should use not {{count}} and then {{reduce}} but {{fold}}.
--
This message was sent by Atlassian JIRA
(v6.2#6252)