You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2020/07/28 03:15:00 UTC

[jira] [Resolved] (SPARK-32460) how spark collects non-match results after performing broadcast left outer join

     [ https://issues.apache.org/jira/browse/SPARK-32460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-32460.
----------------------------------
    Resolution: Invalid

> how spark collects non-match results after performing broadcast left outer join
> -------------------------------------------------------------------------------
>
>                 Key: SPARK-32460
>                 URL: https://issues.apache.org/jira/browse/SPARK-32460
>             Project: Spark
>          Issue Type: Question
>          Components: Spark Core, SQL
>    Affects Versions: 2.4.0
>            Reporter: farshad delavarpour
>            Priority: Major
>
> Does anybody know how spark collects non-match results after performing broadcast hash left outer join?
> Suppose we have 4 nodes. 1 driver and 3 executors. We broadcast the left table. After left outer join is performed in each executor, how does spark recognize which records have not been matched, and how does it collect them to the final result?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org