[jira] [Resolved] (ARROW-9423) [Rust][DataFusion] Add join

["Daniël Heres (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniël Heres resolved ARROW-9423.
---------------------------------
      Assignee: Jorge Leitão
    Resolution: Fixed

> [Rust][DataFusion] Add join
> ---------------------------
>
>                 Key: ARROW-9423
>                 URL: https://issues.apache.org/jira/browse/ARROW-9423
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Rust - DataFusion
>            Reporter: Jorge Leitão
>            Assignee: Jorge Leitão
>            Priority: Major
>
> A major operation in analytics is the join. This issue concerns adding the join operation.
> Given the complexity of this task, I propose starting with a sub-set of all joins, an hash join whose "ON" can only be a set of column names (i.e. no expressions).
> Suggestion for DOD:
> * physical plan to execute the join
> * logical plan with the join
> * SQL planner with the join
> * tests on each of the above
> One idea to perform this join in parallel is to, for each RecordBatch in the left, perform the join with a record on the right. Another way is to first perform a hash by key and sort on both sides, and then perform a "SortMergeJoin" on each of the partitions. There may be better ways to achieve this, though.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)