You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2018/11/22 05:27:00 UTC

[jira] [Created] (BEAM-6114) SQL join selection should be done in planner, not in expansion to PTransform

Kenneth Knowles created BEAM-6114:
-------------------------------------

             Summary: SQL join selection should be done in planner, not in expansion to PTransform
                 Key: BEAM-6114
                 URL: https://issues.apache.org/jira/browse/BEAM-6114
             Project: Beam
          Issue Type: Improvement
          Components: dsl-sql
            Reporter: Kenneth Knowles
            Assignee: Kenneth Knowles


Currently Beam SQL joins all go through a single physical operator which has a single PTransform that does all join algorithms based on properties of its input PCollections as well as the relational algebra.

A first step is to make the needed information part of the relational algebra, so it can choose a PTransform based on that, and the PTransforms can be simpler.

Second step is to have separate (physical) relational operators for different join algorithms.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)