You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2018/11/22 05:27:00 UTC
[jira] [Created] (BEAM-6114) SQL join selection should be done in
planner, not in expansion to PTransform
Kenneth Knowles created BEAM-6114:
-------------------------------------
Summary: SQL join selection should be done in planner, not in expansion to PTransform
Key: BEAM-6114
URL: https://issues.apache.org/jira/browse/BEAM-6114
Project: Beam
Issue Type: Improvement
Components: dsl-sql
Reporter: Kenneth Knowles
Assignee: Kenneth Knowles
Currently Beam SQL joins all go through a single physical operator which has a single PTransform that does all join algorithms based on properties of its input PCollections as well as the relational algebra.
A first step is to make the needed information part of the relational algebra, so it can choose a PTransform based on that, and the PTransforms can be simpler.
Second step is to have separate (physical) relational operators for different join algorithms.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)