You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Anton Kedin (JIRA)" <ji...@apache.org> on 2018/02/07 00:21:00 UTC

[jira] [Created] (BEAM-3634) [SQL] Refactor PTransforms

Anton Kedin created BEAM-3634:
---------------------------------

             Summary: [SQL] Refactor PTransforms
                 Key: BEAM-3634
                 URL: https://issues.apache.org/jira/browse/BEAM-3634
             Project: Beam
          Issue Type: Improvement
          Components: dsl-sql
            Reporter: Anton Kedin


BeamRelNode exposes PCollection<BeamRecord> buildBeamPipeline() which builds a pipeline when parsing.

It feels like it should instead implement a PTransform<PCollection<BeamRecord>, PCollection<BeamRecord>> which would receive a prepared PCollection, and apply sub-expressions instead of manually invoking expression evaluation to get the input.

And maybe consider building it lazily.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)