You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Ben Sidhom (JIRA)" <ji...@apache.org> on 2018/03/29 20:47:00 UTC

[jira] [Created] (BEAM-3971) Pipeline translation utilities should not use SDK construction classes

Ben Sidhom created BEAM-3971:
--------------------------------

             Summary: Pipeline translation utilities should not use SDK construction classes
                 Key: BEAM-3971
                 URL: https://issues.apache.org/jira/browse/BEAM-3971
             Project: Beam
          Issue Type: Bug
          Components: runner-core
            Reporter: Ben Sidhom
            Assignee: Kenneth Knowles


In general, portable runners will require access to pipeline information not available in rehydrated pipelines while constructing physical plans. Translation utilities should operate directly on protos or on thin, information-preserving wrappers.

The pipeline fusion utilities already operate on protos directly and can be used as an example of how this could be done.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)