You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Xu Mingmin (JIRA)" <ji...@apache.org> on 2017/03/13 20:27:41 UTC

[jira] [Created] (BEAM-1705) add method in Pipeline to visualize the DAG

Xu Mingmin created BEAM-1705:
--------------------------------

             Summary: add method in Pipeline to visualize the DAG
                 Key: BEAM-1705
                 URL: https://issues.apache.org/jira/browse/BEAM-1705
             Project: Beam
          Issue Type: New Feature
          Components: sdk-java-core
            Reporter: Xu Mingmin
            Assignee: Xu Mingmin


add a method to print out Pipeline with a easy-to-read format.
Take WindowedWordCount.Java for example, the output could looks like:
{code}
1. TextIO.Read/Read.out [PCollection]}]
  2. ParDo(AddTimestamp).out [PCollection]}]
    3. Window.Into()/Window.Assign.out [PCollection]}]	
      4. WordCount.CountWords/ParDo(ExtractWords).out [PCollection]}]
        5. WordCount.CountWords/Count.PerElement/Init/Map.out [PCollection]}]
          6. WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey.out [PCollection]}]
            7. WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/ParDo(Anonymous).out [PCollection]}]
              8. ParDo(Anonymous).out [PCollection]}]
                9. GroupByKey.out [PCollection]}]
                  10. ParDo(WriteWindowedFiles).out [PCollection]}]
{code}

Add the serial numbers here so it's readable for a complex pipeline with multiple-in and multiple-out.




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)