You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Xu Mingmin (JIRA)" <ji...@apache.org> on 2017/04/18 23:03:41 UTC
[jira] [Updated] (BEAM-1705) visualize the DAG of Pipeline
[ https://issues.apache.org/jira/browse/BEAM-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xu Mingmin updated BEAM-1705:
-----------------------------
Summary: visualize the DAG of Pipeline (was: add method in Pipeline to visualize the DAG)
> visualize the DAG of Pipeline
> -----------------------------
>
> Key: BEAM-1705
> URL: https://issues.apache.org/jira/browse/BEAM-1705
> Project: Beam
> Issue Type: New Feature
> Components: sdk-java-core
> Reporter: Xu Mingmin
> Assignee: Xu Mingmin
> Priority: Minor
>
> add a method to print out Pipeline with a easy-to-read format.
> Take WindowedWordCount.Java for example, the output could looks like:
> {code}
> 1. TextIO.Read/Read.out [PCollection]}]
> 2. ParDo(AddTimestamp).out [PCollection]}]
> 3. Window.Into()/Window.Assign.out [PCollection]}]
> 4. WordCount.CountWords/ParDo(ExtractWords).out [PCollection]}]
> 5. WordCount.CountWords/Count.PerElement/Init/Map.out [PCollection]}]
> 6. WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey.out [PCollection]}]
> 7. WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/ParDo(Anonymous).out [PCollection]}]
> 8. ParDo(Anonymous).out [PCollection]}]
> 9. GroupByKey.out [PCollection]}]
> 10. ParDo(WriteWindowedFiles).out [PCollection]}]
> {code}
> Add the serial numbers here so it's readable for a complex pipeline with multiple-in and multiple-out.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)