You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Xu Mingmin (JIRA)" <ji...@apache.org> on 2017/03/13 20:27:41 UTC
[jira] [Created] (BEAM-1705) add method in Pipeline to visualize
the DAG
Xu Mingmin created BEAM-1705:
--------------------------------
Summary: add method in Pipeline to visualize the DAG
Key: BEAM-1705
URL: https://issues.apache.org/jira/browse/BEAM-1705
Project: Beam
Issue Type: New Feature
Components: sdk-java-core
Reporter: Xu Mingmin
Assignee: Xu Mingmin
add a method to print out Pipeline with a easy-to-read format.
Take WindowedWordCount.Java for example, the output could looks like:
{code}
1. TextIO.Read/Read.out [PCollection]}]
2. ParDo(AddTimestamp).out [PCollection]}]
3. Window.Into()/Window.Assign.out [PCollection]}]
4. WordCount.CountWords/ParDo(ExtractWords).out [PCollection]}]
5. WordCount.CountWords/Count.PerElement/Init/Map.out [PCollection]}]
6. WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey.out [PCollection]}]
7. WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/ParDo(Anonymous).out [PCollection]}]
8. ParDo(Anonymous).out [PCollection]}]
9. GroupByKey.out [PCollection]}]
10. ParDo(WriteWindowedFiles).out [PCollection]}]
{code}
Add the serial numbers here so it's readable for a complex pipeline with multiple-in and multiple-out.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)