[jira] [Commented] (TEZ-4477) Create ASCII art DAG representation for fun

["Zoltan Haindrich (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17689701#comment-17689701 ] 

Zoltan Haindrich commented on TEZ-4477:
---------------------------------------

interesting idea :D
some dot2ascii lib would be very handy - I've only seen: https://github.com/nmeylan/graphviz-plain-to-ascii

> Create ASCII art DAG representation for fun
> -------------------------------------------
>
>                 Key: TEZ-4477
>                 URL: https://issues.apache.org/jira/browse/TEZ-4477
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: László Bodor
>            Priority: Minor
>
> And optionally make it logged, e.g.
> 1. AM can log the full dag once
> 2. Tasks can log only the actual vertex and its inputs/outputs
> {code:java}
>  --------                 ----------
> |  Map1  | -SIMPLE_EDGE->| Reducer2 |
>  --------                 ----------{code}
>  
>  
> currently, we have a log line like this in tasks (which can be translated to ascii art maybe):
> {code}
> 2022-11-16 18:33:01,627 [INFO] [main] |runtime.LogicalIOProcessorRuntimeTask|: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : delete from concurrent_delete_dynamic ...0.0 (Stage-1), VertexName: Reducer 2, VertexParallelism: 10, TaskAttemptID:attempt_1668609417637_0043_5_01_000006_0, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Map 1, physicalEdgeCount=4, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=out_Reducer 2, physicalEdgeCount=0, outputClassName=org.apache.hadoop.hive.ql.exec.tez.NullMROutput }}, ], taskConfEntryCount=1
> {code}
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)