You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by "Dmitriy Fingerman (Jira)" <ji...@apache.org> on 2022/11/22 17:19:00 UTC

[jira] [Created] (TEZ-4455) Add LoggingHandler in ShuffleHandler pipeline for better debuggability

Dmitriy Fingerman created TEZ-4455:
--------------------------------------

             Summary: Add LoggingHandler in ShuffleHandler pipeline for better debuggability
                 Key: TEZ-4455
                 URL: https://issues.apache.org/jira/browse/TEZ-4455
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Dmitriy Fingerman
            Assignee: Dmitriy Fingerman


[https://github.com/apache/tez/blob/8bb27b845ce103b8d02a9a9d7fe2a1af10097e9c/tez-plugins/tez-aux-services/src/main/java/org/apache/tez/auxservices/ShuffleHandler.java#L598]

 

For corner case debugging, it would be helpful to understand when netty processed OPEN/BOUND/CLOSE/RECEIVED/CONNECTED events along with payload details.

Adding "LoggingHandler" in ChannelPipeline mode can help in debugging.

 

An equivalent change was added to Hive recently https://issues.apache.org/jira/browse/HIVE-23754

Now adding similar improvement to Tez.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)