You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by "Dmitriy Fingerman (Jira)" <ji...@apache.org> on 2022/11/22 17:19:00 UTC
[jira] [Created] (TEZ-4455) Add LoggingHandler in ShuffleHandler pipeline for better debuggability
Dmitriy Fingerman created TEZ-4455:
--------------------------------------
Summary: Add LoggingHandler in ShuffleHandler pipeline for better debuggability
Key: TEZ-4455
URL: https://issues.apache.org/jira/browse/TEZ-4455
Project: Apache Tez
Issue Type: Improvement
Reporter: Dmitriy Fingerman
Assignee: Dmitriy Fingerman
[https://github.com/apache/tez/blob/8bb27b845ce103b8d02a9a9d7fe2a1af10097e9c/tez-plugins/tez-aux-services/src/main/java/org/apache/tez/auxservices/ShuffleHandler.java#L598]
For corner case debugging, it would be helpful to understand when netty processed OPEN/BOUND/CLOSE/RECEIVED/CONNECTED events along with payload details.
Adding "LoggingHandler" in ChannelPipeline mode can help in debugging.
An equivalent change was added to Hive recently https://issues.apache.org/jira/browse/HIVE-23754
Now adding similar improvement to Tez.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)