You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@tez.apache.org by "László Bodor (Jira)" <ji...@apache.org> on 2022/11/23 19:27:00 UTC

[jira] [Resolved] (TEZ-4455) Add LoggingHandler in ShuffleHandler pipeline for better debuggability

     [ https://issues.apache.org/jira/browse/TEZ-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

László Bodor resolved TEZ-4455.
-------------------------------
    Resolution: Fixed

> Add LoggingHandler in ShuffleHandler pipeline for better debuggability
> ----------------------------------------------------------------------
>
>                 Key: TEZ-4455
>                 URL: https://issues.apache.org/jira/browse/TEZ-4455
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Dmitriy Fingerman
>            Assignee: Dmitriy Fingerman
>            Priority: Major
>             Fix For: 0.10.3
>
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> [https://github.com/apache/tez/blob/8bb27b845ce103b8d02a9a9d7fe2a1af10097e9c/tez-plugins/tez-aux-services/src/main/java/org/apache/tez/auxservices/ShuffleHandler.java#L598]
>  
> For corner case debugging, it would be helpful to understand when netty processed OPEN/BOUND/CLOSE/RECEIVED/CONNECTED events along with payload details.
> Adding "LoggingHandler" in ChannelPipeline mode can help in debugging.
>  
> An equivalent change was added to Hive recently https://issues.apache.org/jira/browse/HIVE-23754
> Now adding similar improvement to Tez.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)