You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Rajesh Balamohan (JIRA)" <ji...@apache.org> on 2015/10/27 18:50:27 UTC

[jira] [Updated] (TEZ-2021) Tez tool to analyze shuffle performance in large clusters by mining task logs

     [ https://issues.apache.org/jira/browse/TEZ-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rajesh Balamohan updated TEZ-2021:
----------------------------------
    Attachment: TEZ-2021.3.patch

Rebasing the patch as the log formats have changed in the recent releases

> Tez tool to analyze shuffle performance in large clusters by mining task logs
> -----------------------------------------------------------------------------
>
>                 Key: TEZ-2021
>                 URL: https://issues.apache.org/jira/browse/TEZ-2021
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>         Attachments: TEZ-2021.1.patch, TEZ-2021.2.patch, TEZ-2021.3.patch, avg_time_Taken_after_fix.png, avg_time_taken_to_download.png, no_of_times_contacted.png, total_data_transferred.png
>
>
> Tez tool to analyze shuffle performance in large clusters by mining task logs. Provide an easier way to visualize (heat chart) and identify bad nodes in large cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)