You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Rajesh Balamohan (JIRA)" <ji...@apache.org> on 2015/08/27 00:40:45 UTC

[jira] [Resolved] (TEZ-2565) Consider scanning unfinished tasks in VertexImpl::constructStatistics to reduce merge overhead

     [ https://issues.apache.org/jira/browse/TEZ-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rajesh Balamohan resolved TEZ-2565.
-----------------------------------
    Resolution: Fixed

Updated CHANGES.txt to have the info available in "ALL CHANGES" section as well. Marking this as resolved. 

> Consider scanning unfinished tasks in VertexImpl::constructStatistics to reduce merge overhead
> ----------------------------------------------------------------------------------------------
>
>                 Key: TEZ-2565
>                 URL: https://issues.apache.org/jira/browse/TEZ-2565
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>             Fix For: 0.8.0-alpha
>
>         Attachments: TEZ-2565.1.patch, TEZ-2565.2.patch, TEZ-2565.3.patch, TEZ-2565.4.patch, cpu_usage_with_patch.png, cpu_usage_without_patch.png, mem_usage_with_patch.png, mem_usage_without_patch.png
>
>
> constructStatistics() can be an overhead (scanning all tasks and merging stats) depending on the number of invocations to Vertex::getStatistics().  Consider scanning only unfinished tasks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)