You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Bikas Saha (JIRA)" <ji...@apache.org> on 2015/06/25 19:50:05 UTC

[jira] [Resolved] (TEZ-2565) Consider scanning unfinished tasks in VertexImpl::constructStatistics to reduce merge overhead

     [ https://issues.apache.org/jira/browse/TEZ-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bikas Saha resolved TEZ-2565.
-----------------------------
      Resolution: Fixed
    Hadoop Flags: Incompatible change,Reviewed  (was: Reviewed)

> Consider scanning unfinished tasks in VertexImpl::constructStatistics to reduce merge overhead
> ----------------------------------------------------------------------------------------------
>
>                 Key: TEZ-2565
>                 URL: https://issues.apache.org/jira/browse/TEZ-2565
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>             Fix For: 0.8.0
>
>         Attachments: TEZ-2565.1.patch, TEZ-2565.2.patch, TEZ-2565.3.patch, TEZ-2565.4.patch, cpu_usage_with_patch.png, cpu_usage_without_patch.png, mem_usage_with_patch.png, mem_usage_without_patch.png
>
>
> constructStatistics() can be an overhead (scanning all tasks and merging stats) depending on the number of invocations to Vertex::getStatistics().  Consider scanning only unfinished tasks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)