You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Jeff Zhang (JIRA)" <ji...@apache.org> on 2015/04/09 07:23:12 UTC

[jira] [Commented] (TEZ-2119) Counter for launched containers

    [ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486726#comment-14486726 ] 

Jeff Zhang commented on TEZ-2119:
---------------------------------

Try to add one new counter USED_CONTAINERS for both Vertex and DAG, It is a little different from LAUNCHED_CONTAINERS,  because dag will use the container that already launched for the last dag in session mode. [~rohini] Does that make sense to you ?


> Counter for launched containers
> -------------------------------
>
>                 Key: TEZ-2119
>                 URL: https://issues.apache.org/jira/browse/TEZ-2119
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rohini Palaniswamy
>            Assignee: Jeff Zhang
>
> org.apache.tez.common.counters.DAGCounter
>                 NUM_SUCCEEDED_TASKS=32976
>                 TOTAL_LAUNCHED_TASKS=32976
>                 OTHER_LOCAL_TASKS=2
>                 DATA_LOCAL_TASKS=9147
>                 RACK_LOCAL_TASKS=23761
> It would be very nice to have TOTAL_LAUNCHED_CONTAINERS counter added to this. The difference between TOTAL_LAUNCHED_CONTAINERS and TOTAL_LAUNCHED_TASKS should make it easy to see how much container reuse is happening. It is very hard to find out now.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)