You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "László Bodor (Jira)" <ji...@apache.org> on 2020/02/21 13:04:00 UTC

[jira] [Commented] (TEZ-2119) Counter for launched containers

    [ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041841#comment-17041841 ] 

László Bodor commented on TEZ-2119:
-----------------------------------

[~rohini], [~hitesh], [~sseth], [~rajesh.balamohan], [~zjffdu], [~bikas]: picked up this task and uploaded a WIP patch ( [^TEZ-2119.01.patch] ) with the abovementioned counters implemented, I would appreciate some sanity check about that
I haven't included unit tests + haven't tested on cluster yet, I'm about to do that as soon as possible, but in the meantime, I'm interested whether the patch is going to the right direction or not, any comments are appreciated! thanks in advance
(+ starting precommit test)

> Counter for launched containers
> -------------------------------
>
>                 Key: TEZ-2119
>                 URL: https://issues.apache.org/jira/browse/TEZ-2119
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rohini Palaniswamy
>            Assignee: László Bodor
>            Priority: Major
>         Attachments: TEZ-2119.01.patch
>
>
> org.apache.tez.common.counters.DAGCounter
>                 NUM_SUCCEEDED_TASKS=32976
>                 TOTAL_LAUNCHED_TASKS=32976
>                 OTHER_LOCAL_TASKS=2
>                 DATA_LOCAL_TASKS=9147
>                 RACK_LOCAL_TASKS=23761
> It would be very nice to have TOTAL_LAUNCHED_CONTAINERS counter added to this. The difference between TOTAL_LAUNCHED_CONTAINERS and TOTAL_LAUNCHED_TASKS should make it easy to see how much container reuse is happening. It is very hard to find out now.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)