[jira] [Created] (TEZ-1035) Need job counters on resource usage

["Rohini Palaniswamy (JIRA)" <ji...@apache.org>]

Rohini Palaniswamy created TEZ-1035:
---------------------------------------

             Summary: Need job counters on resource usage
                 Key: TEZ-1035
                 URL: https://issues.apache.org/jira/browse/TEZ-1035
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Rohini Palaniswamy


MR provides job counters on resource usage.

For eg:
Launched map tasks 	0 	0 	1
Launched reduce tasks 	0 	0 	1
Rack-local map tasks 	0 	0 	1
Total megabyte-seconds taken by all map tasks 	0 	0 	8973312
Total megabyte-seconds taken by all reduce tasks 	0 	0 	11679744
Total time spent by all map tasks (ms) 	0 	0 	5842
Total time spent by all maps in occupied slots (ms) 	0 	0 	17526
Total time spent by all reduce tasks (ms) 	0 	0 	5703
Total time spent by all reduces in occupied slots (ms) 	0 	0 	22812
Total vcore-seconds taken by all map tasks 	0 	0 	5842
Total vcore-seconds taken by all reduce tasks 	0 	0 	5703 

Need these counters in Tez as well. Would be good to add container reuse information (TEZ-987) into this counter group as well.



--
This message was sent by Atlassian JIRA
(v6.2#6252)