You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2014/07/07 21:21:34 UTC
[jira] [Assigned] (TEZ-1118) Tez with container reuse reports
negative CPU usage
[ https://issues.apache.org/jira/browse/TEZ-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gopal V reassigned TEZ-1118:
----------------------------
Assignee: Gopal V
> Tez with container reuse reports negative CPU usage
> ---------------------------------------------------
>
> Key: TEZ-1118
> URL: https://issues.apache.org/jira/browse/TEZ-1118
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Sergey Shelukhin
> Assignee: Gopal V
>
> 2014-05-13 12:47:37,243 INFO [AsyncDispatcher event handler] org.apache.tez.dag.history.HistoryEventHandler: [HISTORY][DAG:dag_1399351577718_0764_8][Event:TASK_ATTEMPT_FINISHED]: vertexName=Map 2, taskAttemptId=attempt_1399351577718_0764_8_01_000321_0, startTime=1400010446382, finishTime=1400010457242, timeTaken=10860, status=SUCCEEDED, diagnostics=, counters=Counters: 30, org.apache.tez.common.counters.DAGCounter, RACK_LOCAL_TASKS=1, File System Counters, FILE: BYTES_READ=32, FILE: BYTES_WRITTEN=103495, FILE: READ_OPS=0, FILE: LARGE_READ_OPS=0, FILE: WRITE_OPS=0, HDFS: BYTES_READ=158991064, HDFS: BYTES_WRITTEN=0, HDFS: READ_OPS=2, HDFS: LARGE_READ_OPS=0, HDFS: WRITE_OPS=0, org.apache.tez.common.counters.TaskCounter, GC_TIME_MILLIS=72, CPU_MILLISECONDS=-455600
> This seems to get worse as new tasks are scheduled on the container, CPU is obvious column in this csv (attempts are in execution order):
> {noformat}
> Map 2,attempt_1399351577718_0764_1_01_000063_0,22678,269235481,27830,17536,11967
> Map 2,attempt_1399351577718_0764_1_01_000167_0,16472,265337919,-19970,17044,11854
> Map 2,attempt_1399351577718_0764_1_01_000301_0,10197,173878898,-46140,11427,6899
> Map 2,attempt_1399351577718_0764_2_01_000059_0,18545,269736723,-51050,17590,12271
> Map 2,attempt_1399351577718_0764_2_01_000107_0,14677,269520373,-84270,17673,11095
> Map 2,attempt_1399351577718_0764_2_01_000228_0,14910,261276556,-104380,16937,11470
> Map 2,attempt_1399351577718_0764_3_01_000008_0,16164,269641107,-124260,17013,11306
> Map 2,attempt_1399351577718_0764_3_01_000136_0,15105,267827690,-140730,17834,10370
> Map 2,attempt_1399351577718_0764_3_01_000240_0,17380,235117784,-165260,15303,10948
> Map 2,attempt_1399351577718_0764_4_01_000056_0,19848,269790867,-167870,17487,11510
> Map 2,attempt_1399351577718_0764_4_01_000146_0,15303,267603313,-204130,17029,11672
> Map 2,attempt_1399351577718_0764_4_01_000264_0,9518,188372846,-231590,12273,8495
> Map 2,attempt_1399351577718_0764_5_01_000024_0,15836,270431273,-229970,17688,11045
> Map 2,attempt_1399351577718_0764_5_01_000150_0,15368,266500919,-258690,17012,11385
> Map 2,attempt_1399351577718_0764_5_01_000266_0,11882,183276660,-286700,11893,8350
> Map 2,attempt_1399351577718_0764_6_01_000017_0,17037,270252275,-293420,17517,12030
> Map 2,attempt_1399351577718_0764_6_01_000156_0,12759,266500919,-313380,17012,11385
> Map 2,attempt_1399351577718_0764_6_01_000266_0,10078,188372846,-338580,12273,8495
> Map 2,attempt_1399351577718_0764_7_01_000021_0,15984,270757527,-343980,17972,11519
> Map 2,attempt_1399351577718_0764_7_01_000102_0,14149,269589224,-355560,17698,10871
> Map 2,attempt_1399351577718_0764_7_01_000243_0,11578,235644691,-395730,15244,10508
> Map 2,attempt_1399351577718_0764_8_01_000026_0,16377,270431273,-402260,17688,11045
> Map 2,attempt_1399351577718_0764_8_01_000127_0,15517,268903941,-422380,17591,11681
> Map 2,attempt_1399351577718_0764_8_01_000321_0,10860,158991064,-455600,10658,6764
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)