You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2009/01/07 07:20:46 UTC
[jira] Commented: (HADOOP-4983) Job counters sometimes go down as
tasks run without task failures
[ https://issues.apache.org/jira/browse/HADOOP-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661457#action_12661457 ]
Amareshwari Sriramadasu commented on HADOOP-4983:
-------------------------------------------------
This happens, because TaskInProgress replaces counters in every status update and sometimes, status update doesnot have counters.
The code doing the same is in the method, TaskInProgress.recomputeProgress() :
{code}
} else if (status.getRunState() == TaskStatus.State.RUNNING) {
if (status.getProgress() >= bestProgress) {
bestProgress = status.getProgress();
bestState = status.getStateString();
bestCounters = status.getCounters();
}
}
}
{code}
> Job counters sometimes go down as tasks run without task failures
> -----------------------------------------------------------------
>
> Key: HADOOP-4983
> URL: https://issues.apache.org/jira/browse/HADOOP-4983
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Owen O'Malley
> Priority: Critical
>
> As tasks run, the counters seem to back up and move forward again. They always seem to be right when the task completes. I suspect this may have been introduced in HADOOP-2208.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.