You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Bhallamudi Venkata Siva Kamesh (Commented) (JIRA)" <ji...@apache.org> on 2012/01/23 19:06:41 UTC

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191302#comment-13191302 ] 

Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-3686:
-----------------------------------------------------------

While incrementing the counters, existence of counters group has been checked in *groups* map. If not found in *groups* map, created a new group and stored the same group back in the *groups* map.

{code:title=AbstractCounters.java|borderStyle=solid}
   G left = groups.get(right.getName());
      if (left == null) {
        limits.checkGroups(groups.size() + 1);
        left = groupFactory.newGroup(right.getName(), right.getDisplayName(),
                                     limits);
        groups.put(right.getName(), left);
      }
}
{code} 

However while getting CounterGroup, if it is a framework related, getting from *fgroups* map, otherwise, from *groups* map.

{code:title=CountersBlock.java|borderStyle=solid}
boolean isFGroup = isFrameworkGroup(newGroupName);
G group = isFGroup ? fgroups.get(newGroupName) : groups.get(newGroupName);
}
{code}

I think, this is causing issue and we need to update same in AbstractCounters#incrAllCounters method as well.

Any comments?
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Priority: Critical
>         Attachments: jobcounter1.png, jobcounter2.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira