You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Thomas Graves (Created) (JIRA)" <ji...@apache.org> on 2012/01/18 17:56:48 UTC

[jira] [Created] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

history server web ui - job counter values for map/reduce not shown properly
----------------------------------------------------------------------------

                 Key: MAPREDUCE-3686
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: mrv2
    Affects Versions: 0.23.0
            Reporter: Thomas Graves
            Priority: Critical


Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.

Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216682#comment-13216682 ] 

Hudson commented on MAPREDUCE-3686:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #599 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/599/])
    MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh.
svn merge --ignore-ancestry -c 1293775 ../../trunk (Revision 1293776)

     Result = ABORTED
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293776
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/AbstractCounters.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/CounterGroupFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestCounters.java

                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Graves updated MAPREDUCE-3686:
-------------------------------------

    Attachment: jobcounter2.png
                jobcounter1.png
    
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Priority: Critical
>         Attachments: jobcounter1.png, jobcounter2.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-3686:
------------------------------------------------------

    Status: Patch Available  (was: Open)
    
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216674#comment-13216674 ] 

Hudson commented on MAPREDUCE-3686:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #586 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/586/])
    MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh.
svn merge --ignore-ancestry -c 1293775 ../../trunk (Revision 1293776)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293776
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/AbstractCounters.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/CounterGroupFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestCounters.java

                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinod Kumar Vavilapalli updated MAPREDUCE-3686:
-----------------------------------------------

          Resolution: Fixed
       Fix Version/s: 0.23.2
    Target Version/s:   (was: 0.23.1)
        Release Note: Fixed two bugs in Counters because of which web app displays zero counter values for framework counters.
        Hadoop Flags: Reviewed
              Status: Resolved  (was: Patch Available)

Just committed this to trunk, branch-0.23 and branch-0.23.1. Thanks Kamesh!
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198603#comment-13198603 ] 

Hadoop QA commented on MAPREDUCE-3686:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12512925/jobcounter3.png
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1744//console

This message is automatically generated.
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13200508#comment-13200508 ] 

Mahadev konar commented on MAPREDUCE-3686:
------------------------------------------

@Bhallamudi,
 Shouldnt you be using factory.newFrameworkGroup(int id), when the group is a framework group? 
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>         Attachments: MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216718#comment-13216718 ] 

Hudson commented on MAPREDUCE-3686:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #967 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/967/])
    MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh. (Revision 1293775)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293775
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/AbstractCounters.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/CounterGroupFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestCounters.java

                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216683#comment-13216683 ] 

Hudson commented on MAPREDUCE-3686:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1794 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1794/])
    MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh. (Revision 1293775)

     Result = ABORTED
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293775
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/AbstractCounters.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/CounterGroupFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestCounters.java

                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-3686:
------------------------------------------------------

    Attachment: jobcounter3.png

Tested patch with wordcount example. Attaching screen shot which displays map/reduce counter values properly.
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Mahadev konar (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mahadev konar reassigned MAPREDUCE-3686:
----------------------------------------

    Assignee: Bhallamudi Venkata Siva Kamesh
    
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>         Attachments: MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Bhallamudi Venkata Siva Kamesh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198683#comment-13198683 ] 

Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-3686:
-----------------------------------------------------------

Seems Jenkins has not picked up patch, picked up snapshot attached.
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216677#comment-13216677 ] 

Hudson commented on MAPREDUCE-3686:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #1783 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1783/])
    MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh. (Revision 1293775)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293775
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/AbstractCounters.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/CounterGroupFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestCounters.java

                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216676#comment-13216676 ] 

Hudson commented on MAPREDUCE-3686:
-----------------------------------

Integrated in Hadoop-Common-0.23-Commit #598 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/598/])
    MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh.
svn merge --ignore-ancestry -c 1293775 ../../trunk (Revision 1293776)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293776
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/AbstractCounters.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/CounterGroupFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestCounters.java

                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216667#comment-13216667 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-3686:
----------------------------------------------------

Nice catch Kamesh! Both the bugs.

Patch looks good too. Tested and verified. +1. Pushing this in.
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Bhallamudi Venkata Siva Kamesh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191302#comment-13191302 ] 

Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-3686:
-----------------------------------------------------------

While incrementing the counters, existence of counters group has been checked in *groups* map. If not found in *groups* map, created a new group and stored the same group back in the *groups* map.

{code:title=AbstractCounters.java|borderStyle=solid}
   G left = groups.get(right.getName());
      if (left == null) {
        limits.checkGroups(groups.size() + 1);
        left = groupFactory.newGroup(right.getName(), right.getDisplayName(),
                                     limits);
        groups.put(right.getName(), left);
      }
}
{code} 

However while getting CounterGroup, if it is a framework related, getting from *fgroups* map, otherwise, from *groups* map.

{code:title=CountersBlock.java|borderStyle=solid}
boolean isFGroup = isFrameworkGroup(newGroupName);
G group = isFGroup ? fgroups.get(newGroupName) : groups.get(newGroupName);
}
{code}

I think, this is causing issue and we need to update same in AbstractCounters#incrAllCounters method as well.

Any comments?
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Priority: Critical
>         Attachments: jobcounter1.png, jobcounter2.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Bhallamudi Venkata Siva Kamesh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217051#comment-13217051 ] 

Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-3686:
-----------------------------------------------------------

Thanks Mahadev and Vinod.
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-3686:
------------------------------------------------------

    Attachment: MAPREDUCE-3686.patch

Attaching patch. Please review.
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216736#comment-13216736 ] 

Hudson commented on MAPREDUCE-3686:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #208 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/208/])
    MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh.
svn merge --ignore-ancestry -c 1293775 ../../trunk (Revision 1293776)

     Result = FAILURE
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293776
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/AbstractCounters.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/CounterGroupFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestCounters.java

                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Bhallamudi Venkata Siva Kamesh (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199650#comment-13199650 ] 

Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-3686:
-----------------------------------------------------------

I don't think, this patch causes javadoc warnings
{noformat}
-1 javadoc. The javadoc tool appears to have generated 6 warning messages.
{noformat}

                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>         Attachments: MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mahadev konar updated MAPREDUCE-3686:
-------------------------------------

    Attachment: MAPREDUCE-3686.patch

Reattaching the patch from Bhallamudi.
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-3686:
------------------------------------------------------

    Attachment: MAPREDUCE-3686-1.path

Thanks Mahadev for reviewing the patch. Incorporating above comment. Please review.
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13204518#comment-13204518 ] 

Hadoop QA commented on MAPREDUCE-3686:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12513954/MAPREDUCE-3686-1.path
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1830//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1830//console

This message is automatically generated.
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216746#comment-13216746 ] 

Hudson commented on MAPREDUCE-3686:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #1002 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1002/])
    MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh. (Revision 1293775)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293775
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/AbstractCounters.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/CounterGroupFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestCounters.java

                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216723#comment-13216723 ] 

Hudson commented on MAPREDUCE-3686:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #180 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/180/])
    MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh.
svn merge --ignore-ancestry -c 1293775 ../../trunk (Revision 1293776)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293776
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/AbstractCounters.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/CounterGroupFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestCounters.java

                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199467#comment-13199467 ] 

Hadoop QA commented on MAPREDUCE-3686:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12513072/MAPREDUCE-3686.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 9 new or modified tests.

    -1 javadoc.  The javadoc tool appears to have generated 6 warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1760//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1760//console

This message is automatically generated.
                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>         Attachments: MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3686) history server web ui - job counter values for map/reduce not shown properly

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216675#comment-13216675 ] 

Hudson commented on MAPREDUCE-3686:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1857 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1857/])
    MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh. (Revision 1293775)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293775
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/AbstractCounters.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/counters/CounterGroupFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestCounters.java

                
> history server web ui - job counter values for map/reduce not shown properly
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3686
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3686
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3686-1.path, MAPREDUCE-3686.patch, MAPREDUCE-3686.patch, jobcounter1.png, jobcounter2.png, jobcounter3.png
>
>
> Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero.  If you click on a particular column it does show you the map/reduce task and the value of each one.
> Going to attach screenshots shortly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira