You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Thomas Graves (Created) (JIRA)" <ji...@apache.org> on 2012/04/03 21:52:22 UTC

[jira] [Created] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

job counters not available in Jobhistory webui for killed jobs
--------------------------------------------------------------

                 Key: MAPREDUCE-4102
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: webapps
    Affects Versions: 0.23.2
            Reporter: Thomas Graves


Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".

The job history log has:

Caused by: com.google.inject.ProvisionException: Guice provision errors:

2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
...
..
...

1) Error injecting constructor, java.lang.NullPointerException
  at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
  while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
...
..
...
Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
    at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
    at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)


There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4102:
------------------------------------------------------

    Status: Patch Available  (was: Open)
    
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4102:
------------------------------------------------------

    Status: Open  (was: Patch Available)

Cancelling the patch to address the test failures
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>         Attachments: MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4102:
------------------------------------------------------

    Attachment: MAPREDUCE-4102.patch

For this, I *think* we should display all sucessfully completed map/reduce task counters as the overall job counters for killed/failed jobs.Also when job has no sucessfully completed map/reduce tasks it displays
{noformat}Sorry it looks like job_<clusterid>_<jobNum> has no counters.{noformat}

Attaching the patch for the same. Please review.
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>         Attachments: MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271644#comment-13271644 ] 

Hadoop QA commented on MAPREDUCE-4102:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12526186/MAPREDUCE-4102-3.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 4 new or modified test files.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2373//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2373//console

This message is automatically generated.
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253252#comment-13253252 ] 

Hadoop QA commented on MAPREDUCE-4102:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12522540/MAPREDUCE-4102.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 2 new or modified test files.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed these unit tests:
                  org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell
                  org.apache.hadoop.yarn.server.TestDiskFailures
                  org.apache.hadoop.yarn.server.TestContainerManagerSecurity
                  org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService
                  org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry
                  org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization
                  org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs
                  org.apache.hadoop.mapreduce.v2.hs.webapp.TestHsWebServicesJobs
                  org.apache.hadoop.mapreduce.v2.hs.webapp.TestHsWebServicesTasks
                  org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
                  org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
                  org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
                  org.apache.hadoop.mapred.TestMiniMRClasspath
                  org.apache.hadoop.mapreduce.v2.TestMRJobs
                  org.apache.hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers
                  org.apache.hadoop.mapred.TestMiniMRBringup
                  org.apache.hadoop.mapred.TestMiniMRChildTask
                  org.apache.hadoop.mapred.TestReduceFetch
                  org.apache.hadoop.mapred.TestClusterMRNotification
                  org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
                  org.apache.hadoop.mapred.TestJobCounters
                  org.apache.hadoop.mapreduce.TestChild
                  org.apache.hadoop.mapred.TestMiniMRClientCluster
                  org.apache.hadoop.ipc.TestSocketFactory
                  org.apache.hadoop.mapreduce.v2.TestMRJobsWithHistoryService
                  org.apache.hadoop.mapreduce.v2.TestMROldApiJobs
                  org.apache.hadoop.mapreduce.v2.TestSpeculativeExecution
                  org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter
                  org.apache.hadoop.mapred.TestClientRedirect
                  org.apache.hadoop.mapred.TestLazyOutput
                  org.apache.hadoop.mapred.TestJobCleanup
                  org.apache.hadoop.mapreduce.TestMapReduceLazyOutput
                  org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
                  org.apache.hadoop.mapreduce.v2.TestMRAppWithCombiner
                  org.apache.hadoop.conf.TestNoDefaultsJobConf
                  org.apache.hadoop.mapreduce.v2.TestRMNMInfo
                  org.apache.hadoop.mapred.TestClusterMapReduceTestCase
                  org.apache.hadoop.mapreduce.v2.TestNonExistentJob
                  org.apache.hadoop.mapred.TestJobSysDirWithDFS
                  org.apache.hadoop.mapreduce.v2.TestUberAM
                  org.apache.hadoop.mapreduce.v2.TestMiniMRProxyUser
                  org.apache.hadoop.mapred.TestJobName
                  org.apache.hadoop.mapreduce.security.TestJHSSecurity

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2218//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2218//console

This message is automatically generated.
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>         Attachments: MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4102:
------------------------------------------------------

    Status: Open  (was: Patch Available)

Cancelling the patch to support the same functionality through web services as well.
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4102:
------------------------------------------------------

    Attachment: MAPREDUCE-4102-1.patch

Certainly all the test failures are not induced by this patch. Fixed all the relavant test failures and ran all the Testcases shown above.
All the tests passed in my env.

Not modified any *src* changes. Just modified the *test* changes.
Patch contains a testcase, which fails without src changes, and passes with src changes.
Please review.
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276934#comment-13276934 ] 

Hudson commented on MAPREDUCE-4102:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #1046 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1046/])
    MAPREDUCE-4102. job counters not available in Jobhistory webui for killed jobs (Bhallamudi Venkata Siva Kamesh via tgraves) (Revision 1339174)

     Result = FAILURE
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1339174
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/CountersBlock.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/dao/JobCounterInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/MockJobs.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/MockHistoryJobs.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHSWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesJobs.java

                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>             Fix For: 0.23.3
>
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276759#comment-13276759 ] 

Hudson commented on MAPREDUCE-4102:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #2252 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2252/])
    MAPREDUCE-4102. job counters not available in Jobhistory webui for killed jobs (Bhallamudi Venkata Siva Kamesh via tgraves) (Revision 1339174)

     Result = SUCCESS
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1339174
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/CountersBlock.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/dao/JobCounterInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/MockJobs.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/MockHistoryJobs.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHSWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesJobs.java

                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>             Fix For: 0.23.3
>
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4102:
------------------------------------------------------

    Affects Version/s: 2.0.0
               Status: Patch Available  (was: Open)
    
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>         Attachments: MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277826#comment-13277826 ] 

Hudson commented on MAPREDUCE-4102:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #1082 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1082/])
    MAPREDUCE-4102. job counters not available in Jobhistory webui for killed jobs (Bhallamudi Venkata Siva Kamesh via tgraves) (Revision 1339174)

     Result = SUCCESS
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1339174
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/CountersBlock.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/dao/JobCounterInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/MockJobs.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/MockHistoryJobs.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHSWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesJobs.java

                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>             Fix For: 0.23.3
>
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276758#comment-13276758 ] 

Hudson commented on MAPREDUCE-4102:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #2326 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2326/])
    MAPREDUCE-4102. job counters not available in Jobhistory webui for killed jobs (Bhallamudi Venkata Siva Kamesh via tgraves) (Revision 1339174)

     Result = SUCCESS
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1339174
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/CountersBlock.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/dao/JobCounterInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/MockJobs.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/MockHistoryJobs.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHSWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesJobs.java

                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>             Fix For: 0.23.3
>
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13269526#comment-13269526 ] 

Hadoop QA commented on MAPREDUCE-4102:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12525828/MAPREDUCE-4102.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 2 new or modified test files.

    -1 javadoc.  The javadoc tool appears to have generated 2 warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    -1 findbugs.  The patch appears to cause Findbugs (version 1.3.9) to fail.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2360//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2360//console

This message is automatically generated.
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Graves updated MAPREDUCE-4102:
-------------------------------------

       Resolution: Fixed
    Fix Version/s: 0.23.3
           Status: Resolved  (was: Patch Available)

+1 Thanks!  I've committed this to trunk, branch-2, and branch-0.23
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>             Fix For: 0.23.3
>
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Graves updated MAPREDUCE-4102:
-------------------------------------

    Status: Open  (was: Patch Available)

Sorry looks like we took to long to get to this, the patch no longer applies.  Can you please upmerge to latest?
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13270501#comment-13270501 ] 

Thomas Graves commented on MAPREDUCE-4102:
------------------------------------------

Thanks, the changes here look good.  Would you also mind updating the web services job counters to handle the same thing? Unfortunately the counter code between the web services and the web ui is not common yet. 

 curl  -i 'http://jobhistoyrserver:19888/ws/v1/history/mapreduce/jobs/job_1336487148705_0002/counters'
HTTP/1.1 500 Internal Server Error
Content-Type: application/json
Transfer-Encoding: chunked
Server: Jetty(6.1.26)

{"RemoteException":{"exception":"NullPointerException","javaClassName":"java.lang.NullPointerException"}}

Otherwise we could file a separate jira to handle this too if you don't think you can get to it.


                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Closed] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy closed MAPREDUCE-4102.
------------------------------------

    
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0-alpha
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4102:
------------------------------------------------------

    Status: Patch Available  (was: Open)
    
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4102:
------------------------------------------------------

    Status: Patch Available  (was: Open)
    
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253481#comment-13253481 ] 

Hadoop QA commented on MAPREDUCE-4102:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12522573/MAPREDUCE-4102-1.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 2 new or modified test files.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2221//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2221//console

This message is automatically generated.
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13270575#comment-13270575 ] 

Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-4102:
-----------------------------------------------------------

Thanks Thomas for the review. I totally missed the web services here. Thanks for pointing out. I will provide a patch having web services support as well. 
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Graves reassigned MAPREDUCE-4102:
----------------------------------------

    Assignee: Bhallamudi Venkata Siva Kamesh
    
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4102:
------------------------------------------------------

    Attachment: MAPREDUCE-4102.patch

Thanks Thomas for having a look into this issue. I just re-based the previous patch against trunk. Please review it and provide your comments.
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4102:
------------------------------------------------------

    Attachment: MAPREDUCE-4102-3.patch

Updated the previous patch to support the same functionality through web services also. Pleaser review the patch
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276781#comment-13276781 ] 

Hudson commented on MAPREDUCE-4102:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #2269 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2269/])
    MAPREDUCE-4102. job counters not available in Jobhistory webui for killed jobs (Bhallamudi Venkata Siva Kamesh via tgraves) (Revision 1339174)

     Result = ABORTED
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1339174
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/CountersBlock.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/dao/JobCounterInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/MockJobs.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/MockHistoryJobs.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHSWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesJobs.java

                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>             Fix For: 0.23.3
>
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277765#comment-13277765 ] 

Hudson commented on MAPREDUCE-4102:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #259 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/259/])
    merge -r 1339176:1339177 from branch-2. FIXES: MAPREDUCE-4102 (Revision 1339178)

     Result = SUCCESS
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1339178
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/CountersBlock.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/dao/JobCounterInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/MockJobs.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/MockHistoryJobs.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHSWebApp.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesJobs.java

                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>             Fix For: 0.23.3
>
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs

Posted by "Bhallamudi Venkata Siva Kamesh (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277569#comment-13277569 ] 

Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-4102:
-----------------------------------------------------------

Thanks Thomas.
                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>             Fix For: 0.23.3
>
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102-3.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira