You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Robert Joseph Evans (JIRA)" <ji...@apache.org> on 2011/05/27 20:42:47 UTC
[jira] [Created] (MAPREDUCE-2539) NPE when calling
JobClient.getMapTaskReports for retired job
NPE when calling JobClient.getMapTaskReports for retired job
------------------------------------------------------------
Key: MAPREDUCE-2539
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2539
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: client
Affects Versions: 0.22.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
When calling JobClient.getMapTaskReports for a retired job this results in a NPE. In the 0.20.* version an empty TaskReport array was returned instead.
Caused by: java.lang.NullPointerException
at org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:588)
at org.apache.pig.tools.pigstats.JobStats.addMapReduceStatistics(JobStats.java:388)
......
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2539) NPE when calling
JobClient.getMapTaskReports for retired job
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-2539:
-------------------------------------------
Status: Patch Available (was: Open)
> NPE when calling JobClient.getMapTaskReports for retired job
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2539
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2539
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
> Affects Versions: 0.22.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Attachments: MR-2539-trunk-v1.patch, MR-2539-yarn-v1.patch
>
>
> When calling JobClient.getMapTaskReports for a retired job this results in a NPE. In the 0.20.* version an empty TaskReport array was returned instead.
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:588)
> at org.apache.pig.tools.pigstats.JobStats.addMapReduceStatistics(JobStats.java:388)
> ......
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2539) NPE when calling
JobClient.getMapTaskReports for retired job
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13043313#comment-13043313 ]
Hudson commented on MAPREDUCE-2539:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #711 (See [https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/711/])
MAPREDUCE-2539. Fixed NPE in getMapTaskReports in JobClient. Contributed by Robert Evans.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1130994
Files :
* /hadoop/mapreduce/trunk/CHANGES.txt
* /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/JobClientUnitTest.java
* /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/JobClient.java
> NPE when calling JobClient.getMapTaskReports for retired job
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2539
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2539
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
> Affects Versions: 0.22.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Attachments: MR-2539-trunk-v1.patch, MR-2539-yarn-v1.patch
>
>
> When calling JobClient.getMapTaskReports for a retired job this results in a NPE. In the 0.20.* version an empty TaskReport array was returned instead.
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:588)
> at org.apache.pig.tools.pigstats.JobStats.addMapReduceStatistics(JobStats.java:388)
> ......
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2539) NPE when calling
JobClient.getMapTaskReports for retired job
Posted by "Konstantin Shvachko (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195357#comment-13195357 ]
Konstantin Shvachko commented on MAPREDUCE-2539:
------------------------------------------------
This is needed for Pig unit test to run over 0.22.
I ran MR test target. All pass. Will commit it to the branch.
> NPE when calling JobClient.getMapTaskReports for retired job
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2539
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2539
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
> Affects Versions: 0.22.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Attachments: MR-2539-trunk-v1.patch, MR-2539-yarn-v1.patch
>
>
> When calling JobClient.getMapTaskReports for a retired job this results in a NPE. In the 0.20.* version an empty TaskReport array was returned instead.
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:588)
> at org.apache.pig.tools.pigstats.JobStats.addMapReduceStatistics(JobStats.java:388)
> ......
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2539) NPE when calling
JobClient.getMapTaskReports for retired job
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-2539:
-------------------------------------------
Attachment: MR-2539-trunk-v1.patch
MR-2539-yarn-v1.patch
Fixes NPE in JobClient.get*TaskReports if the job is retired.
> NPE when calling JobClient.getMapTaskReports for retired job
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2539
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2539
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
> Affects Versions: 0.22.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Attachments: MR-2539-trunk-v1.patch, MR-2539-yarn-v1.patch
>
>
> When calling JobClient.getMapTaskReports for a retired job this results in a NPE. In the 0.20.* version an empty TaskReport array was returned instead.
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:588)
> at org.apache.pig.tools.pigstats.JobStats.addMapReduceStatistics(JobStats.java:388)
> ......
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2539) NPE when calling
JobClient.getMapTaskReports for retired job
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195537#comment-13195537 ]
Hudson commented on MAPREDUCE-2539:
-----------------------------------
Integrated in Hadoop-Mapreduce-22-branch #98 (See [https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/98/])
MAPREDUCE-2539. Fixed NPE in getMapTaskReports in JobClient. Contributed by Robert Evans.
shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1236961
Files :
* /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt
* /hadoop/common/branches/branch-0.22/mapreduce/src/java/org/apache/hadoop/mapred/JobClient.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/JobClientUnitTest.java
> NPE when calling JobClient.getMapTaskReports for retired job
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2539
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2539
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
> Affects Versions: 0.22.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Attachments: MR-2539-trunk-v1.patch, MR-2539-yarn-v1.patch
>
>
> When calling JobClient.getMapTaskReports for a retired job this results in a NPE. In the 0.20.* version an empty TaskReport array was returned instead.
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:588)
> at org.apache.pig.tools.pigstats.JobStats.addMapReduceStatistics(JobStats.java:388)
> ......
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2539) NPE when calling
JobClient.getMapTaskReports for retired job
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040614#comment-13040614 ]
Robert Joseph Evans commented on MAPREDUCE-2539:
------------------------------------------------
I am not really sure why findbugs was marked as a -1. The findbugs error count is the same as it was before this patch. Also there a no errors in any of the files that are touched by this patch.
> NPE when calling JobClient.getMapTaskReports for retired job
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2539
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2539
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
> Affects Versions: 0.22.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Attachments: MR-2539-trunk-v1.patch, MR-2539-yarn-v1.patch
>
>
> When calling JobClient.getMapTaskReports for a retired job this results in a NPE. In the 0.20.* version an empty TaskReport array was returned instead.
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:588)
> at org.apache.pig.tools.pigstats.JobStats.addMapReduceStatistics(JobStats.java:388)
> ......
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2539) NPE when calling
JobClient.getMapTaskReports for retired job
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13057264#comment-13057264 ]
Hudson commented on MAPREDUCE-2539:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #722 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/722/])
> NPE when calling JobClient.getMapTaskReports for retired job
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2539
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2539
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
> Affects Versions: 0.22.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Attachments: MR-2539-trunk-v1.patch, MR-2539-yarn-v1.patch
>
>
> When calling JobClient.getMapTaskReports for a retired job this results in a NPE. In the 0.20.* version an empty TaskReport array was returned instead.
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:588)
> at org.apache.pig.tools.pigstats.JobStats.addMapReduceStatistics(JobStats.java:388)
> ......
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2539) NPE when calling
JobClient.getMapTaskReports for retired job
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-2539:
-------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this to both trunk and MR-279. Thanks Robert!
> NPE when calling JobClient.getMapTaskReports for retired job
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2539
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2539
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
> Affects Versions: 0.22.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Attachments: MR-2539-trunk-v1.patch, MR-2539-yarn-v1.patch
>
>
> When calling JobClient.getMapTaskReports for a retired job this results in a NPE. In the 0.20.* version an empty TaskReport array was returned instead.
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:588)
> at org.apache.pig.tools.pigstats.JobStats.addMapReduceStatistics(JobStats.java:388)
> ......
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2539) NPE when calling
JobClient.getMapTaskReports for retired job
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040518#comment-13040518 ]
Hadoop QA commented on MAPREDUCE-2539:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12480700/MR-2539-trunk-v1.patch
against trunk revision 1128394.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 4 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
+1 system test framework. The patch passed system test framework compile.
Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/316//testReport/
Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/316//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/316//console
This message is automatically generated.
> NPE when calling JobClient.getMapTaskReports for retired job
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2539
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2539
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
> Affects Versions: 0.22.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Attachments: MR-2539-trunk-v1.patch, MR-2539-yarn-v1.patch
>
>
> When calling JobClient.getMapTaskReports for a retired job this results in a NPE. In the 0.20.* version an empty TaskReport array was returned instead.
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:588)
> at org.apache.pig.tools.pigstats.JobStats.addMapReduceStatistics(JobStats.java:388)
> ......
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira