You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2012/09/06 22:12:07 UTC
[jira] [Created] (MAPREDUCE-4641) Exception in commitJob marks job
as successful in job history
Jason Lowe created MAPREDUCE-4641:
-------------------------------------
Summary: Exception in commitJob marks job as successful in job history
Key: MAPREDUCE-4641
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 2.0.0-alpha, 0.23.3
Reporter: Jason Lowe
If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4641) Exception in commitJob marks
job as successful in job history
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450635#comment-13450635 ]
Hudson commented on MAPREDUCE-4641:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #1189 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1189/])
MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby) (Revision 1381784)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1381784
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4641) Exception in commitJob marks
job as successful in job history
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450708#comment-13450708 ]
Hudson commented on MAPREDUCE-4641:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #367 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/367/])
svn merge -c 1381784 FIXES: MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby) (Revision 1381787)
Result = UNSTABLE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1381787
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (MAPREDUCE-4641) Exception in commitJob marks job
as successful in job history
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy closed MAPREDUCE-4641.
------------------------------------
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Fix For: 0.23.3, 2.0.2-alpha
>
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4641) Exception in commitJob marks
job as successful in job history
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450095#comment-13450095 ]
Robert Joseph Evans commented on MAPREDUCE-4641:
------------------------------------------------
The change itself looks fine to me. +1 assuming that Jenkins comes back OK.
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4641) Exception in commitJob marks job
as successful in job history
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-4641:
-------------------------------------------
Resolution: Fixed
Fix Version/s: 2.2.0-alpha
3.0.0
0.23.3
Status: Resolved (was: Patch Available)
Thanks Jason,
I put this into trunk, branch-2 and 0.23.3
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4641) Exception in commitJob marks
job as successful in job history
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450107#comment-13450107 ]
Hudson commented on MAPREDUCE-4641:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #2697 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2697/])
MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby) (Revision 1381784)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1381784
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4641) Exception in commitJob marks job
as successful in job history
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated MAPREDUCE-4641:
----------------------------------
Attachment: MAPREDUCE-4641.patch
Straightforward patch. We were calling {{logJobHistoryFinishedEvent}} which logs a successful completion event rather than {{abortJob}}.
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.0-alpha
> Reporter: Jason Lowe
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4641) Exception in commitJob marks
job as successful in job history
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450136#comment-13450136 ]
Hudson commented on MAPREDUCE-4641:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2721 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2721/])
MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby) (Revision 1381784)
Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1381784
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4641) Exception in commitJob marks job
as successful in job history
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated MAPREDUCE-4641:
----------------------------------
Assignee: Jason Lowe
Target Version/s: 0.23.3, 2.2.0-alpha
Status: Patch Available (was: Open)
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0-alpha, 0.23.3
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4641) Exception in commitJob marks
job as successful in job history
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450589#comment-13450589 ]
Hudson commented on MAPREDUCE-4641:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #1158 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1158/])
MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby) (Revision 1381784)
Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1381784
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4641) Exception in commitJob marks
job as successful in job history
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450102#comment-13450102 ]
Hadoop QA commented on MAPREDUCE-4641:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12544125/MAPREDUCE-4641.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified test files.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app.
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2825//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2825//console
This message is automatically generated.
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4641) Exception in commitJob marks
job as successful in job history
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450109#comment-13450109 ]
Hudson commented on MAPREDUCE-4641:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2760 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2760/])
MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby) (Revision 1381784)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1381784
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java
> Exception in commitJob marks job as successful in job history
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4641
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4641
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
> Attachments: MAPREDUCE-4641.patch
>
>
> If the job committer throws an {{IOException}} from {{commitJob}} then the job will be marked as FINISHED/FAILED on the RM apps page, but the history server will show the job as SUCCEEDED.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira