You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Vinod Kumar Vavilapalli (Created) (JIRA)" <ji...@apache.org> on 2012/01/14 00:48:39 UTC
[jira] [Created] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
-------------------------------------------------------------------
Key: MAPREDUCE-3672
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Fix For: 0.23.1
We counted maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Anupam Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anupam Seth updated MAPREDUCE-3672:
-----------------------------------
Status: Patch Available (was: Open)
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Anupam Seth (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anupam Seth reassigned MAPREDUCE-3672:
--------------------------------------
Assignee: Anupam Seth
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246296#comment-13246296 ]
Hudson commented on MAPREDUCE-3672:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1989 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1989/])
MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves) (Revision 1309401)
Result = SUCCESS
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309401
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobCounter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/org/apache/hadoop/mapreduce/JobCounter.properties
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestSpeculativeExecution.java
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.23.3
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246303#comment-13246303 ]
Hudson commented on MAPREDUCE-3672:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2002 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2002/])
MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves) (Revision 1309401)
Result = SUCCESS
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309401
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobCounter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/org/apache/hadoop/mapreduce/JobCounter.properties
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestSpeculativeExecution.java
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.23.3
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Anupam Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anupam Seth updated MAPREDUCE-3672:
-----------------------------------
Status: Open (was: Patch Available)
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Robert Joseph Evans (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245628#comment-13245628 ]
Robert Joseph Evans commented on MAPREDUCE-3672:
------------------------------------------------
Have you tested this on a cluster?
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3672:
-----------------------------------------------
Description:
We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
Same with reduces too.
was:
We counted maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
Same with reduces too.
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Fix For: 0.23.1
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Anupam Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anupam Seth updated MAPREDUCE-3672:
-----------------------------------
Status: Patch Available (was: Open)
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Anupam Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anupam Seth updated MAPREDUCE-3672:
-----------------------------------
Status: Open (was: Patch Available)
Cancelling to re-submit patch to avoid TestIndexCache intermittent failure
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Thomas Graves (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246288#comment-13246288 ]
Thomas Graves commented on MAPREDUCE-3672:
------------------------------------------
+1 looks good. Thanks Anupam!
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Anupam Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anupam Seth updated MAPREDUCE-3672:
-----------------------------------
Attachment: MAPREDUCE-3672-branch-23.patch
Attaching patch, kindly review and let me know of any comments!
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3672:
-------------------------------------
Fix Version/s: (was: 0.23.1)
0.24.0
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Fix For: 0.24.0
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228894#comment-13228894 ]
Hadoop QA commented on MAPREDUCE-3672:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12518099/MAPREDUCE-3672-branch-23.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.mapred.TestIndexCache
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2048//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2048//console
This message is automatically generated.
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-3672:
-------------------------------------
Target Version/s: 0.23.3
Fix Version/s: (was: 0.24.0)
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245819#comment-13245819 ]
Hadoop QA commented on MAPREDUCE-3672:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12521210/MAPREDUCE-3672-branch-23.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.mapred.TestMiniMRClientCluster
org.apache.hadoop.mapreduce.v2.TestMROldApiJobs
org.apache.hadoop.mapred.TestJobCounters
org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter
org.apache.hadoop.mapreduce.v2.TestMiniMRProxyUser
org.apache.hadoop.mapreduce.v2.TestRMNMInfo
org.apache.hadoop.mapreduce.security.TestJHSSecurity
org.apache.hadoop.mapreduce.v2.TestUberAM
org.apache.hadoop.mapred.TestReduceFetch
org.apache.hadoop.mapreduce.TestChild
org.apache.hadoop.mapred.TestLazyOutput
org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
org.apache.hadoop.mapreduce.v2.TestMRJobs
org.apache.hadoop.mapred.TestJobSysDirWithDFS
org.apache.hadoop.mapred.TestMiniMRBringup
org.apache.hadoop.mapreduce.TestMapReduceLazyOutput
org.apache.hadoop.mapred.TestJobCleanup
org.apache.hadoop.mapreduce.v2.TestSpeculativeExecution
org.apache.hadoop.conf.TestNoDefaultsJobConf
org.apache.hadoop.mapred.TestMiniMRChildTask
org.apache.hadoop.mapred.TestClientRedirect
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2139//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2139//console
This message is automatically generated.
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-3672:
-------------------------------------
Resolution: Fixed
Fix Version/s: 0.23.3
Status: Resolved (was: Patch Available)
committed this to trunk, branch-2, and branch-0.23
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.23.3
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248356#comment-13248356 ]
Hudson commented on MAPREDUCE-3672:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #1041 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1041/])
MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves) (Revision 1309401)
Result = SUCCESS
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309401
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobCounter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/org/apache/hadoop/mapreduce/JobCounter.properties
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestSpeculativeExecution.java
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.23.3
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Anupam Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anupam Seth updated MAPREDUCE-3672:
-----------------------------------
Status: Patch Available (was: Open)
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248301#comment-13248301 ]
Hudson commented on MAPREDUCE-3672:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #1006 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1006/])
MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves) (Revision 1309401)
Result = FAILURE
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309401
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobCounter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/org/apache/hadoop/mapreduce/JobCounter.properties
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestSpeculativeExecution.java
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.23.3
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Thomas Graves (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245670#comment-13245670 ]
Thomas Graves commented on MAPREDUCE-3672:
------------------------------------------
Hey Anupam,
Can you update it so we get the pretty formatted version from the cli for the new NUM_KILLED fields? It is in: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/org/apache/hadoop/mapreduce/JobCounter.properties
>From cli output right now has:
Job Counters
NUM_KILLED_MAPS=1
NUM_KILLED_REDUCES=1
Launched map tasks=1
Launched reduce tasks=1
It would be nice to display Killed map tasks=X, Killed reduce tasks=Y
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248281#comment-13248281 ]
Hudson commented on MAPREDUCE-3672:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #219 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/219/])
merge -r 1309402:1309403 from branch-2. FIXES: MAPREDUCE-3672 (Revision 1309405)
Result = SUCCESS
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309405
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobCounter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/org/apache/hadoop/mapreduce/JobCounter.properties
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestSpeculativeExecution.java
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.23.3
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Anupam Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anupam Seth updated MAPREDUCE-3672:
-----------------------------------
Attachment: MAPREDUCE-3672-branch-23.patch
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13229306#comment-13229306 ]
Hadoop QA commented on MAPREDUCE-3672:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12518330/MAPREDUCE-3672-branch-23.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2050//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2050//console
This message is automatically generated.
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3672) Killed maps shouldn't be
counted towards JobCounter.NUM_FAILED_MAPS
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246294#comment-13246294 ]
Hudson commented on MAPREDUCE-3672:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2064 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2064/])
MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves) (Revision 1309401)
Result = SUCCESS
tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309401
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobCounter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/org/apache/hadoop/mapreduce/JobCounter.properties
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestSpeculativeExecution.java
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.23.3
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Anupam Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anupam Seth updated MAPREDUCE-3672:
-----------------------------------
Attachment: MAPREDUCE-3672-branch-23.patch
Sorry -wrong file!
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy closed MAPREDUCE-3672.
------------------------------------
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.23.3, 2.0.2-alpha
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3672) Killed maps shouldn't be counted
towards JobCounter.NUM_FAILED_MAPS
Posted by "Anupam Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anupam Seth updated MAPREDUCE-3672:
-----------------------------------
Attachment: MAPREDUCE-3672-branch-23.patch
Thanks! Updated patch to pretty the output. Tested on a single node cluster locally.
> Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3672
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3672
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Anupam Seth
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch, MAPREDUCE-3672-branch-23.patch
>
>
> We count maps that are killed, say by speculator, towards JobCounter.NUM_FAILED_MAPS. We should instead have a separate JobCounter for killed maps.
> Same with reduces too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira