You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Siddharth Seth (Created) (JIRA)" <ji...@apache.org> on 2012/01/08 00:04:39 UTC
[jira] [Created] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
AMRecovery should pick completed task form partial JobHistory files
-------------------------------------------------------------------
Key: MAPREDUCE-3640
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Reporter: Siddharth Seth
Priority: Critical
Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Siddharth Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated MAPREDUCE-3640:
--------------------------------------
Resolution: Fixed
Fix Version/s: 0.23.1
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Committed to trunk and branch-0.23. Thanks Arun.
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198345#comment-13198345 ]
Hudson commented on MAPREDUCE-3640:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #455 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/455/])
merge MAPREDUCE-3640 from trunk
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239403
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/recover/RecoveryService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryParser.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198739#comment-13198739 ]
Hudson commented on MAPREDUCE-3640:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #944 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/944/])
MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files. (Contributed by Arun C Murthy)
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239402
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/recover/RecoveryService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryParser.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3640:
-------------------------------------
Status: Patch Available (was: Open)
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198364#comment-13198364 ]
Hudson commented on MAPREDUCE-3640:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1653 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1653/])
MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files. (Contributed by Arun C Murthy)
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239402
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/recover/RecoveryService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryParser.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196604#comment-13196604 ]
Hadoop QA commented on MAPREDUCE-3640:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12512499/MAPREDUCE-3640.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1716//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1716//console
This message is automatically generated.
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3640:
-------------------------------------
Target Version/s: 0.23.1
Status: Patch Available (was: Open)
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3640:
-------------------------------------
Attachment: MAPREDUCE-3640.patch
Fixed javadoc warnings.
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Mahadev konar (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar reassigned MAPREDUCE-3640:
----------------------------------------
Assignee: Siddharth Seth
Sid,
Want to take a crack at this?
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Priority: Critical
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3640:
-------------------------------------
Attachment: MAPREDUCE-3640.patch
Straight-fwd fix.
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3640:
-----------------------------------------------
Issue Type: Sub-task (was: Bug)
Parent: MAPREDUCE-2692
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197718#comment-13197718 ]
Hadoop QA commented on MAPREDUCE-3640:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12512731/MAPREDUCE-3640.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1734//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1734//console
This message is automatically generated.
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Arun C Murthy (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy reassigned MAPREDUCE-3640:
----------------------------------------
Assignee: Arun C Murthy (was: Siddharth Seth)
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Siddharth Seth (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198313#comment-13198313 ]
Siddharth Seth commented on MAPREDUCE-3640:
-------------------------------------------
+1. Looks good. Will commit the patch shortly.
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Arun C Murthy (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196788#comment-13196788 ]
Arun C Murthy commented on MAPREDUCE-3640:
------------------------------------------
Thanks for the review Mahadev.
The api is needed for a test in a different package, hence it's public (but I've marked it @Private).
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3640:
-------------------------------------
Status: Patch Available (was: Open)
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Siddharth Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated MAPREDUCE-3640:
--------------------------------------
Status: Open (was: Patch Available)
Looked at the patch. Fine overall. One minor comment: it'll be useful to have an API to expose the exception which can be used on the HistoryServer.
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3640:
-------------------------------------
Status: Open (was: Patch Available)
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198343#comment-13198343 ]
Hudson commented on MAPREDUCE-3640:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1708 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1708/])
MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files. (Contributed by Arun C Murthy)
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239402
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/recover/RecoveryService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryParser.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196763#comment-13196763 ]
Mahadev konar commented on MAPREDUCE-3640:
------------------------------------------
The patch looks good, except for a minor nit. Can we make this package private/protected,
{code}
@Private
+ public synchronized JobInfo parse(EventReader reader) throws IOException
{code}
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198811#comment-13198811 ]
Hudson commented on MAPREDUCE-3640:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #977 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/977/])
MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files. (Contributed by Arun C Murthy)
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239402
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/recover/RecoveryService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryParser.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197668#comment-13197668 ]
Hadoop QA commented on MAPREDUCE-3640:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12512724/MAPREDUCE-3640.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 javadoc. The javadoc tool appears to have generated 3 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1733//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1733//console
This message is automatically generated.
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198341#comment-13198341 ]
Hudson commented on MAPREDUCE-3640:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #465 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/465/])
merge MAPREDUCE-3640 from trunk
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239403
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/recover/RecoveryService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryParser.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3640) AMRecovery should pick completed
task form partial JobHistory files
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3640:
-------------------------------------
Attachment: MAPREDUCE-3640.patch
Thanks for review Sid. Incorporated your comments.
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198780#comment-13198780 ]
Hudson commented on MAPREDUCE-3640:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #179 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/179/])
merge MAPREDUCE-3640 from trunk
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239403
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/recover/RecoveryService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryParser.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198372#comment-13198372 ]
Hudson commented on MAPREDUCE-3640:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #479 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/479/])
merge MAPREDUCE-3640 from trunk
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239403
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/recover/RecoveryService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryParser.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198759#comment-13198759 ]
Hudson commented on MAPREDUCE-3640:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #157 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/157/])
merge MAPREDUCE-3640 from trunk
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239403
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/recover/RecoveryService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryParser.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3640) AMRecovery should pick
completed task form partial JobHistory files
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198335#comment-13198335 ]
Hudson commented on MAPREDUCE-3640:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1637 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1637/])
MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files. (Contributed by Arun C Murthy)
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239402
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/recover/RecoveryService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryParser.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> AMRecovery should pick completed task form partial JobHistory files
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3640
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3640
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Siddharth Seth
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3640.patch, MAPREDUCE-3640.patch, MAPREDUCE-3640.patch
>
>
> Currently, if the JobHistory file has a partial record, AMRecovery will start from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira