You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Arun C Murthy (JIRA)" <ji...@apache.org> on 2012/08/29 18:32:07 UTC
[jira] [Created] (MAPREDUCE-4603) Allow JobClient to retry
job-submission when JT is in safemode
Arun C Murthy created MAPREDUCE-4603:
----------------------------------------
Summary: Allow JobClient to retry job-submission when JT is in safemode
Key: MAPREDUCE-4603
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4603
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Similar to HDFS-3504, it would be useful to allow JobClient to retry job-submission when JT is in safemode (via MAPREDUCE-4328).
This way applications like Pig/Hive don't bork midway when the NN/JT are not operational.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4603) Allow JobClient to retry
job-submission when JT is in safemode
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462821#comment-13462821 ]
Hadoop QA commented on MAPREDUCE-4603:
--------------------------------------
{color:red}-1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12546524/MAPREDUCE-4603.patch
against trunk revision .
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2876//console
This message is automatically generated.
> Allow JobClient to retry job-submission when JT is in safemode
> --------------------------------------------------------------
>
> Key: MAPREDUCE-4603
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4603
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Attachments: MAPREDUCE-4603.patch
>
>
> Similar to HDFS-3504, it would be useful to allow JobClient to retry job-submission when JT is in safemode (via MAPREDUCE-4328).
> This way applications like Pig/Hive don't bork midway when the NN/JT are not operational.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4603) Allow JobClient to retry
job-submission when JT is in safemode
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-4603:
-------------------------------------
Resolution: Fixed
Fix Version/s: 1.1.0
Status: Resolved (was: Patch Available)
Thanks for the review Nic. I've just committed this.
> Allow JobClient to retry job-submission when JT is in safemode
> --------------------------------------------------------------
>
> Key: MAPREDUCE-4603
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4603
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Fix For: 1.1.0
>
> Attachments: MAPREDUCE-4603.patch
>
>
> Similar to HDFS-3504, it would be useful to allow JobClient to retry job-submission when JT is in safemode (via MAPREDUCE-4328).
> This way applications like Pig/Hive don't bork midway when the NN/JT are not operational.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4603) Allow JobClient to retry
job-submission when JT is in safemode
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-4603:
-------------------------------------
Status: Patch Available (was: Open)
> Allow JobClient to retry job-submission when JT is in safemode
> --------------------------------------------------------------
>
> Key: MAPREDUCE-4603
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4603
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Attachments: MAPREDUCE-4603.patch
>
>
> Similar to HDFS-3504, it would be useful to allow JobClient to retry job-submission when JT is in safemode (via MAPREDUCE-4328).
> This way applications like Pig/Hive don't bork midway when the NN/JT are not operational.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4603) Allow JobClient to retry
job-submission when JT is in safemode
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462854#comment-13462854 ]
Tsz Wo (Nicholas), SZE commented on MAPREDUCE-4603:
---------------------------------------------------
+1 patch looks good.
> Allow JobClient to retry job-submission when JT is in safemode
> --------------------------------------------------------------
>
> Key: MAPREDUCE-4603
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4603
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Attachments: MAPREDUCE-4603.patch
>
>
> Similar to HDFS-3504, it would be useful to allow JobClient to retry job-submission when JT is in safemode (via MAPREDUCE-4328).
> This way applications like Pig/Hive don't bork midway when the NN/JT are not operational.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4603) Allow JobClient to retry
job-submission when JT is in safemode
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462837#comment-13462837 ]
Arun C Murthy commented on MAPREDUCE-4603:
------------------------------------------
Hey Nic, can you pls take a quick look since you've done a lot of work with IPC retries etc.? Thanks!
> Allow JobClient to retry job-submission when JT is in safemode
> --------------------------------------------------------------
>
> Key: MAPREDUCE-4603
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4603
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Attachments: MAPREDUCE-4603.patch
>
>
> Similar to HDFS-3504, it would be useful to allow JobClient to retry job-submission when JT is in safemode (via MAPREDUCE-4328).
> This way applications like Pig/Hive don't bork midway when the NN/JT are not operational.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4603) Allow JobClient to retry
job-submission when JT is in safemode
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-4603:
-------------------------------------
Attachment: MAPREDUCE-4603.patch
Straight-fwd patch after HADOOP-8748 - all I had to do was throw a new SafeModeException from JobTracker and let ipc retry deal with it.
> Allow JobClient to retry job-submission when JT is in safemode
> --------------------------------------------------------------
>
> Key: MAPREDUCE-4603
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4603
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
> Attachments: MAPREDUCE-4603.patch
>
>
> Similar to HDFS-3504, it would be useful to allow JobClient to retry job-submission when JT is in safemode (via MAPREDUCE-4328).
> This way applications like Pig/Hive don't bork midway when the NN/JT are not operational.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira