You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ravi Teja Ch N V (Created) (JIRA)" <ji...@apache.org> on 2011/12/01 11:23:40 UTC
[jira] [Created] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
The RM should handle the graceful shutdown of the NM.
-----------------------------------------------------
Key: MAPREDUCE-3494
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: nodemanager, resourcemanager
Reporter: Ravi Teja Ch N V
Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3494) The RM should handle the
graceful shutdown of the NM.
Posted by "Devaraj K (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13176123#comment-13176123 ]
Devaraj K commented on MAPREDUCE-3494:
--------------------------------------
Thanks for the comments Kamesh!
That would be a good idea. I will upload the patch with a fix for this comment.
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3494) The RM should handle the
graceful shutdown of the NM.
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13176613#comment-13176613 ]
Hadoop QA commented on MAPREDUCE-3494:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508743/MAPREDUCE-3494.2.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 18 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1514//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1514//console
This message is automatically generated.
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Status: Patch Available (was: Open)
Added the patch with the handling the shutdown scenario.
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3494) The RM should handle the
graceful shutdown of the NM.
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184570#comment-13184570 ]
Mahadev konar commented on MAPREDUCE-3494:
------------------------------------------
@Devaraj,
I am not sure what the use case here is? What it looks like is that when the NM has any issues registering you will unregister it? Can you please elaborate on the implications and the use case?
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, nodemanager, resourcemanager
> Affects Versions: 0.23.0
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3494:
-------------------------------------
Component/s: mrv2
Please add 'mrv2' component for all relevant jiras, so I can track it as it becomes PA. Thanks.
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3494) The RM should handle the
graceful shutdown of the NM.
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175928#comment-13175928 ]
Hadoop QA commented on MAPREDUCE-3494:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508624/MAPREDUCE-3494.1.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 15 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1505//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1505//console
This message is automatically generated.
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Attachment: MAPREDUCE-3494.patch
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated MAPREDUCE-3494:
-------------------------------------
Affects Version/s: (was: 1.0.0)
Removing 1.0 as affects version.
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, nodemanager, resourcemanager
> Affects Versions: 0.23.0
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Status: Open (was: Patch Available)
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Status: Open (was: Patch Available)
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3494) The RM should handle the
graceful shutdown of the NM.
Posted by "Bhallamudi Venkata Siva Kamesh (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175991#comment-13175991 ]
Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-3494:
-----------------------------------------------------------
Hi Devraj,
I think while unregistering NodeManager from RM, we should also remove the corresponding entry from NMLivelinessMonitor.
Is this patch handle this? or it is not required?
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3494) The RM should handle the
graceful shutdown of the NM.
Posted by "Devaraj K (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K reassigned MAPREDUCE-3494:
------------------------------------
Assignee: Devaraj K
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3494) The RM should handle the
graceful shutdown of the NM.
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175366#comment-13175366 ]
Hadoop QA commented on MAPREDUCE-3494:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508501/MAPREDUCE-3494.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 15 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
-1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1501//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1501//artifact/trunk/hadoop-mapreduce-project/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1501//console
This message is automatically generated.
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Status: Patch Available (was: Open)
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3494) The RM should handle the
graceful shutdown of the NM.
Posted by "Devaraj K (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184732#comment-13184732 ]
Devaraj K commented on MAPREDUCE-3494:
--------------------------------------
Hi Mahadev,
This is a straight scenario. When the NM shuts down gracefully, even then the NM is removed only after the expiry interval.
Now we will introduce the unregistration with the RM when the NM is shutting down. So that the RM is aware of it and will do the necessary actions for the same, instead of waiting for expiry interval.
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, nodemanager, resourcemanager
> Affects Versions: 0.23.0
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3494) The RM should handle the
graceful shutdown of the NM.
Posted by "Jonathan Eagles (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13160944#comment-13160944 ]
Jonathan Eagles commented on MAPREDUCE-3494:
--------------------------------------------
A side-effect of this is that NMs using static (non-ephemeral) ports are unable to rejoin until after the expiry period (yarn.resourcemanager.nm.liveness-monitor.expiry-interval-ms default is 10 minutes!).
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Status: Patch Available (was: Open)
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Attachment: MAPREDUCE-3494.1.patch
Attaching the patch with the findbugs fix.
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Attachment: MAPREDUCE-3494.2.patch
Attached the patch addressing the comments.
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: nodemanager, resourcemanager
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Affects Version/s: 0.23.0
1.0.0
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, nodemanager, resourcemanager
> Affects Versions: 0.23.0, 1.0.0
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Affects Version/s: (was: 0.23.0)
3.0.0
2.0.0
Fix Version/s: (was: 0.24.0)
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, nodemanager, resourcemanager
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Component/s: (was: resourcemanager)
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, nodemanager
> Affects Versions: 2.0.0, 3.0.0
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3494) The RM should handle the
graceful shutdown of the NM.
Posted by "Devaraj K (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184728#comment-13184728 ]
Devaraj K commented on MAPREDUCE-3494:
--------------------------------------
Hi Mahadev,
This is a start scenario. When the NM shuts down gracefully, even then the NM is removed only after the expiry interval.
Now we will introduce the unregistration with the RM when the NM is shutting down. So that the RM is aware of it and will do the necessary actions for the same, instead of waiting for expiry interval.
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, nodemanager, resourcemanager
> Affects Versions: 0.23.0
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3494) The RM should handle the graceful
shutdown of the NM.
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3494:
---------------------------------
Fix Version/s: 0.24.0
> The RM should handle the graceful shutdown of the NM.
> -----------------------------------------------------
>
> Key: MAPREDUCE-3494
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3494
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, nodemanager, resourcemanager
> Affects Versions: 0.23.0
> Reporter: Ravi Teja Ch N V
> Assignee: Devaraj K
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3494.1.patch, MAPREDUCE-3494.2.patch, MAPREDUCE-3494.patch
>
>
> Instead of waiting for the NM expiry, RM should remove and handle the NM, which is shutdown gracefully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira