You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Devaraj K (JIRA)" <ji...@apache.org> on 2012/06/26 13:01:44 UTC
[jira] [Created] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Devaraj K created MAPREDUCE-4372:
------------------------------------
Summary: Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Key: MAPREDUCE-4372
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2, resourcemanager
Affects Versions: 2.0.0-alpha, 3.0.0
Reporter: Devaraj K
Assignee: Devaraj K
Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13403126#comment-13403126 ]
Hudson commented on MAPREDUCE-4372:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #1123 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1123/])
MAPREDUCE-4372. Deadlock in Resource Manager (Devaraj K via bobby) (Revision 1354531)
Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1354531
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Fix For: 2.0.1-alpha, 3.0.0
>
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402304#comment-13402304 ]
Hudson commented on MAPREDUCE-4372:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2412 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2412/])
MAPREDUCE-4372. Deadlock in Resource Manager (Devaraj K via bobby) (Revision 1354531)
Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1354531
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Fix For: 2.0.1-alpha, 3.0.0
>
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-4372:
---------------------------------
Status: Patch Available (was: Open)
Thanks a lot Robert for looking into the patch. I have updated the patch as per your suggestion.
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401400#comment-13401400 ]
Robert Joseph Evans commented on MAPREDUCE-4372:
------------------------------------------------
The patch looks good, I have one minor comment.
I would prefer to see
{code}
(ShutdownHookManager.get().isShutdownInProgress()) == false
{code}
as
{code}
!ShutdownHookManager.get().isShutdownInProgress()
{code}
The javadoc warnings appear to be cause by MAPREDUCE-4355
{noformat}
[WARNING] /home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobClient.java:651: warning - @param argument "jobid" is not a parameter name.
[WARNING] /home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobClient.java:669: warning - @param argument "jobid" is not a parameter name.
{noformat}
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401344#comment-13401344 ]
Hadoop QA commented on MAPREDUCE-4372:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12533468/MAPREDUCE-4372.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 javadoc. The javadoc tool appears to have generated 2 warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2514//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2514//console
This message is automatically generated.
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy closed MAPREDUCE-4372.
------------------------------------
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Fix For: 0.23.3, 2.0.2-alpha
>
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13408653#comment-13408653 ]
Hudson commented on MAPREDUCE-4372:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #306 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/306/])
svn merge -c 1354531 FIXES: MAPREDUCE-4372. Deadlock in Resource Manager (Devaraj K via bobby) (Revision 1358402)
Result = UNSTABLE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1358402
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Fix For: 0.23.3, 2.0.1-alpha, 3.0.0
>
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-4372:
---------------------------------
Status: Patch Available (was: Open)
Attaching straightforward patch to fix the issue.
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-4372:
---------------------------------
Attachment: MAPREDUCE-4372.patch
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402126#comment-13402126 ]
Hadoop QA commented on MAPREDUCE-4372:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12533636/MAPREDUCE-4372-1.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 javadoc. The javadoc tool appears to have generated 2 warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2520//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2520//console
This message is automatically generated.
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402255#comment-13402255 ]
Robert Joseph Evans commented on MAPREDUCE-4372:
------------------------------------------------
Changes look good to me +1.
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-4372:
---------------------------------
Attachment: MAPREDUCE-4372-1.patch
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-4372:
-------------------------------------------
Resolution: Fixed
Fix Version/s: 3.0.0
2.0.1-alpha
Status: Resolved (was: Patch Available)
Thanks Devaraj,
I put this into trunk and branch-2.
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Fix For: 2.0.1-alpha, 3.0.0
>
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402264#comment-13402264 ]
Hudson commented on MAPREDUCE-4372:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #2393 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2393/])
MAPREDUCE-4372. Deadlock in Resource Manager (Devaraj K via bobby) (Revision 1354531)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1354531
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Fix For: 2.0.1-alpha, 3.0.0
>
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-4372:
-------------------------------------------
Fix Version/s: 0.23.3
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Fix For: 0.23.3, 2.0.1-alpha, 3.0.0
>
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13403027#comment-13403027 ]
Hudson commented on MAPREDUCE-4372:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #1090 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1090/])
MAPREDUCE-4372. Deadlock in Resource Manager (Devaraj K via bobby) (Revision 1354531)
Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1354531
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Fix For: 2.0.1-alpha, 3.0.0
>
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-4372:
---------------------------------
Status: Open (was: Patch Available)
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401298#comment-13401298 ]
Devaraj K commented on MAPREDUCE-4372:
--------------------------------------
It seems very similar to MAPREDUCE-4031.
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-4372:
---------------------------------
Attachment: rm-threaddump.out
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4372) Deadlock in Resource Manager
between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402262#comment-13402262 ]
Hudson commented on MAPREDUCE-4372:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2462 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2462/])
MAPREDUCE-4372. Deadlock in Resource Manager (Devaraj K via bobby) (Revision 1354531)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1354531
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
> Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
> ------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4372
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4372
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Fix For: 2.0.1-alpha, 3.0.0
>
> Attachments: MAPREDUCE-4372-1.patch, MAPREDUCE-4372.patch, rm-threaddump.out
>
>
> Please find the attached resource manager thread dump for the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira