You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Hitesh Shah (Created) (JIRA)" <ji...@apache.org> on 2011/10/31 06:08:32 UTC
[jira] [Created] (MAPREDUCE-3314) Support AM specific blacklisting
of nodes on the RM
Support AM specific blacklisting of nodes on the RM
---------------------------------------------------
Key: MAPREDUCE-3314
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3314
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Reporter: Hitesh Shah
Fix For: 0.23.1
The AM blacklists certain nodes due to task failures but the RM does not know of this and can allocate blacklisted nodes to the AM again and again.
RM should support a protocol that allows AM to inform the RM of nodes that it should not allocate to it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3314) AM should have a way of telling
RM to not allocate containers on some nodes
Posted by "Hitesh Shah (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hitesh Shah reassigned MAPREDUCE-3314:
--------------------------------------
Assignee: (was: Hitesh Shah)
> AM should have a way of telling RM to not allocate containers on some nodes
> ---------------------------------------------------------------------------
>
> Key: MAPREDUCE-3314
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3314
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Hitesh Shah
> Fix For: 0.23.1
>
>
> The AM blacklists certain nodes due to task failures but the RM does not know of this and can allocate blacklisted nodes to the AM again and again.
> RM should support a protocol that allows AM to inform the RM of nodes that it should not allocate to it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3314) Support AM specific
blacklisting of nodes on the RM
Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139942#comment-13139942 ]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3314:
----------------------------------------------------
Thanks for filing this. I ran into the same issue but was lazy enough not to create it. Essentially what happens for me is that on a small enough cluster (single node actually), if all nodes are blacklisted by the AM, it will just keep getting containers and wasting them.
> Support AM specific blacklisting of nodes on the RM
> ---------------------------------------------------
>
> Key: MAPREDUCE-3314
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3314
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Hitesh Shah
> Fix For: 0.23.1
>
>
> The AM blacklists certain nodes due to task failures but the RM does not know of this and can allocate blacklisted nodes to the AM again and again.
> RM should support a protocol that allows AM to inform the RM of nodes that it should not allocate to it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3314) AM should have a way of telling
RM to not allocate containers on some nodes
Posted by "Hitesh Shah (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hitesh Shah reassigned MAPREDUCE-3314:
--------------------------------------
Assignee: Hitesh Shah
> AM should have a way of telling RM to not allocate containers on some nodes
> ---------------------------------------------------------------------------
>
> Key: MAPREDUCE-3314
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3314
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Hitesh Shah
> Assignee: Hitesh Shah
> Fix For: 0.23.1
>
>
> The AM blacklists certain nodes due to task failures but the RM does not know of this and can allocate blacklisted nodes to the AM again and again.
> RM should support a protocol that allows AM to inform the RM of nodes that it should not allocate to it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3314) AM should have a way of telling
RM to not allocate containers on some nodes
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-3314:
-------------------------------------------
Target Version/s: 2.0.0, 3.0.0 (was: 0.23.1)
> AM should have a way of telling RM to not allocate containers on some nodes
> ---------------------------------------------------------------------------
>
> Key: MAPREDUCE-3314
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3314
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Hitesh Shah
> Fix For: 0.24.0
>
>
> The AM blacklists certain nodes due to task failures but the RM does not know of this and can allocate blacklisted nodes to the AM again and again.
> RM should support a protocol that allows AM to inform the RM of nodes that it should not allocate to it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3314) AM should have a way of telling
RM to not allocate containers on some nodes
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3314:
-----------------------------------------------
Summary: AM should have a way of telling RM to not allocate containers on some nodes (was: Support AM specific blacklisting of nodes on the RM)
Ran into this again.
Editing the title to correctly reflect what we want.
> AM should have a way of telling RM to not allocate containers on some nodes
> ---------------------------------------------------------------------------
>
> Key: MAPREDUCE-3314
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3314
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Hitesh Shah
> Fix For: 0.23.1
>
>
> The AM blacklists certain nodes due to task failures but the RM does not know of this and can allocate blacklisted nodes to the AM again and again.
> RM should support a protocol that allows AM to inform the RM of nodes that it should not allocate to it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3314) AM should have a way of telling
RM to not allocate containers on some nodes
Posted by "Hitesh Shah (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hitesh Shah updated MAPREDUCE-3314:
-----------------------------------
Priority: Critical (was: Major)
> AM should have a way of telling RM to not allocate containers on some nodes
> ---------------------------------------------------------------------------
>
> Key: MAPREDUCE-3314
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3314
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Hitesh Shah
> Assignee: Hitesh Shah
> Priority: Critical
> Fix For: 0.23.1
>
>
> The AM blacklists certain nodes due to task failures but the RM does not know of this and can allocate blacklisted nodes to the AM again and again.
> RM should support a protocol that allows AM to inform the RM of nodes that it should not allocate to it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3314) AM should have a way of telling
RM to not allocate containers on some nodes
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3314:
-------------------------------------
Fix Version/s: (was: 0.23.1)
0.24.0
> AM should have a way of telling RM to not allocate containers on some nodes
> ---------------------------------------------------------------------------
>
> Key: MAPREDUCE-3314
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3314
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Hitesh Shah
> Fix For: 0.24.0
>
>
> The AM blacklists certain nodes due to task failures but the RM does not know of this and can allocate blacklisted nodes to the AM again and again.
> RM should support a protocol that allows AM to inform the RM of nodes that it should not allocate to it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira