[jira] [Commented] (YARN-1488) Allow containers to delegate resources to another container

["Arun C Murthy (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13844348#comment-13844348 ] 

Arun C Murthy commented on YARN-1488:
-------------------------------------

We should add a new API to the NodeManager which would allow an application to *delegate* a container's resources to a different container:

{code:title=ContainerManagementProtocol.java|borderStyle=solid}  
public interface ContainerManagementProtocol {
 // ...
 public DelegateContainerResponse delegateContainer(DelegateContainerRequest request);
 // ...
}
{code}

{code:title=DelegateContainerRequest.java|borderStyle=solid}  
public abstract class DelegateContainerRequest {
 // ...
 public ContainerLaunchContext getSourceContainer();

 public ContainerId getTargetContainer();
 // ...
}
{code}


The implementation of this api would notify the NodeManager to change it's monitoring on the recipient container i.e. Impala or Datanode by modifying cgroup of the recipient container.

Similarly, the NodeManager could be instructed by the ResourceManager to preempt the resources of the source container for continuing to serve the global SLAs of the queues - again, this is implemented by modifying the cgroup of the recipient container. This will allow for ResouceManager/NodeManager to be explicitly in control of resources, even in the face of misbehaving AMs etc.

> Allow containers to delegate resources to another container
> -----------------------------------------------------------
>
>                 Key: YARN-1488
>                 URL: https://issues.apache.org/jira/browse/YARN-1488
>             Project: Hadoop YARN
>          Issue Type: New Feature
>            Reporter: Arun C Murthy
>
> We should allow containers to delegate resources to another container. This would allow external frameworks to share not just YARN's resource-management capabilities but also it's workload-management capabilities.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)