You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Wangda Tan (JIRA)" <ji...@apache.org> on 2014/01/16 06:11:20 UTC

[jira] [Created] (YARN-1609) Add Service Container type to NodeManager in YARN

Wangda Tan created YARN-1609:
--------------------------------

             Summary: Add Service Container type to NodeManager in YARN
                 Key: YARN-1609
                 URL: https://issues.apache.org/jira/browse/YARN-1609
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: nodemanager
    Affects Versions: 2.2.0
            Reporter: Wangda Tan
            Assignee: Wangda Tan


>From our work to support running OpenMPI on YARN (MAPREDUCE-2911), we found that it’s important to have framework specific daemon process manage the tasks on each node directly. The daemon process, most likely similar in other frameworks as well, provides critical services to tasks running on that node(for example “wireup”, spawn user process in large numbers at once etc). In YARN, it’s hard, if not possible, to have the those processes to be managed by YARN. 

We propose to extend the container model on NodeManager side to support “Service Container” to run/manage such framework daemon/services process. We believe this is very useful to other application framework developers as well.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)