You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "BoYang (JIRA)" <ji...@apache.org> on 2014/09/06 01:37:29 UTC

[jira] [Created] (YARN-2518) Support in-process container executor

BoYang created YARN-2518:
----------------------------

             Summary: Support in-process container executor
                 Key: YARN-2518
                 URL: https://issues.apache.org/jira/browse/YARN-2518
             Project: Hadoop YARN
          Issue Type: New Feature
          Components: nodemanager
    Affects Versions: 2.5.0
         Environment: Linux, Windows
            Reporter: BoYang
            Priority: Minor


Node Manage always creates a new process for a new application. We have hit a scenario where we want the node manager to execute the application inside its own process, so we get fast response time. It would be nice if Node Manager or YARN can provide native support for that.

In general, the scenario is that we have a long running process which can accept requests and process the requests inside its own process. Since YARN is good at scheduling jobs, we want to use YARN to dispatch jobs (e.g. requests in JSON) to the long running process. In that case, we do not want YARN container to spin up a new process for each request. Instead, we want YARN container to send the request to the long running process for further processing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)