[jira] [Created] (YARN-4619) Add support to scheduler load simulator to run NM and AM simulation separately from the RM process

["Ming Ma (JIRA)" <ji...@apache.org>]

Ming Ma created YARN-4619:
-----------------------------

             Summary: Add support to scheduler load simulator to run NM and AM simulation separately from the RM process
                 Key: YARN-4619
                 URL: https://issues.apache.org/jira/browse/YARN-4619
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Ming Ma


Currently SLS run everything in one JVM. It has some limitations if we want to use the tool to evaluate scheduler performance. For example, gc caused by the NM and AM simulation allocation can impact the test; the simulation uses direct method calls into RM without using RPC.

First we need to refactor SLS to use RPC calls instead of direct calls, Then we can provide options to start SLS in different modes, such as RM only, NM+AM simulation only. We can even consider running distributed NM+AM simulations on different machines.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)