You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "ygl (Jira)" <ji...@apache.org> on 2020/04/18 09:07:00 UTC

[jira] [Created] (YARN-10238) CLONE - hadoop-sls can not simulate huge scale of YARN

ygl created YARN-10238:
--------------------------

             Summary: CLONE - hadoop-sls can not simulate huge scale of YARN
                 Key: YARN-10238
                 URL: https://issues.apache.org/jira/browse/YARN-10238
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: ygl
            Assignee: zhangshilong


Our YARN cluster scale to nearly 10 thousands nodes. We need to do scheduler pressure test.
Using SLS,we start  2000+ threads to simulate NM and AM. But  cpu.load very high to 100+. I thought that will affect  performance evaluation of scheduler. 
So I thought to separate the scheduler from the simulator.
I start a real RM. Then SLS will register nodes to RM,And submit apps to RM using RM RPC.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org