[jira] [Created] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

["Eric Payne (Jira)" <ji...@apache.org>]

Eric Payne created YARN-9894:
--------------------------------

             Summary: CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.
                 Key: YARN-9894
                 URL: https://issues.apache.org/jira/browse/YARN-9894
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: capacity scheduler, test
    Affects Versions: 3.1.3, 3.2.1, 2.8.5, 2.9.2
            Reporter: Eric Payne


I have developed a unit test based on the existing TestCapacitySchedulerPerf tests that will measure the performance of a configurable number of apps in a configurable number of queues. It will also test the performance of a cluster that has many queues but only a portion of them are active.

{code:title=For example:}
$ mvn test -Dtest=TestCapacitySchedulerPerf#testUserLimitThroughputWithManyQueues \
  -DRunCapacitySchedulerPerfTests=true
  -DNumberOfQueues=100 \
  -DNumberOfApplications=200 \
  -DPercentActiveQueues=100
{code}

- Parameters:
-- RunCapacitySchedulerPerfTests=true:
Needed in order to trigger the test
-- NumberOfQueues
Configurable number of queues
-- NumberOfApplications
Total number of apps to run in the whole cluster, distributed evenly across all queues
-- PercentActiveQueues
Percentage of the queues that contain active applications



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org