You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Haibo Chen (JIRA)" <ji...@apache.org> on 2017/10/17 21:29:04 UTC

[jira] [Issue Comment Deleted] (YARN-6546) SLS is slow while loading 10k queues

     [ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Haibo Chen updated YARN-6546:
-----------------------------
    Comment: was deleted

(was: +1. Will commit it later if there is no objection.)

> SLS is slow while loading 10k queues
> ------------------------------------
>
>                 Key: YARN-6546
>                 URL: https://issues.apache.org/jira/browse/YARN-6546
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: scheduler-load-simulator
>    Affects Versions: 3.0.0-alpha2
>            Reporter: Yufei Gu
>            Assignee: Yufei Gu
>         Attachments: Desktop.png, YARN-6546.001.patch, YARN-6546.002.patch
>
>
> It takes a long time (more than 10 minutes) to load 10k queues in SLS. The problem should be in {{com.codahale.metrics.CsvReporter}} based on the result from profiler. SLS creates 14 .csv files for each leaf queue, and update them constantly during execution. It is not necessary to log information for inactive queues. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org