You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Bilwa S T (Jira)" <ji...@apache.org> on 2021/05/06 14:19:00 UTC
[jira] [Assigned] (YARN-10755) Multithreaded loading Apps from zk
statestore
[ https://issues.apache.org/jira/browse/YARN-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bilwa S T reassigned YARN-10755:
--------------------------------
Assignee: Bilwa S T
> Multithreaded loading Apps from zk statestore
> ---------------------------------------------
>
> Key: YARN-10755
> URL: https://issues.apache.org/jira/browse/YARN-10755
> Project: Hadoop YARN
> Issue Type: Improvement
> Environment: version: hadooop-2.8.5
> Reporter: chaosju
> Assignee: Bilwa S T
> Priority: Major
> Attachments: image-2021-04-27-12-55-18-710.png
>
>
> In RM, we may be get a list of applications to be read from state store and then divide the work of reading data associated with each app to multiple threads.
> I think its import to large clusters.
> h2. Profile
> Profile by TestZKRMStateStorePerf
> Params： -appSize 20000 -appattemptsize 2 -hostPort localhost:2181
> Profile Result： loadRMAppState stage cost is 5s.
> Profile logs：
> !image-2021-04-27-12-55-18-710.png!
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org