You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "chaosju (Jira)" <ji...@apache.org> on 2021/04/27 04:48:00 UTC
[jira] [Updated] (YARN-10755) Multithreaded loading Apps from zk
statestore
[ https://issues.apache.org/jira/browse/YARN-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
chaosju updated YARN-10755:
---------------------------
Description:
In RM, we may be get a list of applications to be read from state store and then divide the work of reading data associated with each app to multiple threads.
h2. Profile
Profile by TestZKRMStateStorePerf
Params： -appSize 20000 -appattemptsize 2 -hostPort localhost:2181
Profile Result： loadRMAppState stage cost is 8s.
was:
In RM, we may be get a list of applications to be read from state store and then divide the work of reading data associated with each app to multiple threads.
h2. Profile
Profile by TestZKRMStateStorePerf
Params： -appSize 20000 -appattemptsize 2 -hostPort localhost:2181
Profile Result： loadRMAppState stage cost is 8s.
> Multithreaded loading Apps from zk statestore
> ---------------------------------------------
>
> Key: YARN-10755
> URL: https://issues.apache.org/jira/browse/YARN-10755
> Project: Hadoop YARN
> Issue Type: Improvement
> Environment: version: hadooop-2.8.5
> Reporter: chaosju
> Priority: Major
>
>
> In RM, we may be get a list of applications to be read from state store and then divide the work of reading data associated with each app to multiple threads.
> h2. Profile
> Profile by TestZKRMStateStorePerf
> Params： -appSize 20000 -appattemptsize 2 -hostPort localhost:2181
> Profile Result： loadRMAppState stage cost is 8s.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org