You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Botong Huang (JIRA)" <ji...@apache.org> on 2018/06/09 04:56:00 UTC
[jira] [Commented] (YARN-7708) [GPG] Load based policy generator
[ https://issues.apache.org/jira/browse/YARN-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506818#comment-16506818 ]
Botong Huang commented on YARN-7708:
------------------------------------
Thanks [~youchen] for the patch! A few comments in LoadBasedGlobalPolicy:
In getTargetWeights, when there's three subclusters and all of their pending is above maxPending, we will get zero weight (default min weight) for all of them?
Can you please change *Map<Class, String>* registerPaths() to *Map<Class<?>, String>*, and in all other necessary places? This will remove all the raw type warnings.
line 48-69: move these to YarnConfiguration, add some comments about them
line 53: default min pending to something smaller, say 100? max pending to say 1000?
line 72-76: some comments here as well to explain the fields
> [GPG] Load based policy generator
> ---------------------------------
>
> Key: YARN-7708
> URL: https://issues.apache.org/jira/browse/YARN-7708
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Carlo Curino
> Assignee: Young Chen
> Priority: Major
> Attachments: YARN-7708-YARN-7402.01.cumulative.patch, YARN-7708-YARN-7402.01.patch, YARN-7708-YARN-7402.02.cumulative.patch, YARN-7708-YARN-7402.02.patch, YARN-7708-YARN-7402.03.cumulative.patch, YARN-7708-YARN-7402.04.cumulative.patch, YARN-7708-YARN-7402.05.cumulative.patch, YARN-7708-YARN-7402.06.cumulative.patch, YARN-7708-YARN-7402.07.cumulative.patch
>
>
> This policy reads load from the "pendingQueueLength" metrics and provides scaling into a set of weights that influence the AMRMProxy and Router behaviors.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org