You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Yufei Gu (JIRA)" <ji...@apache.org> on 2018/04/19 20:59:00 UTC
[jira] [Updated] (YARN-8184) Too many metrics if
containerLocalizer/ResourceLocalizationService uses ReadWriteDiskValidator
[ https://issues.apache.org/jira/browse/YARN-8184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yufei Gu updated YARN-8184:
---------------------------
Description: ContainerLocalizer or ResourceLocalizationService will use the ReadWriteDiskValidator as its disk validator when it downloads files if we configure the yarn.nodemanger.disk-validator to ReadWriteDiskValidator's name. In that case, ReadWriteDiskValidator will create a metric item for each directory localized, which will be too many metrics. We should let ContainerLocalizer only use the basic disk validator. (was: ContainerLocalizer will use the ReadWriteDiskValidator as its disk validator when it downloads files if we configure the yarn.nodemanger.disk-validator to ReadWriteDiskValidator's name. In that case, ReadWriteDiskValidator will create a metric item for each directory localized, which will be too many metrics. We should let ContainerLocalizer only use the basic disk validator.)
> Too many metrics if containerLocalizer/ResourceLocalizationService uses ReadWriteDiskValidator
> ----------------------------------------------------------------------------------------------
>
> Key: YARN-8184
> URL: https://issues.apache.org/jira/browse/YARN-8184
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Reporter: Yufei Gu
> Priority: Major
>
> ContainerLocalizer or ResourceLocalizationService will use the ReadWriteDiskValidator as its disk validator when it downloads files if we configure the yarn.nodemanger.disk-validator to ReadWriteDiskValidator's name. In that case, ReadWriteDiskValidator will create a metric item for each directory localized, which will be too many metrics. We should let ContainerLocalizer only use the basic disk validator.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org