You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Yufei Gu (JIRA)" <ji...@apache.org> on 2018/06/22 21:10:00 UTC

[jira] [Commented] (YARN-8184) Too many metrics if containerLocalizer/ResourceLocalizationService uses ReadWriteDiskValidator

    [ https://issues.apache.org/jira/browse/YARN-8184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16520773#comment-16520773 ] 

Yufei Gu commented on YARN-8184:
--------------------------------

Committed to trunk. Thanks for the review, [~haibochen].

> Too many metrics if containerLocalizer/ResourceLocalizationService uses ReadWriteDiskValidator
> ----------------------------------------------------------------------------------------------
>
>                 Key: YARN-8184
>                 URL: https://issues.apache.org/jira/browse/YARN-8184
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>            Reporter: Yufei Gu
>            Assignee: Yufei Gu
>            Priority: Major
>             Fix For: 3.2.0
>
>         Attachments: YARN-8184.001.patch, YARN-8184.002.patch
>
>
> ContainerLocalizer or ResourceLocalizationService will use the ReadWriteDiskValidator as its disk validator when it downloads files if we configure the yarn.nodemanger.disk-validator to ReadWriteDiskValidator's name. In that case, ReadWriteDiskValidator will create a metric item for each directory localized, which will be too many metrics. We should let ContainerLocalizer only use the basic disk validator.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org