You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Benjamin Teke (Jira)" <ji...@apache.org> on 2023/04/21 12:08:00 UTC

[jira] [Resolved] (YARN-11463) Node Labels root directory creation doesn't have a retry logic

     [ https://issues.apache.org/jira/browse/YARN-11463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Benjamin Teke resolved YARN-11463.
----------------------------------
        Hadoop Flags: Reviewed
    Target Version/s: 3.4.0
          Resolution: Fixed

> Node Labels root directory creation doesn't have a retry logic
> --------------------------------------------------------------
>
>                 Key: YARN-11463
>                 URL: https://issues.apache.org/jira/browse/YARN-11463
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: capacity scheduler
>            Reporter: Benjamin Teke
>            Assignee: Ashutosh Gupta
>            Priority: Major
>              Labels: pull-request-available
>
> When CS is initialized, it'll [try to create the configured node labels root dir|https://github.com/apache/hadoop/blob/7169ec450957e5602775c3cd6fe1bf0b95773dfb/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/nodelabels/store/AbstractFSNodeStore.java#L69]. This however doesn't implement any kind of retry logic (in contrast to the RM FS state store or ZK state store), hence if the distributed file system is unavailable at the exact moment CS tries to start it'll fail. A retry logic could be implemented to improve the robustness of the startup process.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org