You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Bence Kosztolnik (Jira)" <ji...@apache.org> on 2024/06/26 09:43:00 UTC
[jira] [Created] (YARN-11703) Validate accessibility of Node Manager working directories
Bence Kosztolnik created YARN-11703:
---------------------------------------
Summary: Validate accessibility of Node Manager working directories
Key: YARN-11703
URL: https://issues.apache.org/jira/browse/YARN-11703
Project: Hadoop YARN
Issue Type: Improvement
Components: yarn
Affects Versions: 3.5.0
Reporter: Bence Kosztolnik
Assignee: Bence Kosztolnik
h3. Problem:
If some subdirectory or file changes permission under *yarn.nodemanager.local-dirs* or {*}yarn.nodemanager.log-dirs{*}, and won't be accessible by the node manager, then the node manager will not reach an unhealthy state, but container runs would fail.
h3. Testing:
- run an example PI job in a cluster
- change the user cache directory of the user to not readable by the node manager. For example:
{noformat}
chmod 222 ./usercache/{user}
{noformat}
- cluster state will stay healthy
- re-run the PI job
- containers will fail on the affected node, with
{noformat}
... Not able to initialize app-cache directories in any of the configured local directories for user ...{noformat}
h3. Solution:
Add an extra validation to the DirectoryCollection#testdirs to ensure the content of the local-dirs and log-dirs are accessible by the node manager, and turn the node unhealthy if not.
New flag will be introduced to enable this validation: *yarn.nodemanager.working-dir-content-accessibility-validation.enabled* (default true)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org