You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2018/09/17 18:08:00 UTC

[jira] [Created] (YARN-8784) DockerLinuxContainerRuntime prevents access to distributed cache entries on a full disk

Jason Lowe created YARN-8784:
--------------------------------

             Summary: DockerLinuxContainerRuntime prevents access to distributed cache entries on a full disk
                 Key: YARN-8784
                 URL: https://issues.apache.org/jira/browse/YARN-8784
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 3.1.1, 3.2.0
            Reporter: Jason Lowe


DockerLinuxContainerRuntime bind mounts the filecache and usercache directories into the container to allow tasks to access entries in the distributed cache.  However it only bind mounts  directories on disks that are considered good, and disks that are full or bad are not in that list.  If a container tries to run with a distributed cache entry that has been previously localized to a disk that is now considered full/bad, the dist cache directory will _not_ be bind-mounted into the container's filesystem namespace.  At that point any symlinks in the container's current working directory that point to those disks will reference invalid paths.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org