You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Michael Griffiths (Jira)" <ji...@apache.org> on 2023/03/07 03:51:00 UTC

[jira] [Created] (YARN-11452) Ability to use GPUs on YARN Nodemanager when running inside Docker

Michael Griffiths created YARN-11452:
----------------------------------------

             Summary: Ability to use GPUs on YARN Nodemanager when running inside Docker
                 Key: YARN-11452
                 URL: https://issues.apache.org/jira/browse/YARN-11452
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 3.2.4
         Environment: Docker
            Reporter: Michael Griffiths


When running Nodemanagers in docker I have tried to enable GPU support however this fails because it seems to require GPU isolation to be enabled.  GPU isolation requires cgroups which are not available in Docker containers (I even tried using lxcfs to simulate cgroups - but this also fails with an error about mounting the /cgroups/devices/hadoop-yarn directory).

Is it possible to configure Nodemanagers so that they can detect/use GPUs without enabling GPU isolation?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org