You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Zhankun Tang (JIRA)" <ji...@apache.org> on 2018/09/25 08:42:00 UTC

[jira] [Created] (YARN-8820) [Umbrella] GPU support on YARN - Phase 2

Zhankun Tang created YARN-8820:
----------------------------------

             Summary: [Umbrella] GPU support on YARN - Phase 2
                 Key: YARN-8820
                 URL: https://issues.apache.org/jira/browse/YARN-8820
             Project: Hadoop YARN
          Issue Type: New Feature
          Components: yarn
            Reporter: Zhankun Tang


In YARN-6223, we've done a basic support for Nvidia GPU on YARN including resource discovery, allocation, cgroups isolation as well as docker support (Nvidia-docker v1). But there's still room for us to improve.

For instance, multiple GPU cards in one host bring the requirements of GPU hierarchy scheduling. The Nvidia-docker v2 emerged and v1 has been deprecated. And we're planning a new device plugin framework in YARN which has relation to GPU support too. (maybe in the long term)

So here we converge threads related to the above and open an umbrella here to track the next stage tasks for convenience.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org