You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2019/04/17 14:09:00 UTC
[jira] [Commented] (SPARK-27488) Driver interface to support GPU
resources
[ https://issues.apache.org/jira/browse/SPARK-27488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820119#comment-16820119 ]
Thomas Graves commented on SPARK-27488:
---------------------------------------
Note, the api design is here: https://issues.apache.org/jira/browse/SPARK-27364
> Driver interface to support GPU resources
> ------------------------------------------
>
> Key: SPARK-27488
> URL: https://issues.apache.org/jira/browse/SPARK-27488
> Project: Spark
> Issue Type: Story
> Components: Spark Core
> Affects Versions: 3.0.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Major
>
> We want to have an interface to allow the users on the driver to get what resources are allocated to them. This is mostly to handle the case the cluster manager does not launch the driver in an isolated environment and where users could be sharing hosts. For instance in standalone mode it doesn't support container isolation so a host may have 4 gpu's, but only 2 of them could be assigned to the driver. In this case we need an interface for the cluster manager to specify what gpu's for the driver to use and an interface for the user to get the resource information
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org