You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2019/03/01 14:43:00 UTC

[jira] [Commented] (SPARK-27024) Design executor interface to support GPU resources

    [ https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781734#comment-16781734 ] 

Thomas Graves commented on SPARK-27024:
---------------------------------------

I will be looking at this and propose a design.

> Design executor interface to support GPU resources
> --------------------------------------------------
>
>                 Key: SPARK-27024
>                 URL: https://issues.apache.org/jira/browse/SPARK-27024
>             Project: Spark
>          Issue Type: Task
>          Components: Spark Core
>    Affects Versions: 3.0.0
>            Reporter: Xingbo Jiang
>            Priority: Major
>
> The executor interface shall deal with the resources allocated to the executor by cluster managers(Standalone, YARN, Kubernetes), so the Spark Executor don’t need to involve into the GPU discovery and allocation, which shall be handled by cluster managers. However, an executor need to sync with the driver to expose available resources to support task scheduling.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org