You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2019/04/04 00:38:00 UTC

[jira] [Updated] (SPARK-27024) Design: Executor interface for cluster managers to support GPU resources

     [ https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xiangrui Meng updated SPARK-27024:
----------------------------------
    Summary: Design: Executor interface for cluster managers to support GPU resources  (was: Design executor interface to support GPU resources)

> Design: Executor interface for cluster managers to support GPU resources
> ------------------------------------------------------------------------
>
>                 Key: SPARK-27024
>                 URL: https://issues.apache.org/jira/browse/SPARK-27024
>             Project: Spark
>          Issue Type: Task
>          Components: Spark Core
>    Affects Versions: 3.0.0
>            Reporter: Xingbo Jiang
>            Assignee: Thomas Graves
>            Priority: Major
>
> The executor interface shall deal with the resources allocated to the executor by cluster managers(Standalone, YARN, Kubernetes), so the Spark Executor don’t need to involve into the GPU discovery and allocation, which shall be handled by cluster managers. However, an executor need to sync with the driver to expose available resources to support task scheduling.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org