You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@datalab.apache.org by "Vira Vitanska (Jira)" <ji...@apache.org> on 2021/06/18 11:48:00 UTC
[jira] [Updated] (DATALAB-1763) [Investigation] Running code for
Spark Standalone does not use GPU (it is supposed to change kernel
connection to Spark Standalone)
[ https://issues.apache.org/jira/browse/DATALAB-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vira Vitanska updated DATALAB-1763:
-----------------------------------
Summary: [Investigation] Running code for Spark Standalone does not use GPU (it is supposed to change kernel connection to Spark Standalone) (was: Running code for Spark Standalone does not use GPU (it is supposed to change kernel connection to Spark Standalone))
> [Investigation] Running code for Spark Standalone does not use GPU (it is supposed to change kernel connection to Spark Standalone)
> -----------------------------------------------------------------------------------------------------------------------------------
>
> Key: DATALAB-1763
> URL: https://issues.apache.org/jira/browse/DATALAB-1763
> Project: Apache DataLab
> Issue Type: Bug
> Components: DataLab Main
> Reporter: Vira Vitanska
> Assignee: Leonid Frolov
> Priority: Major
> Labels: AWS, AZURE, Debian, DevOps, GCP, Known_issues(release2.3), Known_issues(release2.4), RedHat
> Fix For: v.2.5
>
> Attachments: AWS Spark cluster.png, GCP Spark cluster on Tensor.png, GCP Spark cluster.png, GCP Spark cluster2.png
>
>
> *Preconditions:*
> 1. Data Engine is created with shape for GPU
> *Steps to reproduce:*
> 1. Run code that use GPU for Data Engine Service
> *Actual result:*
> 1. GPU is not used
> *Expected result:*
> 1. GPU is used
> ----
> Code which use GPU
> 1. [https://weeraman.com/put-that-gpu-to-good-use-with-python-e5a437168c01]
> 2. [https://www.geeksforgeeks.org/running-python-script-on-gpu/]
> ----
> (i) Spark cluster creation uses notebook image, so if notebook has been created not on GPU the Spark cluster will be created not on GPU as well, even if you use GPU size for creation.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@datalab.apache.org
For additional commands, e-mail: dev-help@datalab.apache.org