You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2019/05/23 18:50:00 UTC

[jira] [Created] (SPARK-27823) Add an abstraction layer for accelerator resource handling to avoid manipulating raw confs

Xiangrui Meng created SPARK-27823:
-------------------------------------

             Summary: Add an abstraction layer for accelerator resource handling to avoid manipulating raw confs
                 Key: SPARK-27823
                 URL: https://issues.apache.org/jira/browse/SPARK-27823
             Project: Spark
          Issue Type: Story
          Components: Spark Core
    Affects Versions: 3.0.0
            Reporter: Xiangrui Meng


In SPARK-27488, we extract resource requests and allocation by parsing raw Spark confs. This hurts readability because we didn't have the abstraction at resource level. After we merge the core changes, we should do a refactoring and make the code more readable.

See https://github.com/apache/spark/pull/24615#issuecomment-494580663.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org