You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Jackey Lee (Jira)" <ji...@apache.org> on 2020/01/15 01:41:00 UTC

[jira] [Created] (SPARK-30514) add ENV_PYSPARK_MAJOR_PYTHON_VERSION support for JavaMainAppResource

Jackey Lee created SPARK-30514:
----------------------------------

             Summary: add ENV_PYSPARK_MAJOR_PYTHON_VERSION support for JavaMainAppResource
                 Key: SPARK-30514
                 URL: https://issues.apache.org/jira/browse/SPARK-30514
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 3.0.0, 3.1.0
            Reporter: Jackey Lee


In apache Livy, the program is first started with JavaMainAppResource, and then start the Python worker. At this time, the program needs to be able to pass Python environment variables.

In spark on yarn, we support it through spark.yarn.isPython. In k8s, we can support this in a better way.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org