You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2019/08/11 21:22:00 UTC

[jira] [Updated] (SPARK-28652) spark.kubernetes.pyspark.pythonVersion is never passed to executors

     [ https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Liang-Chi Hsieh updated SPARK-28652:
------------------------------------
    Issue Type: Test  (was: Bug)

> spark.kubernetes.pyspark.pythonVersion is never passed to executors
> -------------------------------------------------------------------
>
>                 Key: SPARK-28652
>                 URL: https://issues.apache.org/jira/browse/SPARK-28652
>             Project: Spark
>          Issue Type: Test
>          Components: Kubernetes
>    Affects Versions: 2.4.3
>            Reporter: nanav yorbiz
>            Priority: Major
>
> I suppose this may not be a priority with Python2 on its way out, but given that this setting is only ever sent to the driver and not the executors, no actual work can be performed when the versions don't match, which will tend to be *always* with the default setting for the driver being changed from 2 to 3, and the executors using `python`, which defaults to v2, by default.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org