You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Ondrej Kokes (JIRA)" <ji...@apache.org> on 2018/06/11 10:08:00 UTC

[jira] [Created] (SPARK-24516) PySpark Bindings for K8S - make Python 3 the default

Ondrej Kokes created SPARK-24516:
------------------------------------

             Summary: PySpark Bindings for K8S - make Python 3 the default
                 Key: SPARK-24516
                 URL: https://issues.apache.org/jira/browse/SPARK-24516
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes, PySpark
    Affects Versions: 2.4.0
            Reporter: Ondrej Kokes


Initial PySpark-k8s bindings have just been resolved (SPARK-23984), but the default Python version there is 2. While you can override this by setting it to 3, I think we should have sensible defaults.

Python 3 has been around for ten years and is the clear successor, Python 2 has only 18 months left in terms of support. There isn't a good reason to suggest Python 2 should be used, not in 2018 and not when both versions are supported.

The relevant commit [is here|https://github.com/apache/spark/commit/1a644afbac35c204f9ad55f86999319a9ab458c6#diff-6e882d5561424e7e6651eb46f10104b8R194], the version is also [in the documentation|https://github.com/apache/spark/commit/1a644afbac35c204f9ad55f86999319a9ab458c6#diff-b5527f236b253e0d9f5db5164bdb43e9R643].

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org