You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by fe...@apache.org on 2018/10/25 06:29:52 UTC
spark git commit: [SPARK-24516][K8S] Change Python default to Python3
Repository: spark
Updated Branches:
refs/heads/master b2e325625 -> 19ada15d1
[SPARK-24516][K8S] Change Python default to Python3
## What changes were proposed in this pull request?
As this is targeted for 3.0.0 and Python2 will be deprecated by Jan 1st, 2020, I feel it is appropriate to change the default to Python3. Especially as these projects [found here](https://python3statement.org/) are deprecating their support.
## How was this patch tested?
Unit and Integration tests
Author: Ilan Filonenko <if...@gmail.com>
Closes #22810 from ifilonenko/SPARK-24516.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/19ada15d
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/19ada15d
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/19ada15d
Branch: refs/heads/master
Commit: 19ada15d1b15256de4e3bf2f4b17d87ea0d65cc3
Parents: b2e3256
Author: Ilan Filonenko <if...@gmail.com>
Authored: Wed Oct 24 23:29:47 2018 -0700
Committer: Felix Cheung <fe...@apache.org>
Committed: Wed Oct 24 23:29:47 2018 -0700
----------------------------------------------------------------------
docs/running-on-kubernetes.md | 2 +-
.../core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/19ada15d/docs/running-on-kubernetes.md
----------------------------------------------------------------------
diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md
index d629ed3..60c9279 100644
--- a/docs/running-on-kubernetes.md
+++ b/docs/running-on-kubernetes.md
@@ -816,7 +816,7 @@ specific to Spark on Kubernetes.
</tr>
<tr>
<td><code>spark.kubernetes.pyspark.pythonVersion</code></td>
- <td><code>"2"</code></td>
+ <td><code>"3"</code></td>
<td>
This sets the major Python version of the docker image used to run the driver and executor containers. Can either be 2 or 3.
</td>
http://git-wip-us.apache.org/repos/asf/spark/blob/19ada15d/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
----------------------------------------------------------------------
diff --git a/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala b/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
index c2ad80c..fff8fa4 100644
--- a/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
+++ b/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
@@ -223,7 +223,7 @@ private[spark] object Config extends Logging {
.stringConf
.checkValue(pv => List("2", "3").contains(pv),
"Ensure that major Python version is either Python2 or Python3")
- .createWithDefault("2")
+ .createWithDefault("3")
val KUBERNETES_KERBEROS_KRB5_FILE =
ConfigBuilder("spark.kubernetes.kerberos.krb5.path")
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org