You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/06/04 14:11:00 UTC
[jira] [Resolved] (SPARK-35651) Update the doc of
running-on-kubernetes
[ https://issues.apache.org/jira/browse/SPARK-35651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun resolved SPARK-35651.
-----------------------------------
Resolution: Invalid
The error report is wrong because it works in Apache Spark 3.1.2.
- https://downloads.apache.org/spark/spark-3.1.2/
{code}
$ cd ../spark-3.1.2-bin-hadoop3.2
$ ls
LICENSE R RELEASE conf examples kubernetes python yarn
NOTICE README.md bin data jars licenses sbin
$ bin/docker-image-tool.sh -p kubernetes/dockerfiles/spark/bindings/python/Dockerfile -n build
[+] Building 0.6s (3/3) FINISHED
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 2.46kB
...
{code}
> Update the doc of running-on-kubernetes
> ---------------------------------------
>
> Key: SPARK-35651
> URL: https://issues.apache.org/jira/browse/SPARK-35651
> Project: Spark
> Issue Type: Improvement
> Components: docs
> Affects Versions: 3.1.2
> Reporter: Jiamin Wang
> Priority: Major
>
> The commands of building PySpark / SparkR docker image can not run in the lateset version
>
> {code:java}
> ./bin/docker-image-tool.sh -r <repo> -t my-tag -p ./kubernetes/dockerfiles/spark/bindings/python/Dockerfile build {code}
> {code:java}
> ./bin/docker-image-tool.sh -r <repo> -t my-tag -R ./kubernetes/dockerfiles/spark/bindings/R/Dockerfile build
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org