You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Nagaram Prasad Addepally (JIRA)" <ji...@apache.org> on 2018/11/14 23:24:00 UTC
[jira] [Commented] (SPARK-25957) Skip building spark-r docker image
if spark distribution does not have R support
[ https://issues.apache.org/jira/browse/SPARK-25957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687276#comment-16687276 ]
Nagaram Prasad Addepally commented on SPARK-25957:
--------------------------------------------------
I think we can parameterize what images we want to build and publish using [docker-image-tool.sh|https://github.com/apache/spark/blob/master/bin/docker-image-tool.sh]. By default, we can build and publish all images (to keep existing behavior intact) and provide an override option to specify which images we want to build explicitly. Note that we will always build base spark (JVM) docker image.
For example,
{noformat}
./docker-image-tool.sh -r <repo> -t <tag> build|publish # Builds/publishes all docker images
./docker-image-tool.sh -r <repo> -t <tag> --select [p,R] build|publish # Builds/publishes docker images specified in select param. We will always build spark base (JVM) docker image.{noformat}
Does this approach sound reasonable? Or anyone has a better suggestion?
> Skip building spark-r docker image if spark distribution does not have R support
> --------------------------------------------------------------------------------
>
> Key: SPARK-25957
> URL: https://issues.apache.org/jira/browse/SPARK-25957
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 2.4.0
> Reporter: Nagaram Prasad Addepally
> Priority: Major
>
> [docker-image-tool.sh|https://github.com/apache/spark/blob/master/bin/docker-image-tool.sh] script by default tries to build spark-r image. We may not always build spark distribution with R support. It would be good to skip building and publishing spark-r images if R support is not available in the spark distribution.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org