You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by va...@apache.org on 2018/12/03 21:54:15 UTC

spark git commit: [SPARK-25957][FOLLOWUP] Build python docker image in sbt build too.

Repository: spark
Updated Branches:
  refs/heads/master 0c2935b01 -> 187bb7d00


[SPARK-25957][FOLLOWUP] Build python docker image in sbt build too.

docker-image-tool.sh requires explicit argument to create the python
image now; do that from the sbt integration tests target too.

Closes #23172 from vanzin/SPARK-25957.followup.

Authored-by: Marcelo Vanzin <va...@cloudera.com>
Signed-off-by: Marcelo Vanzin <va...@cloudera.com>


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/187bb7d0
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/187bb7d0
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/187bb7d0

Branch: refs/heads/master
Commit: 187bb7d008872e812aaa6590c89121bfa50e97d3
Parents: 0c2935b
Author: Marcelo Vanzin <va...@cloudera.com>
Authored: Mon Dec 3 13:54:09 2018 -0800
Committer: Marcelo Vanzin <va...@cloudera.com>
Committed: Mon Dec 3 13:54:09 2018 -0800

----------------------------------------------------------------------
 project/SparkBuild.scala | 8 +++++++-
 1 file changed, 7 insertions(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/187bb7d0/project/SparkBuild.scala
----------------------------------------------------------------------
diff --git a/project/SparkBuild.scala b/project/SparkBuild.scala
index bb834bc..a0946a9 100644
--- a/project/SparkBuild.scala
+++ b/project/SparkBuild.scala
@@ -494,7 +494,13 @@ object KubernetesIntegrationTests {
     dockerBuild := {
       if (shouldBuildImage) {
         val dockerTool = s"$sparkHome/bin/docker-image-tool.sh"
-        val cmd = Seq(dockerTool, "-m", "-t", imageTag.value, "build")
+        val bindingsDir = s"$sparkHome/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/bindings"
+        val cmd = Seq(dockerTool, "-m",
+          "-t", imageTag.value,
+          "-p", s"$bindingsDir/python/Dockerfile",
+          "-R", s"$bindingsDir/R/Dockerfile",
+          "build"
+        )
         val ec = Process(cmd).!
         if (ec != 0) {
           throw new IllegalStateException(s"Process '${cmd.mkString(" ")}' exited with $ec.")


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org