You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by fe...@apache.org on 2018/01/14 07:26:18 UTC
spark git commit: [SPARK-23038][TEST] Update docker/spark-test
(JDK/OS)
Repository: spark
Updated Branches:
refs/heads/master c3548d11c -> 7a3d0aad2
[SPARK-23038][TEST] Update docker/spark-test (JDK/OS)
## What changes were proposed in this pull request?
This PR aims to update the followings in `docker/spark-test`.
- JDK7 -> JDK8
Spark 2.2+ supports JDK8 only.
- Ubuntu 12.04.5 LTS(precise) -> Ubuntu 16.04.3 LTS(xeniel)
The end of life of `precise` was April 28, 2017.
## How was this patch tested?
Manual.
* Master
```
$ cd external/docker
$ ./build
$ export SPARK_HOME=...
$ docker run -v $SPARK_HOME:/opt/spark spark-test-master
CONTAINER_IP=172.17.0.3
...
18/01/11 06:50:25 INFO MasterWebUI: Bound MasterWebUI to 172.17.0.3, and started at http://172.17.0.3:8080
18/01/11 06:50:25 INFO Utils: Successfully started service on port 6066.
18/01/11 06:50:25 INFO StandaloneRestServer: Started REST server for submitting applications on port 6066
18/01/11 06:50:25 INFO Master: I have been elected leader! New state: ALIVE
```
* Slave
```
$ docker run -v $SPARK_HOME:/opt/spark spark-test-worker spark://172.17.0.3:7077
CONTAINER_IP=172.17.0.4
...
18/01/11 06:51:54 INFO Worker: Successfully registered with master spark://172.17.0.3:7077
```
After slave starts, master will show
```
18/01/11 06:51:54 INFO Master: Registering worker 172.17.0.4:8888 with 4 cores, 1024.0 MB RAM
```
Author: Dongjoon Hyun <do...@apache.org>
Closes #20230 from dongjoon-hyun/SPARK-23038.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7a3d0aad
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/7a3d0aad
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/7a3d0aad
Branch: refs/heads/master
Commit: 7a3d0aad2b89aef54f7dd580397302e9ff984d9d
Parents: c3548d1
Author: Dongjoon Hyun <do...@apache.org>
Authored: Sat Jan 13 23:26:12 2018 -0800
Committer: Felix Cheung <fe...@apache.org>
Committed: Sat Jan 13 23:26:12 2018 -0800
----------------------------------------------------------------------
external/docker/spark-test/base/Dockerfile | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/7a3d0aad/external/docker/spark-test/base/Dockerfile
----------------------------------------------------------------------
diff --git a/external/docker/spark-test/base/Dockerfile b/external/docker/spark-test/base/Dockerfile
index 5a95a93..c70cd71 100644
--- a/external/docker/spark-test/base/Dockerfile
+++ b/external/docker/spark-test/base/Dockerfile
@@ -15,14 +15,14 @@
# limitations under the License.
#
-FROM ubuntu:precise
+FROM ubuntu:xenial
# Upgrade package index
-# install a few other useful packages plus Open Jdk 7
+# install a few other useful packages plus Open Jdk 8
# Remove unneeded /var/lib/apt/lists/* after install to reduce the
# docker image size (by ~30MB)
RUN apt-get update && \
- apt-get install -y less openjdk-7-jre-headless net-tools vim-tiny sudo openssh-server && \
+ apt-get install -y less openjdk-8-jre-headless iproute2 vim-tiny sudo openssh-server && \
rm -rf /var/lib/apt/lists/*
ENV SCALA_VERSION 2.11.8
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org