You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@toree.apache.org by lr...@apache.org on 2019/06/18 19:05:54 UTC
[incubator-toree] branch master updated (ec32167 -> 916a0ba)
This is an automated email from the ASF dual-hosted git repository.
lresende pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-toree.git.
from ec32167 [MINOR] Update to latest version of sb plugins
new 67f985d [TOREE-502] Fix OpenJDK install on travis build
new 916a0ba [TOREE-502] Install Apache Spark from dist archive
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
Dockerfile.system-test | 21 ++++++++-------------
1 file changed, 8 insertions(+), 13 deletions(-)
[incubator-toree] 01/02: [TOREE-502] Fix OpenJDK install on travis
build
Posted by lr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lresende pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-toree.git
commit 67f985d4eba23277699cf7d377acd9dc4cf24d56
Author: Luciano Resende <lr...@apache.org>
AuthorDate: Mon Jun 17 11:08:29 2019 -0700
[TOREE-502] Fix OpenJDK install on travis build
---
Dockerfile.system-test | 14 +++++---------
1 file changed, 5 insertions(+), 9 deletions(-)
diff --git a/Dockerfile.system-test b/Dockerfile.system-test
index 28248fb..9dad03d 100644
--- a/Dockerfile.system-test
+++ b/Dockerfile.system-test
@@ -14,25 +14,21 @@
# See the License for the specific language governing permissions and
# limitations under the License
#
-# This is a dockerfile used to construct the spark environment used for the
+# This is a dockerfile used to construct the spark environment used for the
# integration test suite.
-FROM jupyter/all-spark-notebook:07a7c4d6d447
+FROM jupyter/all-spark-notebook:d4cbf2f80a2a
# User escalation
USER root
# Spark dependencies
-ENV APACHE_SPARK_VERSION 2.0.0
+ENV APACHE_SPARK_VERSION 2.3.3
-# Temporarily add jessie backports to get openjdk 8, but then remove that source
-RUN echo 'deb http://ftp.debian.org/debian jessie-backports main' > /etc/apt/sources.list.d/jessie-backports.list && \
- apt-get -y update && \
- apt-get install -y --no-install-recommends -t jessie-backports openjdk-8-jre-headless && \
- rm /etc/apt/sources.list.d/jessie-backports.list && \
+RUN apt-get -y update && \
+ apt-get install -y --no-install-recommends openjdk-8-jre-headless && \
apt-get clean && \
rm -rf /var/lib/apt/lists/* && \
- rm -rf /var/lib/apt/lists/* && \
update-alternatives --set java /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java
[incubator-toree] 02/02: [TOREE-502] Install Apache Spark from dist
archive
Posted by lr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lresende pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-toree.git
commit 916a0bab79e786e18b18cde6625c33ea45d2af33
Author: Luciano Resende <lr...@apache.org>
AuthorDate: Tue Jun 18 05:49:26 2019 -0700
[TOREE-502] Install Apache Spark from dist archive
---
Dockerfile.system-test | 7 +++----
1 file changed, 3 insertions(+), 4 deletions(-)
diff --git a/Dockerfile.system-test b/Dockerfile.system-test
index 9dad03d..e8e1cff 100644
--- a/Dockerfile.system-test
+++ b/Dockerfile.system-test
@@ -34,10 +34,9 @@ RUN apt-get -y update && \
# Installing Spark2
RUN cd /tmp && \
- wget -q http://d3kbcqa49mib13.cloudfront.net/spark-${APACHE_SPARK_VERSION}-bin-hadoop2.6.tgz && \
- echo "e17d9da4b3ac463ea3ce42289f2a71cefb479d154b1ffd00310c7d7ab207aa2c *spark-${APACHE_SPARK_VERSION}-bin-hadoop2.6.tgz" | sha256sum -c - && \
- tar xzf spark-${APACHE_SPARK_VERSION}-bin-hadoop2.6.tgz -C /usr/local && \
- rm spark-${APACHE_SPARK_VERSION}-bin-hadoop2.6.tgz
+ wget -q https://archive.apache.org/dist/spark/spark-${APACHE_SPARK_VERSION}/spark-${APACHE_SPARK_VERSION}-bin-hadoop2.6.tgz && \
+ tar xzf spark-${APACHE_SPARK_VERSION}-bin-hadoop2.6.tgz -C /usr/local && \
+ rm spark-${APACHE_SPARK_VERSION}-bin-hadoop2.6.tgz
# Overwrite symlink
RUN cd /usr/local && \