You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by dw...@apache.org on 2020/07/21 09:53:34 UTC
[flink] branch release-1.11 updated (b3ad6e7 -> d3cc4aa)
This is an automated email from the ASF dual-hosted git repository.
dwysakowicz pushed a change to branch release-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git.
from b3ad6e7 [FLINK-18644][doc][hive] Remove obsolete hive connector docs
new f56c219 [FLINK-18600] Upgrade kerberized yarn docker image to use openjdk
new d3cc4aa Revert "[FLINK-18600] Temporary disable kerberized e2e yarn tests"
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
flink-end-to-end-tests/run-nightly-tests.sh | 11 ++++-------
.../test-scripts/docker-hadoop-secure-cluster/Dockerfile | 13 ++-----------
2 files changed, 6 insertions(+), 18 deletions(-)
[flink] 02/02: Revert "[FLINK-18600] Temporary disable kerberized
e2e yarn tests"
Posted by dw...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
dwysakowicz pushed a commit to branch release-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit d3cc4aab80e97c1e5299cbd3788bf0abf4633d59
Author: Dawid Wysakowicz <dw...@apache.org>
AuthorDate: Tue Jul 21 11:52:38 2020 +0200
Revert "[FLINK-18600] Temporary disable kerberized e2e yarn tests"
This reverts commit 065eb7242e2fb437962b89f276fd82513db9ffcd.
---
flink-end-to-end-tests/run-nightly-tests.sh | 11 ++++-------
1 file changed, 4 insertions(+), 7 deletions(-)
diff --git a/flink-end-to-end-tests/run-nightly-tests.sh b/flink-end-to-end-tests/run-nightly-tests.sh
index 3b1da5c..04422c7 100755
--- a/flink-end-to-end-tests/run-nightly-tests.sh
+++ b/flink-end-to-end-tests/run-nightly-tests.sh
@@ -132,13 +132,10 @@ if [[ ${PROFILE} != *"jdk11"* ]]; then
if [[ `uname -i` != 'aarch64' ]]; then
# Hadoop YARN deosn't support aarch64 at this moment. See: https://issues.apache.org/jira/browse/HADOOP-16723
-
- # YARN tests disabled because we can no longer download oracle jdk. See FLINK-18600
- #run_test "Running Kerberized YARN per-job on Docker test (default input)" "$END_TO_END_DIR/test-scripts/test_yarn_job_kerberos_docker.sh"
- #run_test "Running Kerberized YARN per-job on Docker test (custom fs plugin)" "$END_TO_END_DIR/test-scripts/test_yarn_job_kerberos_docker.sh dummy-fs"
- #run_test "Running Kerberized YARN application on Docker test (default input)" "$END_TO_END_DIR/test-scripts/test_yarn_application_kerberos_docker.sh"
- #run_test "Running Kerberized YARN application on Docker test (custom fs plugin)" "$END_TO_END_DIR/test-scripts/test_yarn_application_kerberos_docker.sh dummy-fs"
-
+ run_test "Running Kerberized YARN per-job on Docker test (default input)" "$END_TO_END_DIR/test-scripts/test_yarn_job_kerberos_docker.sh"
+ run_test "Running Kerberized YARN per-job on Docker test (custom fs plugin)" "$END_TO_END_DIR/test-scripts/test_yarn_job_kerberos_docker.sh dummy-fs"
+ run_test "Running Kerberized YARN application on Docker test (default input)" "$END_TO_END_DIR/test-scripts/test_yarn_application_kerberos_docker.sh"
+ run_test "Running Kerberized YARN application on Docker test (custom fs plugin)" "$END_TO_END_DIR/test-scripts/test_yarn_application_kerberos_docker.sh dummy-fs"
run_test "Run Mesos WordCount test" "$END_TO_END_DIR/test-scripts/test_mesos_wordcount.sh"
run_test "Run Mesos multiple submission test" "$END_TO_END_DIR/test-scripts/test_mesos_multiple_submissions.sh"
[flink] 01/02: [FLINK-18600] Upgrade kerberized yarn docker image
to use openjdk
Posted by dw...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
dwysakowicz pushed a commit to branch release-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit f56c2199774f3d60efabfa4257d8bff4b293cc8b
Author: Dawid Wysakowicz <dw...@apache.org>
AuthorDate: Thu Jul 16 13:57:09 2020 +0200
[FLINK-18600] Upgrade kerberized yarn docker image to use openjdk
---
.../test-scripts/docker-hadoop-secure-cluster/Dockerfile | 13 ++-----------
1 file changed, 2 insertions(+), 11 deletions(-)
diff --git a/flink-end-to-end-tests/test-scripts/docker-hadoop-secure-cluster/Dockerfile b/flink-end-to-end-tests/test-scripts/docker-hadoop-secure-cluster/Dockerfile
index b1902f6..ff9b640 100644
--- a/flink-end-to-end-tests/test-scripts/docker-hadoop-secure-cluster/Dockerfile
+++ b/flink-end-to-end-tests/test-scripts/docker-hadoop-secure-cluster/Dockerfile
@@ -24,7 +24,7 @@
#
# Creates multi-node, kerberized Hadoop cluster on Docker
-FROM sequenceiq/pam:ubuntu-14.04
+FROM openjdk:8
RUN set -x \
&& addgroup hadoop \
@@ -35,7 +35,7 @@ RUN set -x \
# install dev tools
RUN set -x \
- && apt-get update && apt-get install -y \
+ && apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y \
curl tar sudo openssh-server openssh-client rsync unzip krb5-user
# Kerberos client
@@ -51,15 +51,6 @@ RUN set -x \
&& ssh-keygen -q -N "" -t rsa -f /root/.ssh/id_rsa \
&& cp /root/.ssh/id_rsa.pub /root/.ssh/authorized_keys
-# java
-RUN set -x \
- && mkdir -p /usr/java/default \
- && curl -Ls 'https://download.oracle.com/otn-pub/java/jdk/8u251-b08/3d5a2bb8f8d4428bbe94aed7ec7ae784/jdk-8u251-linux-x64.tar.gz' -H 'Cookie: oraclelicense=accept-securebackup-cookie' | \
- tar --strip-components=1 -xz -C /usr/java/default/
-
-ENV JAVA_HOME /usr/java/default
-ENV PATH $PATH:$JAVA_HOME/bin
-
RUN sed -i 's/^#crypto.policy=unlimited/crypto.policy=unlimited/' $JAVA_HOME/jre/lib/security/java.security
ARG HADOOP_VERSION=2.8.4