You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by va...@apache.org on 2019/03/18 23:52:25 UTC

[spark] branch branch-2.4 updated: [SPARK-27178][K8S][BRANCH-2.4] adding nss package to fix tests

This is an automated email from the ASF dual-hosted git repository.

vanzin pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-2.4 by this push:
     new 342e91f  [SPARK-27178][K8S][BRANCH-2.4] adding nss package to fix tests
342e91f is described below

commit 342e91fdfa4e6ce5cc3a0da085d1fe723184021b
Author: shane knapp <in...@gmail.com>
AuthorDate: Mon Mar 18 16:51:57 2019 -0700

    [SPARK-27178][K8S][BRANCH-2.4] adding nss package to fix tests
    
    ## What changes were proposed in this pull request?
    
    see also:  https://github.com/apache/spark/pull/24111
    
    while performing some tests on our existing minikube and k8s infrastructure, i noticed that the integration tests were failing. i dug in and discovered the following message buried at the end of the stacktrace:
    
    ```
      Caused by: java.io.FileNotFoundException: /usr/lib/libnss3.so
      	at sun.security.pkcs11.Secmod.initialize(Secmod.java:193)
      	at sun.security.pkcs11.SunPKCS11.<init>(SunPKCS11.java:218)
      	... 81 more
    ```
    after i added the `nss` package to `resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile`, everything worked.
    
    this is also impacting current builds.  see:  https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/8959/console
    
    ## How was this patch tested?
    
    i tested locally before pushing, and the build system will test the rest.
    
    Closes #24137 from shaneknapp/add-nss-package.
    
    Authored-by: shane knapp <in...@gmail.com>
    Signed-off-by: Marcelo Vanzin <va...@cloudera.com>
---
 .../kubernetes/docker/src/main/dockerfiles/spark/Dockerfile             | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile b/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile
index 1c4dcd5..196b74f 100644
--- a/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile
+++ b/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile
@@ -30,7 +30,7 @@ ARG k8s_tests=kubernetes/tests
 
 RUN set -ex && \
     apk upgrade --no-cache && \
-    apk add --no-cache bash tini libc6-compat linux-pam && \
+    apk add --no-cache bash tini libc6-compat linux-pam nss && \
     mkdir -p /opt/spark && \
     mkdir -p /opt/spark/work-dir && \
     touch /opt/spark/RELEASE && \


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org