[GitHub] [spark] plusplusjiajia opened a new pull request #25112: [SPARK-28347][K8S]Add gcompat to spark k8s Dockerfile.

[GitBox <gi...@apache.org>]

plusplusjiajia opened a new pull request #25112: [SPARK-28347][K8S]Add gcompat to spark k8s Dockerfile.
URL: https://github.com/apache/spark/pull/25112
 
 
   ## What changes were proposed in this pull request?
   
   I want to run TPC-DS in K8S, when generating data on HDFS, with following error: 
   `
   ERROR Utils: Aborting task
   java.lang.UnsatisfiedLinkError: /tmp/snappy-1.1.7-91d7ec9a-6e2d-47af-90ae-84c00d143b6d-libsnappyjava.so: Error loading shared library ld-linux-x86-64.so.2: No such file or directory
   `
   Looking into the executor pod, ld-linux-x86-64.so.2 is existed in /lib64 but not in /lib :
   `
   # ls -al /lib/ld*
   -rwxr-xr-x 1 root root 584304 Mar 19 09:56 /lib/ld-musl-x86_64.so.1
   
   # ls -al /lib64/ld* lrwxrwxrwx 1 root root 26 Jul 2 09:05 /lib64/ld-linux-x86-64.so.2 -> /lib/libc.musl-x86_64.so.1
   `
   After adding the gcompat in Dockerfile,  ld-linux-x86-64.so.2 exists in both lib and lib64 folders and no more error:
   `
   ls -al /lib/ld*
   -rwxr-xr-x 1 root root 18512 Dec 24 2018 /lib/ld-linux-x86-64.so.2 -rwxr-xr-x 1 root root 584304 Mar 19 09:56 /lib/ld-musl-x86_64.so.1
   
   ls -al /lib64/ld*
   lrwxrwxrwx 1 root root 26 Jul 11 02:06 /lib64/ld-linux-x86-64.so.2 -> /lib/libc.musl-x86_64.so.1 
   `
   ## How was this patch tested?
   
   manual test
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org