You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "hoelog (JIRA)" <ji...@apache.org> on 2014/11/20 14:45:33 UTC
[jira] [Commented] (SPARK-4511) snappy-1.0.5.3 needs GLIBCXX_3.4.9
[ https://issues.apache.org/jira/browse/SPARK-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219378#comment-14219378 ]
hoelog commented on SPARK-4511:
-------------------------------
similar problem. the prebuild sparks have the snappy 1.0.5 which needs GLIBCXX_3.4.9.
https://issues.apache.org/jira/browse/SPARK-4354
the servers which have lower GLIBCXX can't run the spark's executors.
> snappy-1.0.5.3 needs GLIBCXX_3.4.9
> ----------------------------------
>
> Key: SPARK-4511
> URL: https://issues.apache.org/jira/browse/SPARK-4511
> Project: Spark
> Issue Type: Question
> Affects Versions: 1.1.0
> Environment: Linux 2.6.18-371.12.1.el5 #1 SMP Wed Sep 3 16:22:34 EDT 2014 x86_64 x86_64 x86_64 GNU/Linux
> Reporter: hoelog
>
> executors failed with *Could not initialize class org.xerial.snappy.Snappy* or *[FAILED_TO_LOAD_NATIVE_LIBRARY] null* errors.
> I got a error message * /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.9' not found* when running the snappy's example code with spark's *lib_managed/bundles/snappy-java-1.0.5.3.jar*.
> how to fix it? shoud I upgrade glibc?
> {code:title=snappy test code}
> String input = "Hello snappy-java! Snappy-java is a JNI-based wrapper of "
> + "Snappy, a fast compresser/decompresser.";
> byte[] compressed = Snappy.compress(input.getBytes("UTF-8"));
> byte[] uncompressed = Snappy.uncompress(compressed);
> String result = new String(uncompressed, "UTF-8");
> System.out.println(result);
> {code}
> {panel:title=glibcxx error msg}
> Caused by: java.lang.UnsatisfiedLinkError: /tmp/snappy-1.0.5.3-94bdd15d-6841-4730-9815-4bdf7b745734-libsnappyjava.so: /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /tmp/snappy-1.0.5.3-94bdd15d-6841-4730-9815-4bdf7b745734-libsnappyjava.so)
> at java.lang.ClassLoader$NativeLibrary.load(Native Method)
> at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)
> at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)
> at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1851)
> at java.lang.Runtime.load0(Runtime.java:795)
> at java.lang.System.load(System.java:1062)
> at org.xerial.snappy.SnappyNativeLoader.load(SnappyNativeLoader.java:39)
> ... 8 more
> Exception in thread "main" org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
> at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:236)
> at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
> at Snap.main(Snap.java:8)
> {panel}
> {panel:title=fail msg}
> org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
> org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:236)
> org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
> org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351)
> org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159)
> org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142)
> java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
> java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
> java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
> java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
> java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
> org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57)
> {panel}
> {panel:title=fail msg}
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351)
> org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159)
> org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142)
> java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
> java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
> java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
> java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
> java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
> org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57)
> {panel}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org