You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "hoelog (JIRA)" <ji...@apache.org> on 2014/11/20 10:47:33 UTC
[jira] [Updated] (SPARK-4511) snappy-1.0.5.3 needs GLIBCXX_3.4.9
[ https://issues.apache.org/jira/browse/SPARK-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
hoelog updated SPARK-4511:
--------------------------
Description:
executors failed with *Could not initialize class org.xerial.snappy.Snappy* or *[FAILED_TO_LOAD_NATIVE_LIBRARY] null* errors.
I got a error message - * /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.9' not found* - when running the snappy's example code with spark's *lib_managed/bundles/snappy-java-1.0.5.3.jar*.
how to fix it? shoud I upgrade glibc?
{code:title=snappy test code}
String input = "Hello snappy-java! Snappy-java is a JNI-based wrapper of "
+ "Snappy, a fast compresser/decompresser.";
byte[] compressed = Snappy.compress(input.getBytes("UTF-8"));
byte[] uncompressed = Snappy.uncompress(compressed);
String result = new String(uncompressed, "UTF-8");
System.out.println(result);
{code}
{panel:title=glibcxx error msg}
Caused by: java.lang.UnsatisfiedLinkError: /tmp/snappy-1.0.5.3-94bdd15d-6841-4730-9815-4bdf7b745734-libsnappyjava.so: /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /tmp/snappy-1.0.5.3-94bdd15d-6841-4730-9815-4bdf7b745734-libsnappyjava.so)
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1851)
at java.lang.Runtime.load0(Runtime.java:795)
at java.lang.System.load(System.java:1062)
at org.xerial.snappy.SnappyNativeLoader.load(SnappyNativeLoader.java:39)
... 8 more
Exception in thread "main" org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:236)
at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
at Snap.main(Snap.java:8)
{panel}
{panel:title=fail msg}
org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:236)
org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351)
org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159)
org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142)
java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57)
{panel}
{panel:title=fail msg}
java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351)
org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159)
org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142)
java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57)
{panel}
was:
executors failed with *Could not initialize class org.xerial.snappy.Snappy* or *[FAILED_TO_LOAD_NATIVE_LIBRARY] null* errors.
I got a error message - * /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.9' not found* - when running the snappy's example code with spark's *lib_managed/bundles/snappy-java-1.0.5.3.jar*.
how to fix it? shoud I upgrade glibc?
{code:title=snappy test code}
String input = "Hello snappy-java! Snappy-java is a JNI-based wrapper of "
+ "Snappy, a fast compresser/decompresser.";
byte[] compressed = Snappy.compress(input.getBytes("UTF-8"));
byte[] uncompressed = Snappy.uncompress(compressed);
String result = new String(uncompressed, "UTF-8");
System.out.println(result);
{code}
{panel:title=fail msg}
org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:236)
org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351)
org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159)
org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142)
java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57)
{panel}
{panel:title=fail msg}
java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351)
org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159)
org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142)
java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57)
{panel}
> snappy-1.0.5.3 needs GLIBCXX_3.4.9
> ----------------------------------
>
> Key: SPARK-4511
> URL: https://issues.apache.org/jira/browse/SPARK-4511
> Project: Spark
> Issue Type: Question
> Affects Versions: 1.1.0
> Environment: Linux 2.6.18-371.12.1.el5 #1 SMP Wed Sep 3 16:22:34 EDT 2014 x86_64 x86_64 x86_64 GNU/Linux
> Reporter: hoelog
>
> executors failed with *Could not initialize class org.xerial.snappy.Snappy* or *[FAILED_TO_LOAD_NATIVE_LIBRARY] null* errors.
> I got a error message - * /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.9' not found* - when running the snappy's example code with spark's *lib_managed/bundles/snappy-java-1.0.5.3.jar*.
> how to fix it? shoud I upgrade glibc?
> {code:title=snappy test code}
> String input = "Hello snappy-java! Snappy-java is a JNI-based wrapper of "
> + "Snappy, a fast compresser/decompresser.";
> byte[] compressed = Snappy.compress(input.getBytes("UTF-8"));
> byte[] uncompressed = Snappy.uncompress(compressed);
> String result = new String(uncompressed, "UTF-8");
> System.out.println(result);
> {code}
> {panel:title=glibcxx error msg}
> Caused by: java.lang.UnsatisfiedLinkError: /tmp/snappy-1.0.5.3-94bdd15d-6841-4730-9815-4bdf7b745734-libsnappyjava.so: /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /tmp/snappy-1.0.5.3-94bdd15d-6841-4730-9815-4bdf7b745734-libsnappyjava.so)
> at java.lang.ClassLoader$NativeLibrary.load(Native Method)
> at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)
> at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)
> at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1851)
> at java.lang.Runtime.load0(Runtime.java:795)
> at java.lang.System.load(System.java:1062)
> at org.xerial.snappy.SnappyNativeLoader.load(SnappyNativeLoader.java:39)
> ... 8 more
> Exception in thread "main" org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
> at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:236)
> at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
> at Snap.main(Snap.java:8)
> {panel}
> {panel:title=fail msg}
> org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
> org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:236)
> org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
> org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351)
> org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159)
> org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142)
> java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
> java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
> java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
> java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
> java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
> org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57)
> {panel}
> {panel:title=fail msg}
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351)
> org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159)
> org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142)
> java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
> java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
> java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
> java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
> java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
> org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57)
> {panel}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org