You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "hoelog (JIRA)" <ji...@apache.org> on 2014/11/20 10:44:33 UTC
[jira] [Created] (SPARK-4511) snappy-1.0.5.3 needs GLIBCXX_3.4.9
hoelog created SPARK-4511:
-----------------------------
Summary: snappy-1.0.5.3 needs GLIBCXX_3.4.9
Key: SPARK-4511
URL: https://issues.apache.org/jira/browse/SPARK-4511
Project: Spark
Issue Type: Question
Affects Versions: 1.1.0
Environment: Linux 2.6.18-371.12.1.el5 #1 SMP Wed Sep 3 16:22:34 EDT 2014 x86_64 x86_64 x86_64 GNU/Linux
Reporter: hoelog
executors failed with *Could not initialize class org.xerial.snappy.Snappy* or *[FAILED_TO_LOAD_NATIVE_LIBRARY] null* errors.
I got a error message - * /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.9' not found* - when running the snappy's example code with spark's *lib_managed/bundles/snappy-java-1.0.5.3.jar*.
how to fix it? shoud I upgrade glibc?
{code:title=snappy test code}
String input = "Hello snappy-java! Snappy-java is a JNI-based wrapper of "
+ "Snappy, a fast compresser/decompresser.";
byte[] compressed = Snappy.compress(input.getBytes("UTF-8"));
byte[] uncompressed = Snappy.uncompress(compressed);
String result = new String(uncompressed, "UTF-8");
System.out.println(result);
{code}
{panel:title=fail msg}
org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:236)
org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351)
org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159)
org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142)
java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57)
{panel}
{panel:title=fail msg}
java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351)
org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159)
org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142)
java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57)
{panel}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org