Failed to Load Native Library Snappy - org.xerial.snappy.SnappyError

[Vineet Mishra <cl...@gmail.com>]

Hi Al,

I have recently got stuck into a issue, I was trying to run a Storm
Topology with Kafka-Storm as Spout, recently I moved the Storm Cluster on
different machines(earlier 3 nodes were sharing both the Kafka and Storm).

While I am running the topology again I am ending up in error saying,

org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null at
org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:229) at
org.xerial.snappy.Snappy.<clinit>(Snappy.java:44) at
org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:350)
at org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:158)
at org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142) at
java.io.InputStream.read(InputStream.java:101) at
kafka.message.ByteBufferMessageSet$$anonfun$decompress$1.apply$mcI$sp(ByteBufferMessageSet.scala:68)
at
kafka.message.ByteBufferMessageSet$$anonfun$decompress$1.apply(ByteBufferMessageSet.scala:68)
at
kafka.message.ByteBufferMessageSet$$anonfun$decompress$1.apply(ByteBufferMessageSet.scala:68)
at scala.collection.immutable.Stream$.continually(Stream.scala:1104) at
kafka.message.ByteBufferMessageSet$.decompress(ByteBufferMessageSet.scala:68)
at
kafka.message.ByteBufferMessageSet$$anon$1.makeNextOuter(ByteBufferMessageSet.scala:178)
at
kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:191)
at
kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:145)
at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) at
kafka.javaapi.message.ByteBufferMessageSet$$anon$1.hasNext(ByteBufferMessageSet.scala:42)
at storm.kafka.PartitionManager.fill(PartitionManager.java:177) at
storm.kafka.PartitionManager.next(PartitionManager.java:124) at
storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:141) at
backtype.storm.daemon.executor$fn__3373$fn__3388$fn__3417.invoke(executor.clj:565)
at backtype.storm.util$async_loop$fn__464.invoke(util.clj:463) at
clojure.lang.AFn.run(AFn.java:24) at java.lang.Thread.run(Thread.java:745)

Even though I could validate the Snappy library to be present in my Storm
Topology Jar and I even tried keeping the Snappy Jar in Storm lib folder
but still no luck.

Looking out for a quick solution.

Thanks!

Re: Failed to Load Native Library Snappy - org.xerial.snappy.SnappyError

[Vineet Mishra <cl...@gmail.com>]

Thanks All.

By the way, it's resolved now!
The issue was to make the /tmp mounting with exec enabled. It worked for me.

For reference to the same, please refer the link.
http://neelimabawa.blogspot.in/2012/07/em12c-how-to-fix-javalangunsatisfiedlin.html

Cheers!

On Fri, Feb 6, 2015 at 2:02 PM, Vineet Mishra <cl...@gmail.com>
wrote:

> Hi Al,
>
> I have recently got stuck into a issue, I was trying to run a Storm
> Topology with Kafka-Storm as Spout, recently I moved the Storm Cluster on
> different machines(earlier 3 nodes were sharing both the Kafka and Storm).
>
> While I am running the topology again I am ending up in error saying,
>
> org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null at
> org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:229) at
> org.xerial.snappy.Snappy.<clinit>(Snappy.java:44) at
> org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:350)
> at org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:158)
> at org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142) at
> java.io.InputStream.read(InputStream.java:101) at
> kafka.message.ByteBufferMessageSet$$anonfun$decompress$1.apply$mcI$sp(ByteBufferMessageSet.scala:68)
> at
> kafka.message.ByteBufferMessageSet$$anonfun$decompress$1.apply(ByteBufferMessageSet.scala:68)
> at
> kafka.message.ByteBufferMessageSet$$anonfun$decompress$1.apply(ByteBufferMessageSet.scala:68)
> at scala.collection.immutable.Stream$.continually(Stream.scala:1104) at
> kafka.message.ByteBufferMessageSet$.decompress(ByteBufferMessageSet.scala:68)
> at
> kafka.message.ByteBufferMessageSet$$anon$1.makeNextOuter(ByteBufferMessageSet.scala:178)
> at
> kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:191)
> at
> kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:145)
> at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
> at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) at
> kafka.javaapi.message.ByteBufferMessageSet$$anon$1.hasNext(ByteBufferMessageSet.scala:42)
> at storm.kafka.PartitionManager.fill(PartitionManager.java:177) at
> storm.kafka.PartitionManager.next(PartitionManager.java:124) at
> storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:141) at
> backtype.storm.daemon.executor$fn__3373$fn__3388$fn__3417.invoke(executor.clj:565)
> at backtype.storm.util$async_loop$fn__464.invoke(util.clj:463) at
> clojure.lang.AFn.run(AFn.java:24) at java.lang.Thread.run(Thread.java:745)
>
> Even though I could validate the Snappy library to be present in my Storm
> Topology Jar and I even tried keeping the Snappy Jar in Storm lib folder
> but still no luck.
>
> Looking out for a quick solution.
>
> Thanks!
>