You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by pradeepbill <pr...@gmail.com> on 2016/05/11 18:38:42 UTC

snappy compression issue

Hi there, I get snappy java.lang.UnsatisfiedLinkError:  like below, I have
the libsnappy.so in both 
 
export LD_LIBRARY_PATH=/usr/lib/jvm/java-1.7.0-openjdk.x86_64/jre/lib/  and 
-Djava.library.path=/usr/lib/jvm/java-1.7.0-openjdk.x86_64/jre/lib/libsnappy.so
, but still nifi cant find the libsnappy.so file, any thing I am missing
about nar files ?, because the error comes from the jar file inside the nar
file,
/opt/nifi-0.6.0-node2/work/nar/extensions/nifi-hbase_1_1_2-client-service-nar-0.6.0.nar-unpacked/META-INF/bundled-dependencies/hadoop-common-2.6.2.jar.I
guess.

and yes, I have seen the thread below

http://apache-nifi-developer-list.39713.n7.nabble.com/java-lang-UnsatisfiedLinkError-in-PutHDFS-with-snappy-compression-td7182.html

Please see error below

2016-05-11 15:02:01,008 ERROR [Timer-Driven Process Thread-147]
o.apache.nifi.processors.hadoop.PutHDFS
PutHDFS[id=db4b7b92-05e9-4714-81a5-e335d3ad5917] Failed to write to HDFS due
to java.lang.UnsatisfiedLinkError:
org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z:
java.lang.UnsatisfiedLinkError:
org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
2016-05-11 15:02:01,010 ERROR [Timer-Driven Process Thread-147]
o.apache.nifi.processors.hadoop.PutHDFS
java.lang.UnsatisfiedLinkError:
org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
        at
org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy(Native Method)
~[hadoop-common-2.6.2.jar:na]
        at
org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:63)
~[hadoop-common-2.6.2.jar:na]
        at
org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:133)
~[hadoop-common-2.6.2.jar:na]
        at
org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:148)
~[hadoop-common-2.6.2.jar:na]


Thanks in advance.
Pradeep



--
View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/snappy-compression-issue-tp10166.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.