You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by srmore <co...@gmail.com> on 2013/11/11 22:32:07 UTC
java.io.FileNotFoundException when setting up internode_compression
I might be missing something obvious here, for some reason I cannot seem to
get internode_compression = all to work. I am getting the following
exception. I am using cassandra 1.2.9 and have snappy-java-1.0.5.jar in my
classpath. Google search did not return any useful result, has anyone seen
this before ?
java.io.FileNotFoundException: /usr/tmp/snappy-1.0.5-libsnappyjava.so (No
such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
at
org.xerial.snappy.SnappyLoader.extractLibraryFile(SnappyLoader.java:394)
at
org.xerial.snappy.SnappyLoader.findNativeLibrary(SnappyLoader.java:468)
at
org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:318)
at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:229)
at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
at
org.apache.cassandra.io.compress.SnappyCompressor.create(SnappyCompressor.java:45)
at
org.apache.cassandra.io.compress.SnappyCompressor.isAvailable(SnappyCompressor.java:55)
at
org.apache.cassandra.io.compress.SnappyCompressor.<clinit>(SnappyCompressor.java:37)
at
org.apache.cassandra.config.CFMetaData.<clinit>(CFMetaData.java:82)
at
org.apache.cassandra.config.KSMetaData.systemKeyspace(KSMetaData.java:81)
at
org.apache.cassandra.config.DatabaseDescriptor.loadYaml(DatabaseDescriptor.java:471)
at
org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:123)
Caused by: java.lang.UnsatisfiedLinkError: no snappyjava in
java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1738)
at java.lang.Runtime.loadLibrary0(Runtime.java:823)
at java.lang.System.loadLibrary(System.java:1028)
at
org.xerial.snappy.SnappyNativeLoader.loadLibrary(SnappyNativeLoader.java:52)
... 18 more
Re: java.io.FileNotFoundException when setting up internode_compression
Posted by Jan Schmidle <ja...@gmail.com>.
I had this error as well some time ago. It was due to the noexec mount flag of the tmp directory. Worked again when I removed that flag from the tmp directory.
Cheers
--
Jan Schmidle
Founder & CEO
P+49 89 999540-41
Mschmidle@cospired.com
cospired GmbH
Roßmarkt 6
D-80331 Munich
P+49 89 999540-40
F+49 89 999540-49
Mhello@cospired.com
T@cospired
Whttp://cospired.com
HRB 196843UID DE281743865
Am 14.11.2013 um 03:39 schrieb srmore:
> Yes it does, the stack trace is in the first thread. I did not try to create CF (was trying to enable it in cassandra.yaml), I have an existing CF and wanted to use compression for inter-node communication. When I enable snappy compression (in yaml) I get the error and cassandra quits. I figured this might be a snappy issue and nothing to do with cassandra, will log a bug there.
>
>
> On Wed, Nov 13, 2013 at 8:01 PM, Aaron Morton <aa...@thelastpickle.com> wrote:
> IIRC there is a test for snappy when the node starts does that log an error ?
>
> And / or can you create a CF that uses snappy compression (it was the default for a while in 1.2).
>
> Cheers
>
> -----------------
> Aaron Morton
> New Zealand
> @aaronmorton
>
> Co-Founder & Principal Consultant
> Apache Cassandra Consulting
> http://www.thelastpickle.com
>
> On 13/11/2013, at 3:09 am, srmore <co...@gmail.com> wrote:
>
>> Thanks Christopher !
>> I don't think glibc is an issue (as it did go that far) /usr/tmp/snappy-1.0.5-libsnappyjava.so is not there, permissions look ok, are there any special settings (like JVM args) that I should be using ? I can see libsnappyjava.so in the jar though (snappy-java-1.0.5.jar\org\xerial\snappy\native\Linux\i386\) one other thing I am using RedHat 6. I will try updating glibc ans see what happens.
>>
>> Thanks !
>>
>>
>>
>>
>> On Mon, Nov 11, 2013 at 5:01 PM, Christopher Wirt <ch...@struq.com> wrote:
>> I had this the other day when we were accidentally provisioned a centos5 machine (instead of 6). Think it relates to the version of glibc. Notice it wants the native binary .so not the .jar
>>
>>
>>
>> So maybe update to a newer version of glibc? Or possibly make sure the .so exists at /usr/tmp/snappy-1.0.5-libsnappyjava.so?
>>
>> I was lucky and just did an OS reload to centos6.
>>
>>
>>
>> Here is someone having a similar issue.
>>
>> http://mail-archives.apache.org/mod_mbox/cassandra-commits/201307.mbox/%3CJIRA.12616012.1352862646995.6820.1373083550278@arcas%3E
>>
>>
>>
>>
>>
>> From: srmore [mailto:comomore@gmail.com]
>> Sent: 11 November 2013 21:32
>> To: user@cassandra.apache.org
>> Subject: java.io.FileNotFoundException when setting up internode_compression
>>
>>
>>
>> I might be missing something obvious here, for some reason I cannot seem to get internode_compression = all to work. I am getting the following exception. I am using cassandra 1.2.9 and have snappy-java-1.0.5.jar in my classpath. Google search did not return any useful result, has anyone seen this before ?
>>
>>
>> java.io.FileNotFoundException: /usr/tmp/snappy-1.0.5-libsnappyjava.so (No such file or directory)
>> at java.io.FileOutputStream.open(Native Method)
>> at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
>> at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
>> at org.xerial.snappy.SnappyLoader.extractLibraryFile(SnappyLoader.java:394)
>> at org.xerial.snappy.SnappyLoader.findNativeLibrary(SnappyLoader.java:468)
>> at org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:318)
>> at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:229)
>> at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
>> at org.apache.cassandra.io.compress.SnappyCompressor.create(SnappyCompressor.java:45)
>> at org.apache.cassandra.io.compress.SnappyCompressor.isAvailable(SnappyCompressor.java:55)
>> at org.apache.cassandra.io.compress.SnappyCompressor.<clinit>(SnappyCompressor.java:37)
>> at org.apache.cassandra.config.CFMetaData.<clinit>(CFMetaData.java:82)
>> at org.apache.cassandra.config.KSMetaData.systemKeyspace(KSMetaData.java:81)
>> at org.apache.cassandra.config.DatabaseDescriptor.loadYaml(DatabaseDescriptor.java:471)
>> at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:123)
>>
>> Caused by: java.lang.UnsatisfiedLinkError: no snappyjava in java.library.path
>> at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1738)
>> at java.lang.Runtime.loadLibrary0(Runtime.java:823)
>> at java.lang.System.loadLibrary(System.java:1028)
>> at org.xerial.snappy.SnappyNativeLoader.loadLibrary(SnappyNativeLoader.java:52)
>> ... 18 more
>>
>>
>
>
Re: java.io.FileNotFoundException when setting up internode_compression
Posted by srmore <co...@gmail.com>.
Yes it does, the stack trace is in the first thread. I did not try to
create CF (was trying to enable it in cassandra.yaml), I have an existing
CF and wanted to use compression for inter-node communication. When I
enable snappy compression (in yaml) I get the error and cassandra quits. I
figured this might be a snappy issue and nothing to do with cassandra, will
log a bug there.
On Wed, Nov 13, 2013 at 8:01 PM, Aaron Morton <aa...@thelastpickle.com>wrote:
> IIRC there is a test for snappy when the node starts does that log an
> error ?
>
> And / or can you create a CF that uses snappy compression (it was the
> default for a while in 1.2).
>
> Cheers
>
> -----------------
> Aaron Morton
> New Zealand
> @aaronmorton
>
> Co-Founder & Principal Consultant
> Apache Cassandra Consulting
> http://www.thelastpickle.com
>
> On 13/11/2013, at 3:09 am, srmore <co...@gmail.com> wrote:
>
> Thanks Christopher !
> I don't think glibc is an issue (as it did go that far) /usr/tmp/
> snappy-1.0.5-libsnappyjava.so is not there, permissions look ok, are
> there any special settings (like JVM args) that I should be using ? I can
> see libsnappyjava.so in the jar though
> (snappy-java-1.0.5.jar\org\xerial\snappy\native\Linux\i386\) one other
> thing I am using RedHat 6. I will try updating glibc ans see what happens.
>
> Thanks !
>
>
>
>
> On Mon, Nov 11, 2013 at 5:01 PM, Christopher Wirt <ch...@struq.com>wrote:
>
>> I had this the other day when we were accidentally provisioned a centos5
>> machine (instead of 6). Think it relates to the version of glibc. Notice it
>> wants the native binary .so not the .jar
>>
>>
>>
>> So maybe update to a newer version of glibc? Or possibly make sure the
>> .so exists at /usr/tmp/snappy-1.0.5-libsnappyjava.so?
>>
>> I was lucky and just did an OS reload to centos6.
>>
>>
>>
>> Here is someone having a similar issue.
>>
>>
>> http://mail-archives.apache.org/mod_mbox/cassandra-commits/201307.mbox/%3CJIRA.12616012.1352862646995.6820.1373083550278@arcas%3E
>>
>>
>>
>>
>>
>> *From:* srmore [mailto:comomore@gmail.com]
>> *Sent:* 11 November 2013 21:32
>> *To:* user@cassandra.apache.org
>> *Subject:* java.io.FileNotFoundException when setting up
>> internode_compression
>>
>>
>>
>> I might be missing something obvious here, for some reason I cannot seem
>> to get internode_compression = all to work. I am getting the following
>> exception. I am using cassandra 1.2.9 and have snappy-java-1.0.5.jar in my
>> classpath. Google search did not return any useful result, has anyone seen
>> this before ?
>>
>>
>> java.io.FileNotFoundException: /usr/tmp/snappy-1.0.5-libsnappyjava.so(No such file or directory)
>> at java.io.FileOutputStream.open(Native Method)
>> at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
>> at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
>> at
>> org.xerial.snappy.SnappyLoader.extractLibraryFile(SnappyLoader.java:394)
>> at
>> org.xerial.snappy.SnappyLoader.findNativeLibrary(SnappyLoader.java:468)
>> at
>> org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:318)
>> at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:229)
>> at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
>> at
>> org.apache.cassandra.io.compress.SnappyCompressor.create(SnappyCompressor.java:45)
>> at
>> org.apache.cassandra.io.compress.SnappyCompressor.isAvailable(SnappyCompressor.java:55)
>> at
>> org.apache.cassandra.io.compress.SnappyCompressor.<clinit>(SnappyCompressor.java:37)
>> at
>> org.apache.cassandra.config.CFMetaData.<clinit>(CFMetaData.java:82)
>> at
>> org.apache.cassandra.config.KSMetaData.systemKeyspace(KSMetaData.java:81)
>> at
>> org.apache.cassandra.config.DatabaseDescriptor.loadYaml(DatabaseDescriptor.java:471)
>> at
>> org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:123)
>>
>> Caused by: java.lang.UnsatisfiedLinkError: no snappyjava in
>> java.library.path
>> at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1738)
>> at java.lang.Runtime.loadLibrary0(Runtime.java:823)
>> at java.lang.System.loadLibrary(System.java:1028)
>> at
>> org.xerial.snappy.SnappyNativeLoader.loadLibrary(SnappyNativeLoader.java:52)
>> ... 18 more
>>
>
>
>
Re: java.io.FileNotFoundException when setting up internode_compression
Posted by Aaron Morton <aa...@thelastpickle.com>.
IIRC there is a test for snappy when the node starts does that log an error ?
And / or can you create a CF that uses snappy compression (it was the default for a while in 1.2).
Cheers
-----------------
Aaron Morton
New Zealand
@aaronmorton
Co-Founder & Principal Consultant
Apache Cassandra Consulting
http://www.thelastpickle.com
On 13/11/2013, at 3:09 am, srmore <co...@gmail.com> wrote:
> Thanks Christopher !
> I don't think glibc is an issue (as it did go that far) /usr/tmp/snappy-1.0.5-libsnappyjava.so is not there, permissions look ok, are there any special settings (like JVM args) that I should be using ? I can see libsnappyjava.so in the jar though (snappy-java-1.0.5.jar\org\xerial\snappy\native\Linux\i386\) one other thing I am using RedHat 6. I will try updating glibc ans see what happens.
>
> Thanks !
>
>
>
>
> On Mon, Nov 11, 2013 at 5:01 PM, Christopher Wirt <ch...@struq.com> wrote:
> I had this the other day when we were accidentally provisioned a centos5 machine (instead of 6). Think it relates to the version of glibc. Notice it wants the native binary .so not the .jar
>
>
>
> So maybe update to a newer version of glibc? Or possibly make sure the .so exists at /usr/tmp/snappy-1.0.5-libsnappyjava.so?
>
> I was lucky and just did an OS reload to centos6.
>
>
>
> Here is someone having a similar issue.
>
> http://mail-archives.apache.org/mod_mbox/cassandra-commits/201307.mbox/%3CJIRA.12616012.1352862646995.6820.1373083550278@arcas%3E
>
>
>
>
>
> From: srmore [mailto:comomore@gmail.com]
> Sent: 11 November 2013 21:32
> To: user@cassandra.apache.org
> Subject: java.io.FileNotFoundException when setting up internode_compression
>
>
>
> I might be missing something obvious here, for some reason I cannot seem to get internode_compression = all to work. I am getting the following exception. I am using cassandra 1.2.9 and have snappy-java-1.0.5.jar in my classpath. Google search did not return any useful result, has anyone seen this before ?
>
>
> java.io.FileNotFoundException: /usr/tmp/snappy-1.0.5-libsnappyjava.so (No such file or directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
> at org.xerial.snappy.SnappyLoader.extractLibraryFile(SnappyLoader.java:394)
> at org.xerial.snappy.SnappyLoader.findNativeLibrary(SnappyLoader.java:468)
> at org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:318)
> at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:229)
> at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
> at org.apache.cassandra.io.compress.SnappyCompressor.create(SnappyCompressor.java:45)
> at org.apache.cassandra.io.compress.SnappyCompressor.isAvailable(SnappyCompressor.java:55)
> at org.apache.cassandra.io.compress.SnappyCompressor.<clinit>(SnappyCompressor.java:37)
> at org.apache.cassandra.config.CFMetaData.<clinit>(CFMetaData.java:82)
> at org.apache.cassandra.config.KSMetaData.systemKeyspace(KSMetaData.java:81)
> at org.apache.cassandra.config.DatabaseDescriptor.loadYaml(DatabaseDescriptor.java:471)
> at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:123)
>
> Caused by: java.lang.UnsatisfiedLinkError: no snappyjava in java.library.path
> at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1738)
> at java.lang.Runtime.loadLibrary0(Runtime.java:823)
> at java.lang.System.loadLibrary(System.java:1028)
> at org.xerial.snappy.SnappyNativeLoader.loadLibrary(SnappyNativeLoader.java:52)
> ... 18 more
>
>
Re: java.io.FileNotFoundException when setting up internode_compression
Posted by srmore <co...@gmail.com>.
Thanks Christopher !
I don't think glibc is an issue (as it did go that far) /usr/tmp/
snappy-1.0.5-libsnappyjava.so is not there, permissions look ok, are there
any special settings (like JVM args) that I should be using ? I can see
libsnappyjava.so in the jar though
(snappy-java-1.0.5.jar\org\xerial\snappy\native\Linux\i386\) one other
thing I am using RedHat 6. I will try updating glibc ans see what happens.
Thanks !
On Mon, Nov 11, 2013 at 5:01 PM, Christopher Wirt <ch...@struq.com>wrote:
> I had this the other day when we were accidentally provisioned a centos5
> machine (instead of 6). Think it relates to the version of glibc. Notice it
> wants the native binary .so not the .jar
>
>
>
> So maybe update to a newer version of glibc? Or possibly make sure the .so
> exists at /usr/tmp/snappy-1.0.5-libsnappyjava.so?
>
> I was lucky and just did an OS reload to centos6.
>
>
>
> Here is someone having a similar issue.
>
>
> http://mail-archives.apache.org/mod_mbox/cassandra-commits/201307.mbox/%3CJIRA.12616012.1352862646995.6820.1373083550278@arcas%3E
>
>
>
>
>
> *From:* srmore [mailto:comomore@gmail.com]
> *Sent:* 11 November 2013 21:32
> *To:* user@cassandra.apache.org
> *Subject:* java.io.FileNotFoundException when setting up
> internode_compression
>
>
>
> I might be missing something obvious here, for some reason I cannot seem
> to get internode_compression = all to work. I am getting the following
> exception. I am using cassandra 1.2.9 and have snappy-java-1.0.5.jar in my
> classpath. Google search did not return any useful result, has anyone seen
> this before ?
>
>
> java.io.FileNotFoundException: /usr/tmp/snappy-1.0.5-libsnappyjava.so (No
> such file or directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
> at
> org.xerial.snappy.SnappyLoader.extractLibraryFile(SnappyLoader.java:394)
> at
> org.xerial.snappy.SnappyLoader.findNativeLibrary(SnappyLoader.java:468)
> at
> org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:318)
> at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:229)
> at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
> at
> org.apache.cassandra.io.compress.SnappyCompressor.create(SnappyCompressor.java:45)
> at
> org.apache.cassandra.io.compress.SnappyCompressor.isAvailable(SnappyCompressor.java:55)
> at
> org.apache.cassandra.io.compress.SnappyCompressor.<clinit>(SnappyCompressor.java:37)
> at
> org.apache.cassandra.config.CFMetaData.<clinit>(CFMetaData.java:82)
> at
> org.apache.cassandra.config.KSMetaData.systemKeyspace(KSMetaData.java:81)
> at
> org.apache.cassandra.config.DatabaseDescriptor.loadYaml(DatabaseDescriptor.java:471)
> at
> org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:123)
>
> Caused by: java.lang.UnsatisfiedLinkError: no snappyjava in
> java.library.path
> at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1738)
> at java.lang.Runtime.loadLibrary0(Runtime.java:823)
> at java.lang.System.loadLibrary(System.java:1028)
> at
> org.xerial.snappy.SnappyNativeLoader.loadLibrary(SnappyNativeLoader.java:52)
> ... 18 more
>
RE: java.io.FileNotFoundException when setting up internode_compression
Posted by Christopher Wirt <ch...@struq.com>.
I had this the other day when we were accidentally provisioned a centos5
machine (instead of 6). Think it relates to the version of glibc. Notice it
wants the native binary .so not the .jar
So maybe update to a newer version of glibc? Or possibly make sure the .so
exists at /usr/tmp/snappy-1.0.5-libsnappyjava.so?
I was lucky and just did an OS reload to centos6.
Here is someone having a similar issue.
http://mail-archives.apache.org/mod_mbox/cassandra-commits/201307.mbox/%3CJI
RA.12616012.1352862646995.6820.1373083550278@arcas%3E
From: srmore [mailto:comomore@gmail.com]
Sent: 11 November 2013 21:32
To: user@cassandra.apache.org
Subject: java.io.FileNotFoundException when setting up internode_compression
I might be missing something obvious here, for some reason I cannot seem to
get internode_compression = all to work. I am getting the following
exception. I am using cassandra 1.2.9 and have snappy-java-1.0.5.jar in my
classpath. Google search did not return any useful result, has anyone seen
this before ?
java.io.FileNotFoundException: /usr/tmp/snappy-1.0.5-libsnappyjava.so (No
such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
at
org.xerial.snappy.SnappyLoader.extractLibraryFile(SnappyLoader.java:394)
at
org.xerial.snappy.SnappyLoader.findNativeLibrary(SnappyLoader.java:468)
at
org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:318)
at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:229)
at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
at
org.apache.cassandra.io.compress.SnappyCompressor.create(SnappyCompressor.ja
va:45)
at
org.apache.cassandra.io.compress.SnappyCompressor.isAvailable(SnappyCompress
or.java:55)
at
org.apache.cassandra.io.compress.SnappyCompressor.<clinit>(SnappyCompressor.
java:37)
at
org.apache.cassandra.config.CFMetaData.<clinit>(CFMetaData.java:82)
at
org.apache.cassandra.config.KSMetaData.systemKeyspace(KSMetaData.java:81)
at
org.apache.cassandra.config.DatabaseDescriptor.loadYaml(DatabaseDescriptor.j
ava:471)
at
org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.j
ava:123)
Caused by: java.lang.UnsatisfiedLinkError: no snappyjava in
java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1738)
at java.lang.Runtime.loadLibrary0(Runtime.java:823)
at java.lang.System.loadLibrary(System.java:1028)
at
org.xerial.snappy.SnappyNativeLoader.loadLibrary(SnappyNativeLoader.java:52)
... 18 more