You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Vitalii Tymchyshyn (Created) (JIRA)" <ji...@apache.org> on 2011/12/05 16:20:40 UTC
[jira] [Created] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
When Snappy compression is not available on the platform, trying to enable it introduces problems
-------------------------------------------------------------------------------------------------
Key: CASSANDRA-3573
URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
Project: Cassandra
Issue Type: Bug
Components: Core
Affects Versions: 1.0.5
Environment: FreeBSD
Reporter: Vitalii Tymchyshyn
I've tried to enable compression for some column families in my cluster using Snappy compression.
It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
In log I have the next:
ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
shWriter:961,5,main]
java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
1) A check be done on schema update if Snappy can be used
2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
Posted by "Pavel Yaskevich (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Pavel Yaskevich updated CASSANDRA-3573:
---------------------------------------
Attachment: CASSANDRA-3573.patch
> When Snappy compression is not available on the platform, trying to enable it introduces problems
> -------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3573
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.0
> Environment: FreeBSD
> Reporter: Vitalii Tymchyshyn
> Assignee: Pavel Yaskevich
> Priority: Minor
> Fix For: 1.0.6
>
> Attachments: CASSANDRA-3573.patch
>
>
> I've tried to enable compression for some column families in my cluster using Snappy compression.
> It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
> In log I have the next:
> ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
> shWriter:961,5,main]
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
> at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
> at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
> at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
> at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
> at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
> 1) A check be done on schema update if Snappy can be used
> 2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
Posted by "Vitalii Tymchyshyn (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162864#comment-13162864 ]
Vitalii Tymchyshyn commented on CASSANDRA-3573:
-----------------------------------------------
In case when someone get int othis trap, I could replace Snappy compression class with NOOP one and restart:
public class SnappyCompressor implements ICompressor
{
public static final SnappyCompressor instance = new SnappyCompressor();
public static SnappyCompressor create(Map<String, String> compressionOptions)
{
// no specific options supported so far
return instance;
}
public int initialCompressedBufferLength(int chunkLength)
{
return chunkLength;
}
public int compress(byte[] input, int inputOffset, int inputLength, ICompressor.WrappedArray output, int outputOffset) throws IOException
{
System.arraycopy(input, inputOffset, output.buffer, outputOffset, inputLength);
return inputLength;
}
public int uncompress(byte[] input, int inputOffset, int inputLength, byte[] output, int outputOffset) throws IOException
{
System.arraycopy(input, inputOffset, output, outputOffset, inputLength);
return inputLength;
}
}
> When Snappy compression is not available on the platform, trying to enable it introduces problems
> -------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3573
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.5
> Environment: FreeBSD
> Reporter: Vitalii Tymchyshyn
>
> I've tried to enable compression for some column families in my cluster using Snappy compression.
> It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
> In log I have the next:
> ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
> shWriter:961,5,main]
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
> at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
> at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
> at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
> at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
> at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
> 1) A check be done on schema update if Snappy can be used
> 2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
Posted by "T Jake Luciani (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162831#comment-13162831 ]
T Jake Luciani commented on CASSANDRA-3573:
-------------------------------------------
If you build snappy-java directly on those machines you can tell snappy to use that library with the following:
cassandra -Djava.library.path=(path to the installed snappyjava lib) -Dorg.xerial.snappy.use.systemlib=true
> When Snappy compression is not available on the platform, trying to enable it introduces problems
> -------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3573
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.5
> Environment: FreeBSD
> Reporter: Vitalii Tymchyshyn
>
> I've tried to enable compression for some column families in my cluster using Snappy compression.
> It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
> In log I have the next:
> ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
> shWriter:961,5,main]
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
> at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
> at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
> at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
> at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
> at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
> 1) A check be done on schema update if Snappy can be used
> 2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
Posted by "Brandon Williams (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162996#comment-13162996 ]
Brandon Williams commented on CASSANDRA-3573:
---------------------------------------------
bq. We probably need to bump the thrift rev too
Nevermind.
> When Snappy compression is not available on the platform, trying to enable it introduces problems
> -------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3573
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.0
> Environment: FreeBSD
> Reporter: Vitalii Tymchyshyn
> Assignee: Pavel Yaskevich
> Priority: Minor
> Fix For: 1.0.6
>
> Attachments: CASSANDRA-3573.patch
>
>
> I've tried to enable compression for some column families in my cluster using Snappy compression.
> It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
> In log I have the next:
> ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
> shWriter:961,5,main]
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
> at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
> at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
> at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
> at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
> at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
> 1) A check be done on schema update if Snappy can be used
> 2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
Posted by "Pavel Yaskevich (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Pavel Yaskevich updated CASSANDRA-3573:
---------------------------------------
Attachment: CASSANDRA-3573.patch
> When Snappy compression is not available on the platform, trying to enable it introduces problems
> -------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3573
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.0
> Environment: FreeBSD
> Reporter: Vitalii Tymchyshyn
> Assignee: Pavel Yaskevich
> Priority: Minor
> Fix For: 1.0.6
>
> Attachments: CASSANDRA-3573.patch
>
>
> I've tried to enable compression for some column families in my cluster using Snappy compression.
> It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
> In log I have the next:
> ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
> shWriter:961,5,main]
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
> at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
> at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
> at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
> at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
> at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
> 1) A check be done on schema update if Snappy can be used
> 2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
Posted by "Brandon Williams (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162993#comment-13162993 ]
Brandon Williams commented on CASSANDRA-3573:
---------------------------------------------
We probably need to bump the thrift rev too, but +1 otherwise.
> When Snappy compression is not available on the platform, trying to enable it introduces problems
> -------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3573
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.0
> Environment: FreeBSD
> Reporter: Vitalii Tymchyshyn
> Assignee: Pavel Yaskevich
> Priority: Minor
> Fix For: 1.0.6
>
> Attachments: CASSANDRA-3573.patch
>
>
> I've tried to enable compression for some column families in my cluster using Snappy compression.
> It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
> In log I have the next:
> ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
> shWriter:961,5,main]
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
> at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
> at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
> at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
> at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
> at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
> 1) A check be done on schema update if Snappy can be used
> 2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
Posted by "Vitalii Tymchyshyn (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162920#comment-13162920 ]
Vitalii Tymchyshyn commented on CASSANDRA-3573:
-----------------------------------------------
I'm afraid the patch won't help because Snappy compressor don't initialize snappy on init. This must be changed too.
> When Snappy compression is not available on the platform, trying to enable it introduces problems
> -------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3573
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.0
> Environment: FreeBSD
> Reporter: Vitalii Tymchyshyn
> Assignee: Pavel Yaskevich
> Priority: Minor
> Fix For: 1.0.6
>
> Attachments: CASSANDRA-3573.patch
>
>
> I've tried to enable compression for some column families in my cluster using Snappy compression.
> It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
> In log I have the next:
> ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
> shWriter:961,5,main]
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
> at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
> at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
> at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
> at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
> at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
> 1) A check be done on schema update if Snappy can be used
> 2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
Posted by "Jonathan Ellis (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-3573:
--------------------------------------
Reviewer: jbellis
Priority: Minor (was: Major)
Affects Version/s: (was: 1.0.5)
1.0.0
Fix Version/s: 1.0.6
Assignee: Pavel Yaskevich
Sounds like we should try to instantiate the compressor during validateCfDef to make sure it's not going to cause problems later.
> When Snappy compression is not available on the platform, trying to enable it introduces problems
> -------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3573
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.0
> Environment: FreeBSD
> Reporter: Vitalii Tymchyshyn
> Assignee: Pavel Yaskevich
> Priority: Minor
> Fix For: 1.0.6
>
>
> I've tried to enable compression for some column families in my cluster using Snappy compression.
> It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
> In log I have the next:
> ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
> shWriter:961,5,main]
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
> at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
> at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
> at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
> at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
> at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
> 1) A check be done on schema update if Snappy can be used
> 2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
Posted by "Pavel Yaskevich (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Pavel Yaskevich updated CASSANDRA-3573:
---------------------------------------
Attachment: (was: CASSANDRA-3573.patch)
> When Snappy compression is not available on the platform, trying to enable it introduces problems
> -------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3573
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.0
> Environment: FreeBSD
> Reporter: Vitalii Tymchyshyn
> Assignee: Pavel Yaskevich
> Priority: Minor
> Fix For: 1.0.6
>
> Attachments: CASSANDRA-3573.patch
>
>
> I've tried to enable compression for some column families in my cluster using Snappy compression.
> It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
> In log I have the next:
> ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
> shWriter:961,5,main]
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
> at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
> at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
> at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
> at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
> at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
> 1) A check be done on schema update if Snappy can be used
> 2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
Posted by "Pavel Yaskevich (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162923#comment-13162923 ]
Pavel Yaskevich commented on CASSANDRA-3573:
--------------------------------------------
you are right, I will add validation to SnappyCompressor create method to ensure that Snappy lib is in place.
> When Snappy compression is not available on the platform, trying to enable it introduces problems
> -------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3573
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.0
> Environment: FreeBSD
> Reporter: Vitalii Tymchyshyn
> Assignee: Pavel Yaskevich
> Priority: Minor
> Fix For: 1.0.6
>
> Attachments: CASSANDRA-3573.patch
>
>
> I've tried to enable compression for some column families in my cluster using Snappy compression.
> It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
> In log I have the next:
> ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
> shWriter:961,5,main]
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
> at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
> at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
> at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
> at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
> at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
> 1) A check be done on schema update if Snappy can be used
> 2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3573) When Snappy compression is not
available on the platform, trying to enable it introduces problems
Posted by "Pavel Yaskevich (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Pavel Yaskevich updated CASSANDRA-3573:
---------------------------------------
Reviewer: brandon.williams (was: jbellis)
> When Snappy compression is not available on the platform, trying to enable it introduces problems
> -------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3573
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3573
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.0
> Environment: FreeBSD
> Reporter: Vitalii Tymchyshyn
> Assignee: Pavel Yaskevich
> Priority: Minor
> Fix For: 1.0.6
>
> Attachments: CASSANDRA-3573.patch
>
>
> I've tried to enable compression for some column families in my cluster using Snappy compression.
> It does not work and I am having problems with schema updates to remove it (a lot of UNREACHABLE nodes during scema update).
> In log I have the next:
> ERROR [FlushWriter:961] 2011-12-05 17:16:33,383 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Flu
> shWriter:961,5,main]
> java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
> at org.apache.cassandra.io.compress.SnappyCompressor.initialCompressedBufferLength(SnappyCompressor.java:39)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.<init>(CompressedSequentialWriter.java:63)
> at org.apache.cassandra.io.compress.CompressedSequentialWriter.open(CompressedSequentialWriter.java:34)
> at org.apache.cassandra.io.sstable.SSTableWriter.<init>(SSTableWriter.java:91)
> at org.apache.cassandra.db.ColumnFamilyStore.createFlushWriter(ColumnFamilyStore.java:1850)
> at org.apache.cassandra.db.Memtable.writeSortedContents(Memtable.java:250)
> at org.apache.cassandra.db.Memtable.access$400(Memtable.java:47)
> at org.apache.cassandra.db.Memtable$4.runMayThrow(Memtable.java:291)
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> It looks like Snappy can't initialize because it does not have native library for my platform. It would be great if:
> 1) A check be done on schema update if Snappy can be used
> 2) If it is enabled and can't be used it would still work without compression writes (but may be outputting some errors to indicate the situation)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira