You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Nimi Wariboko Jr <ni...@channelmeter.com> on 2016/06/07 23:58:08 UTC
Cassandra 3.6: Compaction/Write Requests fail with
org.xerial.snappy.SnappyError: [NOT_A_DIRECT_BUFFER] destination is not a
direct buffer
Has anyone seen this issue since upgrading to 3.6? I don't have a good idea
what is going on yet, as my logs have just been spewing the following
error.
WARN [SharedPool-Worker-174] 2016-06-07 16:54:07,651
AbstractLocalAwareExecutorService.java:169 - Uncaught exception on thread
Thread[SharedPool-Worker-174,5,main]: {}
org.xerial.snappy.SnappyError: [NOT_A_DIRECT_BUFFER] destination is not a
direct buffer
at org.xerial.snappy.Snappy.uncompress(Snappy.java:509)
~[snappy-java-1.1.1.7.jar:na]
at
org.apache.cassandra.io.compress.SnappyCompressor.uncompress(SnappyCompressor.java:102)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.io.util.CompressedSegmentedFile$Mmap.readChunk(CompressedSegmentedFile.java:323)
~[apache-cassandra-3.6.jar:3.6]
at org.apache.cassandra.cache.ChunkCache.load(ChunkCache.java:137)
~[apache-cassandra-3.6.jar:3.6]
at org.apache.cassandra.cache.ChunkCache.load(ChunkCache.java:19)
~[apache-cassandra-3.6.jar:3.6]
at
com.github.benmanes.caffeine.cache.BoundedLocalCache$BoundedLocalLoadingCache.lambda$new$0(BoundedLocalCache.java:2949)
~[caffeine-2.2.6.jar:na]
at
com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$15(BoundedLocalCache.java:1807)
~[caffeine-2.2.6.jar:na]
at
java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1853)
~[na:1.8.0_72]
at
com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:1805)
~[caffeine-2.2.6.jar:na]
at
com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:1788)
~[caffeine-2.2.6.jar:na]
at
com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:97)
~[caffeine-2.2.6.jar:na]
at
com.github.benmanes.caffeine.cache.LocalLoadingCache.get(LocalLoadingCache.java:66)
~[caffeine-2.2.6.jar:na]
at
org.apache.cassandra.cache.ChunkCache$CachingRebufferer.rebuffer(ChunkCache.java:215)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.cache.ChunkCache$CachingRebufferer.rebuffer(ChunkCache.java:193)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.io.util.RandomAccessReader.reBufferAt(RandomAccessReader.java:78)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.io.util.RandomAccessReader.seek(RandomAccessReader.java:220)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.io.util.SegmentedFile.createReader(SegmentedFile.java:138)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.io.sstable.format.SSTableReader.getFileDataInput(SSTableReader.java:1779)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.db.columniterator.AbstractSSTableIterator.<init>(AbstractSSTableIterator.java:103)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.db.columniterator.SSTableIterator.<init>(SSTableIterator.java:44)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.io.sstable.format.big.BigTableReader.iterator(BigTableReader.java:72)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.io.sstable.format.big.BigTableReader.iterator(BigTableReader.java:65)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.db.rows.UnfilteredRowIteratorWithLowerBound.initializeIterator(UnfilteredRowIteratorWithLowerBound.java:85)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.db.rows.LazilyInitializedUnfilteredRowIterator.maybeInit(LazilyInitializedUnfilteredRowIterator.java:48)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.db.rows.LazilyInitializedUnfilteredRowIterator.partitionLevelDeletion(LazilyInitializedUnfilteredRowIterator.java:81)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.db.rows.UnfilteredRowIteratorWithLowerBound.partitionLevelDeletion(UnfilteredRowIteratorWithLowerBound.java:145)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.db.SinglePartitionReadCommand.queryMemtableAndDiskInternal(SinglePartitionReadCommand.java:556)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.db.SinglePartitionReadCommand.queryMemtableAndDisk(SinglePartitionReadCommand.java:463)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.db.SinglePartitionReadCommand.queryStorage(SinglePartitionReadCommand.java:325)
~[apache-cassandra-3.6.jar:3.6]
at org.apache.cassandra.db.ReadCommand.executeLocally(ReadCommand.java:366)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.db.ReadCommandVerbHandler.doVerb(ReadCommandVerbHandler.java:48)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:64)
~[apache-cassandra-3.6.jar:3.6]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[na:1.8.0_72]
at
org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164)
~[apache-cassandra-3.6.jar:3.6]
at
org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:136)
[apache-cassandra-3.6.jar:3.6]
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105)
[apache-cassandra-3.6.jar:3.6]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
Re: Cassandra 3.6: Compaction/Write Requests fail with
org.xerial.snappy.SnappyError: [NOT_A_DIRECT_BUFFER] destination is not a
direct buffer
Posted by Nimi Wariboko Jr <ni...@channelmeter.com>.
I also found CASSANDRA-9548, "Doing a bit more digging into this, the
SnappyCompressor does only support OFF_HEAP buffers.", however I already am
using offheap_buffers. I also got this error with offheap_objects.
On Tue, Jun 7, 2016 at 4:58 PM, Nimi Wariboko Jr <ni...@channelmeter.com>
wrote:
> Has anyone seen this issue since upgrading to 3.6? I don't have a good
> idea what is going on yet, as my logs have just been spewing the following
> error.
>
> WARN [SharedPool-Worker-174] 2016-06-07 16:54:07,651
> AbstractLocalAwareExecutorService.java:169 - Uncaught exception on thread
> Thread[SharedPool-Worker-174,5,main]: {}
> org.xerial.snappy.SnappyError: [NOT_A_DIRECT_BUFFER] destination is not a
> direct buffer
> at org.xerial.snappy.Snappy.uncompress(Snappy.java:509)
> ~[snappy-java-1.1.1.7.jar:na]
> at
> org.apache.cassandra.io.compress.SnappyCompressor.uncompress(SnappyCompressor.java:102)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.io.util.CompressedSegmentedFile$Mmap.readChunk(CompressedSegmentedFile.java:323)
> ~[apache-cassandra-3.6.jar:3.6]
> at org.apache.cassandra.cache.ChunkCache.load(ChunkCache.java:137)
> ~[apache-cassandra-3.6.jar:3.6]
> at org.apache.cassandra.cache.ChunkCache.load(ChunkCache.java:19)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> com.github.benmanes.caffeine.cache.BoundedLocalCache$BoundedLocalLoadingCache.lambda$new$0(BoundedLocalCache.java:2949)
> ~[caffeine-2.2.6.jar:na]
> at
> com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$15(BoundedLocalCache.java:1807)
> ~[caffeine-2.2.6.jar:na]
> at
> java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1853)
> ~[na:1.8.0_72]
> at
> com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:1805)
> ~[caffeine-2.2.6.jar:na]
> at
> com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:1788)
> ~[caffeine-2.2.6.jar:na]
> at
> com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:97)
> ~[caffeine-2.2.6.jar:na]
> at
> com.github.benmanes.caffeine.cache.LocalLoadingCache.get(LocalLoadingCache.java:66)
> ~[caffeine-2.2.6.jar:na]
> at
> org.apache.cassandra.cache.ChunkCache$CachingRebufferer.rebuffer(ChunkCache.java:215)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.cache.ChunkCache$CachingRebufferer.rebuffer(ChunkCache.java:193)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.io.util.RandomAccessReader.reBufferAt(RandomAccessReader.java:78)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.io.util.RandomAccessReader.seek(RandomAccessReader.java:220)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.io.util.SegmentedFile.createReader(SegmentedFile.java:138)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.io.sstable.format.SSTableReader.getFileDataInput(SSTableReader.java:1779)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.db.columniterator.AbstractSSTableIterator.<init>(AbstractSSTableIterator.java:103)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.db.columniterator.SSTableIterator.<init>(SSTableIterator.java:44)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.io.sstable.format.big.BigTableReader.iterator(BigTableReader.java:72)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.io.sstable.format.big.BigTableReader.iterator(BigTableReader.java:65)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.db.rows.UnfilteredRowIteratorWithLowerBound.initializeIterator(UnfilteredRowIteratorWithLowerBound.java:85)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.db.rows.LazilyInitializedUnfilteredRowIterator.maybeInit(LazilyInitializedUnfilteredRowIterator.java:48)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.db.rows.LazilyInitializedUnfilteredRowIterator.partitionLevelDeletion(LazilyInitializedUnfilteredRowIterator.java:81)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.db.rows.UnfilteredRowIteratorWithLowerBound.partitionLevelDeletion(UnfilteredRowIteratorWithLowerBound.java:145)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.db.SinglePartitionReadCommand.queryMemtableAndDiskInternal(SinglePartitionReadCommand.java:556)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.db.SinglePartitionReadCommand.queryMemtableAndDisk(SinglePartitionReadCommand.java:463)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.db.SinglePartitionReadCommand.queryStorage(SinglePartitionReadCommand.java:325)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.db.ReadCommand.executeLocally(ReadCommand.java:366)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.db.ReadCommandVerbHandler.doVerb(ReadCommandVerbHandler.java:48)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:64)
> ~[apache-cassandra-3.6.jar:3.6]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> ~[na:1.8.0_72]
> at
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164)
> ~[apache-cassandra-3.6.jar:3.6]
> at
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:136)
> [apache-cassandra-3.6.jar:3.6]
> at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105)
> [apache-cassandra-3.6.jar:3.6]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
>
>