You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Peter Velas (Updated) (JIRA)" <ji...@apache.org> on 2011/11/22 14:00:41 UTC
[jira] [Updated] (CASSANDRA-3521) sstableloader throwing exceptions
when loading snapshot data from compressed CFs
[ https://issues.apache.org/jira/browse/CASSANDRA-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peter Velas updated CASSANDRA-3521:
-----------------------------------
Description:
Loaded data from snapshot then enabled `sstable_compression: org.apache.cassandra.io.compress.SnappyCompressor`
Then flush, scrub and compact. I can see actual CompressionRatio in JMX Console and access my data without problems..
Now I snapshot compressed keyspace and when trying to load snapshot to another single node or different Keyspace (the same super CF structure with compression options enabled, even try to truncate snapshoted CFs.) I cant load any data.
sstableloader command with debug mode dont throw any errors and shows its streaming
{quote}
sstableloader-cassandra_2/bin/sstableloader --debug Impressions_compressed/
{quote}
Node logs contains repeating the errors bellow.
{quote}
ERROR [Thread-319] 2011-11-22 09:56:01,931 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Thread-319,5,main]
java.lang.AssertionError: attempted to delete non-existing file HidSaid-tmp-hb-260-Data.db
at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
at org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
INFO [Thread-320] 2011-11-22 09:56:02,492 StreamInSession.java (line 120) Streaming of file Impressions_compressed/HidSaid-hb-9-Data.db sections=1 progress=0/5616749 - 0% from org.apache.cassandra.streaming.StreamInSession@3cc62c07 failed: requesting a retry.
ERROR [Thread-320] 2011-11-22 09:56:02,493 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Thread-320,5,main]
java.lang.AssertionError: attempted to delete non-existing file HidSaid-tmp-hb-261-Data.db
at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
at org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
{quote}
Hope its enough if you need more info just tell me what you need to reproduce this bug.
was:
Loaded data from snapshot then enabled `sstable_compression: org.apache.cassandra.io.compress.SnappyCompressor`
Then flush, scrub and compact. I can see actual CompressionRatio in JMX Console and access my data without problems..
Now I snapshot compressed keyspace and when trying to load snapshot to another single node or different Keyspace (the same super CF structure with compression options enabled, even try to truncate snapshoted CFs.) I cant load any data.
sstableloader command with debug mode dont throw any errors and shows its streaming
{quote}
sstableloader-cassandra_2/bin/sstableloader --debug Keyspace_compressed/
{quote}
Node logs contains repeating the errors bellow.
{quote}
ERROR [Thread-319] 2011-11-22 09:56:01,931 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Thread-319,5,main]
java.lang.AssertionError: attempted to delete non-existing file HidSaid-tmp-hb-260-Data.db
at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
at org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
INFO [Thread-320] 2011-11-22 09:56:02,492 StreamInSession.java (line 120) Streaming of file Impressions_compressed/HidSaid-hb-9-Data.db sections=1 progress=0/5616749 - 0% from org.apache.cassandra.streaming.StreamInSession@3cc62c07 failed: requesting a retry.
ERROR [Thread-320] 2011-11-22 09:56:02,493 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Thread-320,5,main]
java.lang.AssertionError: attempted to delete non-existing file HidSaid-tmp-hb-261-Data.db
at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
at org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
{quote}
Hope its enough if you need more info just tell me what you need to reproduce this bug.
> sstableloader throwing exceptions when loading snapshot data from compressed CFs
> --------------------------------------------------------------------------------
>
> Key: CASSANDRA-3521
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3521
> Project: Cassandra
> Issue Type: Bug
> Environment: One node cluster (same problem with 4 nodes ) and dedicated machine for sstable loader.
> node and loader running jdk1.6.0_29 and cassandra-1.0.3
> Reporter: Peter Velas
>
> Loaded data from snapshot then enabled `sstable_compression: org.apache.cassandra.io.compress.SnappyCompressor`
> Then flush, scrub and compact. I can see actual CompressionRatio in JMX Console and access my data without problems..
> Now I snapshot compressed keyspace and when trying to load snapshot to another single node or different Keyspace (the same super CF structure with compression options enabled, even try to truncate snapshoted CFs.) I cant load any data.
> sstableloader command with debug mode dont throw any errors and shows its streaming
> {quote}
> sstableloader-cassandra_2/bin/sstableloader --debug Impressions_compressed/
> {quote}
> Node logs contains repeating the errors bellow.
> {quote}
> ERROR [Thread-319] 2011-11-22 09:56:01,931 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Thread-319,5,main]
> java.lang.AssertionError: attempted to delete non-existing file HidSaid-tmp-hb-260-Data.db
> at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
> at org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
> at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
> at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
> at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
> INFO [Thread-320] 2011-11-22 09:56:02,492 StreamInSession.java (line 120) Streaming of file Impressions_compressed/HidSaid-hb-9-Data.db sections=1 progress=0/5616749 - 0% from org.apache.cassandra.streaming.StreamInSession@3cc62c07 failed: requesting a retry.
> ERROR [Thread-320] 2011-11-22 09:56:02,493 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Thread-320,5,main]
> java.lang.AssertionError: attempted to delete non-existing file HidSaid-tmp-hb-261-Data.db
> at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
> at org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
> at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
> at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
> at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
> {quote}
> Hope its enough if you need more info just tell me what you need to reproduce this bug.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira