You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Dinesh Joshi (JIRA)" <ji...@apache.org> on 2018/12/12 22:03:00 UTC

[jira] [Assigned] (CASSANDRA-14895) SSTable loader exception when loading 3.0/3.11 compact tables into 4.0

     [ https://issues.apache.org/jira/browse/CASSANDRA-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dinesh Joshi reassigned CASSANDRA-14895:
----------------------------------------

    Assignee: Dinesh Joshi  (was: Ariel Weisberg)

> SSTable loader exception when loading 3.0/3.11 compact tables into 4.0
> ----------------------------------------------------------------------
>
>                 Key: CASSANDRA-14895
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-14895
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tools
>            Reporter: Ariel Weisberg
>            Assignee: Dinesh Joshi
>            Priority: Blocker
>              Labels: 4.0-pre-rc-bugs
>             Fix For: 3.0.x, 3.11.x, 4.0.x
>
>
> While working on the upgrade tests I added 3.0/3.11 to current tests for loading old version sstables using sstable loader. [The tests for loading compact sstables fail.|addedhttps://github.com/apache/cassandra-dtest/blob/master/upgrade_tests/storage_engine_upgrade_test.py#L466]
> It doesn't help to alter the table to drop compact storage and then run rebuild and cleanup before attempting to load into current.
> Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
> java.lang.RuntimeException: Unknown column value during deserialization
> java.lang.RuntimeException: Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
> 	at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:77)
> 	at org.apache.cassandra.db.lifecycle.LifecycleTransaction.getFiles(LifecycleTransaction.java:561)
> 	at org.apache.cassandra.io.sstable.SSTableLoader.openSSTables(SSTableLoader.java:76)
> 	at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:166)
> 	at org.apache.cassandra.tools.BulkLoader.load(BulkLoader.java:83)
> 	at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:49)
> Caused by: java.lang.RuntimeException: Unknown column value during deserialization
> 	at org.apache.cassandra.db.SerializationHeader$Component.toHeader(SerializationHeader.java:317)
> 	at org.apache.cassandra.io.sstable.format.SSTableReader.openForBatch(SSTableReader.java:440)
> 	at org.apache.cassandra.io.sstable.SSTableLoader.lambda$openSSTables$0(SSTableLoader.java:121)
> 	at org.apache.cassandra.db.lifecycle.LogAwareFileLister.lambda$innerList$2(LogAwareFileLister.java:99)
> 	at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)
> 	at java.util.TreeMap$EntrySpliterator.forEachRemaining(TreeMap.java:2969)
> 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
> 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
> 	at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
> 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> 	at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
> 	at org.apache.cassandra.db.lifecycle.LogAwareFileLister.innerList(LogAwareFileLister.java:101)
> 	at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:73)
> 	... 5 more
> Exception in thread "main" org.apache.cassandra.tools.BulkLoadException: java.lang.RuntimeException: Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
> 	at org.apache.cassandra.tools.BulkLoader.load(BulkLoader.java:96)
> 	at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:49)
> Caused by: java.lang.RuntimeException: Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
> 	at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:77)
> 	at org.apache.cassandra.db.lifecycle.LifecycleTransaction.getFiles(LifecycleTransaction.java:561)
> 	at org.apache.cassandra.io.sstable.SSTableLoader.openSSTables(SSTableLoader.java:76)
> 	at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:166)
> 	at org.apache.cassandra.tools.BulkLoader.load(BulkLoader.java:83)
> 	... 1 more
> Caused by: java.lang.RuntimeException: Unknown column value during deserialization
> 	at org.apache.cassandra.db.SerializationHeader$Component.toHeader(SerializationHeader.java:317)
> 	at org.apache.cassandra.io.sstable.format.SSTableReader.openForBatch(SSTableReader.java:440)
> 	at org.apache.cassandra.io.sstable.SSTableLoader.lambda$openSSTables$0(SSTableLoader.java:121)
> 	at org.apache.cassandra.db.lifecycle.LogAwareFileLister.lambda$innerList$2(LogAwareFileLister.java:99)
> 	at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)
> 	at java.util.TreeMap$EntrySpliterator.forEachRemaining(TreeMap.java:2969)
> 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
> 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
> 	at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
> 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> 	at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
> 	at org.apache.cassandra.db.lifecycle.LogAwareFileLister.innerList(LogAwareFileLister.java:101)
> 	at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:73)
> 	... 5 more



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org