You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Andy Stec (Updated) (JIRA)" <ji...@apache.org> on 2011/10/26 19:19:34 UTC

[jira] [Updated] (CASSANDRA-3402) Runtime exception thrown periodically under load

     [ https://issues.apache.org/jira/browse/CASSANDRA-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andy Stec updated CASSANDRA-3402:
---------------------------------

    Attachment: system.log.gz

Hi Sylvain,

Looks like assertions are enabled:

# enable assertions.  disabling this in production will give a modest
# performance benefit (around 5%).
JVM_OPTS="$JVM_OPTS -ea"

The exception always says "error reading 5 of 5".  We don't have a way of
reproducing the problem on a blank database.  The exception is thrown after
load runs for several hours.  I attached the full system.log.

Thanks,

Andy
On Wed, Oct 26, 2011 at 4:47 AM, Sylvain Lebresne (Commented) (JIRA) <


                
> Runtime exception thrown periodically under load
> ------------------------------------------------
>
>                 Key: CASSANDRA-3402
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3402
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 1.0.0
>         Environment: Cassandra 1.0
> Red Hat Enterprise Linux Server 6.0
>            Reporter: Andy Stec
>            Assignee: Sylvain Lebresne
>             Fix For: 1.0.1
>
>         Attachments: system.log.gz
>
>
> The exception listed below is thrown periodically.  We're using thrift interface for C++.  Jonathan Ellis requested that we open a bug for this.
> ERROR [ReadStage:1761] 2011-10-25 12:17:16,088 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[ReadStage:1761,5,main]
> java.lang.RuntimeException: error reading 5 of 5
>         at org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:83)
>         at org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:40)
>         at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
>         at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
>         at org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNext(SSTableSliceIterator.java:107)
>         at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:145)
>         at org.apache.cassandra.utils.MergeIterator$ManyToOne.advance(MergeIterator.java:124)
>         at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:98)
>         at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
>         at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
>         at org.apache.cassandra.db.filter.SliceQueryFilter.collectReducedColumns(SliceQueryFilter.java:116)
>         at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:144)
>         at org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:225)
>         at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:61)
>         at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1297)
>         at org.apache.cassandra.db.ColumnFamilyStore.cacheRow(ColumnFamilyStore.java:1128)
>         at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1157)
>         at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1114)
>         at org.apache.cassandra.db.Table.getRow(Table.java:388)
>         at org.apache.cassandra.db.SliceByNamesReadCommand.getRow(SliceByNamesReadCommand.java:58)
>         at org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:62)
>         at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:59)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.cassandra.db.ColumnSerializer$CorruptColumnException: invalid column name length 0
>         at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:89)
>         at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:82)
>         at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:72)
>         at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:36)
>         at org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:79)
>         ... 24 more

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira