Re: https://issues.apache.org/jira/browse/CASSANDRA-10961 fix

[Paulo Motta <pa...@gmail.com>]

Hello Zhiyan,

Replying to the mailing list since this could help others. I'm not sure
what that could be, it's generally related to some kind of corruption,
perhaps CASSANDRA-10791. Although the message is similar to #10971, that is
restricted to streaming so it's a different issue here. Was this a one-off
problem or is it happening frequently? Did you upgrade recently? Did you
try running scrub in the affected node/sstables?

Thanks,

Paulo

2016-09-20 4:50 GMT-03:00 Zhiyan Shao <zh...@gmail.com>:

> Hi Paul,
>
> I got a similar crash as #10961 but couldn't figure out where is the
> issue. Could you help take a look? The crash happened during select query
> with pagination. Here is the stack:
>
>
> ERROR [SharedPool-Worker-3] 2016-09-13 02:10:54,349 ErrorMessage.java:336
> - Unexpected exception during request java.lang.IllegalArgumentException:
> Not enough bytes. Offset: 2. Length: 837. Buffer size: 16 at
> org.apache.cassandra.db.composites.AbstractCType.checkRemaining(AbstractCType.java:362)
> ~[apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.db.compos
> ites.AbstractCompoundCellNameType.fromByteBuffer(AbstractCompoundCellNameType.java:98)
> ~[apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.service.p
> ager.SliceQueryPager.<init>(SliceQueryPager.java:65)
> ~[apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.service.p
> ager.QueryPagers.pager(QueryPagers.java:91) ~[apache-cassandra-2.2.5.jar:2.2.5]
> at org.apache.cassandra.service.pager.QueryPagers.pager(QueryPagers.java:100)
> ~[apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.service.p
> ager.QueryPagers.pager(QueryPagers.java:126)
> ~[apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.cql3.stat
> ements.SelectStatement.execute(SelectStatement.java:178)
> ~[apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.cql3.stat
> ements.SelectStatement.execute(SelectStatement.java:76)
> ~[apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.cql3.Quer
> yProcessor.processStatement(QueryProcessor.java:226)
> ~[apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.cql3.Quer
> yProcessor.processPrepared(QueryProcessor.java:466)
> ~[apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.cql3.Quer
> yProcessor.processPrepared(QueryProcessor.java:443)
> ~[apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.transport
> .messages.ExecuteMessage.execute(ExecuteMessage.java:142)
> ~[apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.transport
> .Message$Dispatcher.channelRead0(Message.java:507)
> [apache-cassandra-2.2.5.jar:2.2.5] at org.apache.cassandra.transport
> .Message$Dispatcher.channelRead0(Message.java:401)
> [apache-cassandra-2.2.5.jar:2.2.5] at io.netty.channel.SimpleChannel
> InboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
> [netty-all-4.0.23.Final.jar:4.0.23.Final] at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannel
> Read(AbstractChannelHandlerContext.java:333)
> [netty-all-4.0.23.Final.jar:4.0.23.Final] at
> io.netty.channel.AbstractChannelHandlerContext.access$700(Ab
> stractChannelHandlerContext.java:32) [netty-all-4.0.23.Final.jar:4.0.23.Final]
> at io.netty.channel.AbstractChannelHandlerContext$8.run(Abstrac
> tChannelHandlerContext.java:324) [netty-all-4.0.23.Final.jar:4.0.23.Final]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> [na:1.8.0_74] at org.apache.cassandra.concurren
> t.AbstractLocalAwareExecutorService$FutureTask.run(AbstractL
> ocalAwareExecutorService.java:164) [apache-cassandra-2.2.5.jar:2.2.5] at
> org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105)
> [apache-cassandra-2.2.5.jar:2.2.5] at java.lang.Thread.run(Thread.java:745)
> [na:1.8.0_74]
>
> Thanks,
> Zhiyan
>
>