You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Russ Hatch (JIRA)" <ji...@apache.org> on 2016/03/08 22:24:40 UTC
[jira] [Commented] (CASSANDRA-11196) tuple_notation_test upgrade
tests flaps
[ https://issues.apache.org/jira/browse/CASSANDRA-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185834#comment-15185834 ]
Russ Hatch commented on CASSANDRA-11196:
----------------------------------------
[~slebresne] I'm able to repro this locally, here's the cassandra stack trace:
{noformat}
node1: ERROR [SharedPool-Worker-2] 2016-03-08 14:15:16,739 QueryMessage.java:136 - Unexpected error during query
java.lang.IndexOutOfBoundsException: null
at java.nio.Buffer.checkIndex(Buffer.java:540) ~[na:1.8.0_74]
at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:178) ~[na:1.8.0_74]
at org.apache.cassandra.db.composites.BoundedComposite.toByteBuffer(BoundedComposite.java:91) ~[main/:na]
at org.apache.cassandra.db.composites.AbstractCType$Serializer.serializedSize(AbstractCType.java:387) ~[main/:na]
at org.apache.cassandra.db.composites.AbstractCType$Serializer.serializedSize(AbstractCType.java:366) ~[main/:na]
at org.apache.cassandra.db.filter.ColumnSlice$Serializer.serializedSize(ColumnSlice.java:286) ~[main/:na]
at org.apache.cassandra.db.filter.ColumnSlice$Serializer.serializedSize(ColumnSlice.java:259) ~[main/:na]
at org.apache.cassandra.db.filter.SliceQueryFilter$Serializer.serializedSize(SliceQueryFilter.java:541) ~[main/:na]
at org.apache.cassandra.db.filter.SliceQueryFilter$Serializer.serializedSize(SliceQueryFilter.java:500) ~[main/:na]
at org.apache.cassandra.db.SliceFromReadCommandSerializer.serializedSize(SliceFromReadCommand.java:203) ~[main/:na]
at org.apache.cassandra.db.ReadCommandSerializer.serializedSize(ReadCommand.java:171) ~[main/:na]
at org.apache.cassandra.db.ReadCommandSerializer.serializedSize(ReadCommand.java:132) ~[main/:na]
at org.apache.cassandra.net.MessageOut.payloadSize(MessageOut.java:166) ~[main/:na]
at org.apache.cassandra.net.OutboundTcpConnectionPool.getConnection(OutboundTcpConnectionPool.java:72) ~[main/:na]
at org.apache.cassandra.net.MessagingService.getConnection(MessagingService.java:592) ~[main/:na]
at org.apache.cassandra.net.MessagingService.sendOneWay(MessagingService.java:739) ~[main/:na]
at org.apache.cassandra.net.MessagingService.sendRR(MessagingService.java:682) ~[main/:na]
at org.apache.cassandra.net.MessagingService.sendRRWithFailure(MessagingService.java:665) ~[main/:na]
at org.apache.cassandra.service.AbstractReadExecutor.makeRequests(AbstractReadExecutor.java:112) ~[main/:na]
at org.apache.cassandra.service.AbstractReadExecutor.makeDataRequests(AbstractReadExecutor.java:85) ~[main/:na]
at org.apache.cassandra.service.AbstractReadExecutor$NeverSpeculatingReadExecutor.executeAsync(AbstractReadExecutor.java:216) ~[main/:na]
at org.apache.cassandra.service.StorageProxy.fetchRows(StorageProxy.java:1422) ~[main/:na]
at org.apache.cassandra.service.StorageProxy.readRegular(StorageProxy.java:1360) ~[main/:na]
at org.apache.cassandra.service.StorageProxy.read(StorageProxy.java:1277) ~[main/:na]
at org.apache.cassandra.service.pager.SliceQueryPager.queryNextPage(SliceQueryPager.java:96) ~[main/:na]
at org.apache.cassandra.service.pager.AbstractQueryPager.fetchPage(AbstractQueryPager.java:85) ~[main/:na]
at org.apache.cassandra.service.pager.SliceQueryPager.fetchPage(SliceQueryPager.java:39) ~[main/:na]
at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:239) ~[main/:na]
at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:179) ~[main/:na]
at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:76) ~[main/:na]
at org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:226) ~[main/:na]
at org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:257) ~[main/:na]
at org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:242) ~[main/:na]
at org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:123) ~[main/:na]
at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:507) [main/:na]
at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:401) [main/:na]
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) [netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333) [netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.channel.AbstractChannelHandlerContext.access$700(AbstractChannelHandlerContext.java:32) [netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.channel.AbstractChannelHandlerContext$8.run(AbstractChannelHandlerContext.java:324) [netty-all-4.0.23.Final.jar:4.0.23.Final]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_74]
at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164) [main/:na]
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [main/:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74]
ERROR [SharedPool-Worker-2] 2016-03-08 14:15:16,739 ErrorMessage.java:338 - Unexpected exception during request
java.lang.IndexOutOfBoundsException: null
at java.nio.Buffer.checkIndex(Buffer.java:540) ~[na:1.8.0_74]
at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:178) ~[na:1.8.0_74]
at org.apache.cassandra.db.composites.BoundedComposite.toByteBuffer(BoundedComposite.java:91) ~[main/:na]
at org.apache.cassandra.db.composites.AbstractCType$Serializer.serializedSize(AbstractCType.java:387) ~[main/:na]
at org.apache.cassandra.db.composites.AbstractCType$Serializer.serializedSize(AbstractCType.java:366) ~[main/:na]
at org.apache.cassandra.db.filter.ColumnSlice$Serializer.serializedSize(ColumnSlice.java:286) ~[main/:na]
at org.apache.cassandra.db.filter.ColumnSlice$Serializer.serializedSize(ColumnSlice.java:259) ~[main/:na]
at org.apache.cassandra.db.filter.SliceQueryFilter$Serializer.serializedSize(SliceQueryFilter.java:541) ~[main/:na]
at org.apache.cassandra.db.filter.SliceQueryFilter$Serializer.serializedSize(SliceQueryFilter.java:500) ~[main/:na]
at org.apache.cassandra.db.SliceFromReadCommandSerializer.serializedSize(SliceFromReadCommand.java:203) ~[main/:na]
at org.apache.cassandra.db.ReadCommandSerializer.serializedSize(ReadCommand.java:171) ~[main/:na]
at org.apache.cassandra.db.ReadCommandSerializer.serializedSize(ReadCommand.java:132) ~[main/:na]
at org.apache.cassandra.net.MessageOut.payloadSize(MessageOut.java:166) ~[main/:na]
at org.apache.cassandra.net.OutboundTcpConnectionPool.getConnection(OutboundTcpConnectionPool.java:72) ~[main/:na]
at org.apache.cassandra.net.MessagingService.getConnection(MessagingService.java:592) ~[main/:na]
at org.apache.cassandra.net.MessagingService.sendOneWay(MessagingService.java:739) ~[main/:na]
at org.apache.cassandra.net.MessagingService.sendRR(MessagingService.java:682) ~[main/:na]
at org.apache.cassandra.net.MessagingService.sendRRWithFailure(MessagingService.java:665) ~[main/:na]
at org.apache.cassandra.service.AbstractReadExecutor.makeRequests(AbstractReadExecutor.java:112) ~[main/:na]
at org.apache.cassandra.service.AbstractReadExecutor.makeDataRequests(AbstractReadExecutor.java:85) ~[main/:na]
at org.apache.cassandra.service.AbstractReadExecutor$NeverSpeculatingReadExecutor.executeAsync(AbstractReadExecutor.java:216) ~[main/:na]
at org.apache.cassandra.service.StorageProxy.fetchRows(StorageProxy.java:1422) ~[main/:na]
at org.apache.cassandra.service.StorageProxy.readRegular(StorageProxy.java:1360) ~[main/:na]
at org.apache.cassandra.service.StorageProxy.read(StorageProxy.java:1277) ~[main/:na]
at org.apache.cassandra.service.pager.SliceQueryPager.queryNextPage(SliceQueryPager.java:96) ~[main/:na]
at org.apache.cassandra.service.pager.AbstractQueryPager.fetchPage(AbstractQueryPager.java:85) ~[main/:na]
at org.apache.cassandra.service.pager.SliceQueryPager.fetchPage(SliceQueryPager.java:39) ~[main/:na]
at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:239) ~[main/:na]
at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:179) ~[main/:na]
at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:76) ~[main/:na]
at org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:226) ~[main/:na]
at org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:257) ~[main/:na]
at org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:242) ~[main/:na]
at org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:123) ~[main/:na]
at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:507) [main/:na]
at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:401) [main/:na]
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) [netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333) [netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.channel.AbstractChannelHandlerContext.access$700(AbstractChannelHandlerContext.java:32) [netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.channel.AbstractChannelHandlerContext$8.run(AbstractChannelHandlerContext.java:324) [netty-all-4.0.23.Final.jar:4.0.23.Final]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_74]
at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164) [main/:na]
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [main/:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74]
{noformat}
I'll attach some full logs in just a minute here.
> tuple_notation_test upgrade tests flaps
> ---------------------------------------
>
> Key: CASSANDRA-11196
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11196
> Project: Cassandra
> Issue Type: Bug
> Reporter: Jim Witschey
> Assignee: Benjamin Lerer
> Labels: dtest
>
> {{tuple_notation_test}} in the {{upgrade_tests.cql_tests}} module flaps on a number of different upgrade paths. Here are some of the tests that flap:
> {code}
> upgrade_tests/cql_tests.py:TestCQLNodes2RF1_2_1_UpTo_2_2_HEAD.tuple_notation_test
> upgrade_tests/cql_tests.py:TestCQLNodes2RF1_2_1_UpTo_2_2_HEAD.tuple_notation_test
> upgrade_tests/cql_tests.py:TestCQLNodes3RF3_2_1_UpTo_2_2_HEAD.tuple_notation_test
> upgrade_tests/cql_tests.py:TestCQLNodes3RF3_2_1_UpTo_2_2_HEAD.tuple_notation_test
> upgrade_tests/cql_tests.py:TestCQLNodes3RF3_2_2_HEAD_UpTo_Trunk.tuple_notation_test
> upgrade_tests/cql_tests.py:TestCQLNodes3RF3_2_2_HEAD_UpTo_Trunk.tuple_notation_test
> {code}
> Here's an example failure:
> http://cassci.datastax.com/job/upgrade_tests-all/9/testReport/upgrade_tests.cql_tests/TestCQLNodes2RF1_2_1_UpTo_2_2_HEAD/tuple_notation_test/
> All the failures I've seen fail with this error:
> {code}
> <ErrorMessage code=0000 [Server error] message="java.lang.IndexOutOfBoundsException">
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)