You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Berenguer Blasi (Jira)" <ji...@apache.org> on 2021/03/09 07:54:00 UTC

[jira] [Comment Edited] (CASSANDRA-16494) org.apache.cassandra.distributed.test.TopologyChangeTest failing with client timeout

    [ https://issues.apache.org/jira/browse/CASSANDRA-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17297918#comment-17297918 ] 

Berenguer Blasi edited comment on CASSANDRA-16494 at 3/9/21, 7:53 AM:
----------------------------------------------------------------------

Scratch my previous comments. The test repro'es the failure if you run it under j11

{noformat}
java.lang.OutOfMemoryError: Direct buffer memory
[junit-timeout] 	at java.base/java.nio.Bits.reserveMemory(Bits.java:175)
[junit-timeout] 	at java.base/java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:118)
[junit-timeout] 	at java.base/java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:317)
[junit-timeout] 	at io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:645)
[junit-timeout] 	at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:621)
[junit-timeout] 	at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:204)
[junit-timeout] 	at io.netty.buffer.PoolArena.tcacheAllocateSmall(PoolArena.java:174)
[junit-timeout] 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:136)
[junit-timeout] 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:128)
[junit-timeout] 	at io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:378)
[junit-timeout] 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187)
[junit-timeout] 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178)
[junit-timeout] 	at io.netty.buffer.AbstractByteBufAllocator.ioBuffer(AbstractByteBufAllocator.java:139)
[junit-timeout] 	at io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114)
[junit-timeout] 	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:150)
[junit-timeout] 	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719)
[junit-timeout] 	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:655)
[junit-timeout] 	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:581)
[junit-timeout] 	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
[junit-timeout] 	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
[junit-timeout] 	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
[junit-timeout] 	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
[junit-timeout] 	at java.base/java.lang.Thread.run(Thread.java:834)
{noformat}

This is the same failure as in CASSANDRA-16493


was (Author: bereng):
Scratch my previous comments. The test repro'es the failure if you run it under j11

{noformat}
java.lang.OutOfMemoryError: Direct buffer memory
[junit-timeout] 	at java.base/java.nio.Bits.reserveMemory(Bits.java:175)
[junit-timeout] 	at java.base/java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:118)
[junit-timeout] 	at java.base/java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:317)
[junit-timeout] 	at io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:645)
[junit-timeout] 	at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:621)
[junit-timeout] 	at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:204)
[junit-timeout] 	at io.netty.buffer.PoolArena.tcacheAllocateSmall(PoolArena.java:174)
[junit-timeout] 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:136)
[junit-timeout] 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:128)
[junit-timeout] 	at io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:378)
[junit-timeout] 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187)
[junit-timeout] 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178)
[junit-timeout] 	at io.netty.buffer.AbstractByteBufAllocator.ioBuffer(AbstractByteBufAllocator.java:139)
[junit-timeout] 	at io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114)
[junit-timeout] 	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:150)
[junit-timeout] 	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719)
[junit-timeout] 	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:655)
[junit-timeout] 	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:581)
[junit-timeout] 	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
[junit-timeout] 	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
[junit-timeout] 	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
[junit-timeout] 	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
[junit-timeout] 	at java.base/java.lang.Thread.run(Thread.java:834)
{noformat}

>  org.apache.cassandra.distributed.test.TopologyChangeTest failing with client timeout
> -------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-16494
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-16494
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Test/dtest/java
>            Reporter: Adam Holmberg
>            Assignee: Berenguer Blasi
>            Priority: Normal
>             Fix For: 4.0, 4.0-beta
>
>
> Two tests failing with the same error, so I'm assuming they're related. 
> testRestartNode[1: provision strategy=OneNetworkInterface]
> testDecommission[1: provision strategy=OneNetworkInterface]
> Feel free to split out if it ends up looking like something different.
> https://ci-cassandra.apache.org/job/Cassandra-trunk/307/#showFailuresLink
> https://app.circleci.com/pipelines/github/adelapena/cassandra/210/workflows/d21c7f93-58a7-4522-a505-0844304de67f/jobs/1700
> {noformat}
> com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /127.0.0.1:9042 (com.datastax.driver.core.exceptions.OperationTimedOutException: [/127.0.0.1:9042] Operation timed out))
> 	at com.datastax.driver.core.ControlConnection.reconnectInternal(ControlConnection.java:270)
> 	at com.datastax.driver.core.ControlConnection.connect(ControlConnection.java:109)
> 	at com.datastax.driver.core.Cluster$Manager.negotiateProtocolVersionAndConnect(Cluster.java:1813)
> 	at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1726)
> 	at com.datastax.driver.core.Cluster.init(Cluster.java:214)
> 	at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:387)
> 	at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:366)
> 	at com.datastax.driver.core.Cluster.connect(Cluster.java:311)
> 	at org.apache.cassandra.distributed.test.TopologyChangeTest.testRestartNode(TopologyChangeTest.java:176)
> 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org