You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jaydeepkumar Chovatia (Jira)" <ji...@apache.org> on 2025/06/02 21:58:00 UTC

[jira] [Commented] (CASSANDRA-20610) nodetool unreachable shows all other instances down

    [ https://issues.apache.org/jira/browse/CASSANDRA-20610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955770#comment-17955770 ] 

Jaydeepkumar Chovatia commented on CASSANDRA-20610:
---------------------------------------------------

[~chrisjmiller] 

This seems to be a different issue to me because I do not see anything happening in the _SecondaryIndex_ thread, and 

the _MemtableReclaimMemory_ thread also does not seem to be stuck.

What I observe in the stack trace is that all but 2 of the Native transports are busy in the Auth path. 
{code:java}
"Native-Transport-Requests-44" #392 daemon prio=5 os_prio=0 cpu=209884785.50ms elapsed=9406506.45s tid=0x00007fdf80425e60 nid=0xe3a waiting for monitor entry  [0x00007e9a74bbf000]\
   java.lang.Thread.State: BLOCKED (on object monitor)\
        at java.util.concurrent.ConcurrentHashMap.compute(java.base@11.0.19/ConcurrentHashMap.java:1923)\
        - waiting to lock <0x0000000410435be0> (a java.util.concurrent.ConcurrentHashMap$Node)\
        at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2411)\
        at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2394)\
        at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108)\
        at com.github.benmanes.caffeine.cache.LocalLoadingCache.get(LocalLoadingCache.java:54)\
        at org.apache.cassandra.auth.AuthCache.get(AuthCache.java:230)\
        at org.apache.cassandra.auth.PermissionsCache.getPermissions(PermissionsCache.java:46)\
        at org.apache.cassandra.auth.AuthenticatedUser.getPermissions(AuthenticatedUser.java:123)\
        at org.apache.cassandra.service.ClientState.authorize(ClientState.java:582)\
        at org.apache.cassandra.service.ClientState.ensurePermissionOnResourceChain(ClientState.java:474)\
        at org.apache.cassandra.service.ClientState.ensurePermission(ClientState.java:447)\
        at org.apache.cassandra.service.ClientState.ensurePermission(ClientState.java:434)\
        at org.apache.cassandra.service.ClientState.ensureTablePermission(ClientState.java:414)\
        at org.apache.cassandra.cql3.statements.SelectStatement.authorize(SelectStatement.java:236)\
        at org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:253)\
        at org.apache.cassandra.cql3.QueryProcessor.processPrepared(QueryProcessor.java:826)\
        at org.apache.cassandra.cql3.QueryProcessor.processPrepared(QueryProcessor.java:804)\
        at org.apache.cassandra.transport.messages.ExecuteMessage.execute(ExecuteMessage.java:167)\
        at org.apache.cassandra.transport.Message$Request.execute(Message.java:254)\
        at org.apache.cassandra.transport.Dispatcher.processRequest(Dispatcher.java:122)\
        at org.apache.cassandra.transport.Dispatcher.processRequest(Dispatcher.java:141)\
        at org.apache.cassandra.transport.Dispatcher.processRequest(Dispatcher.java:168)\
        at org.apache.cassandra.transport.Dispatcher.lambda$dispatch$0(Dispatcher.java:82)\
        at org.apache.cassandra.transport.Dispatcher$$Lambda$1528/0x00000008007e3840.run(Unknown Source)\
        at org.apache.cassandra.concurrent.FutureTask$1.call(FutureTask.java:81)\
        at org.apache.cassandra.concurrent.FutureTask.call(FutureTask.java:47)\
        at org.apache.cassandra.concurrent.FutureTask.run(FutureTask.java:57)\
        at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:120)\
        at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)\
        at java.lang.Thread.run(java.base@11.0.19/Thread.java:829)\{code}

> nodetool unreachable shows all other instances down
> ---------------------------------------------------
>
>                 Key: CASSANDRA-20610
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-20610
>             Project: Apache Cassandra
>          Issue Type: Bug
>            Reporter: Chris Miller
>            Priority: Normal
>         Attachments: cassandra_thread_dump_20250530.txt
>
>
> see first comment



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org