[jira] [Created] (IGNITE-23551) Restarted node fails with NullPointerException

["Ashu Pachauri (Jira)" <ji...@apache.org>]

Ashu Pachauri created IGNITE-23551:
--------------------------------------

             Summary: Restarted node fails with NullPointerException
                 Key: IGNITE-23551
                 URL: https://issues.apache.org/jira/browse/IGNITE-23551
             Project: Ignite
          Issue Type: Bug
          Components: cache
    Affects Versions: 2.16, 2.15
         Environment: OS: Ubuntu/debian

Java: Openjdk version "17.0.13" 2024-10-15
            Reporter: Ashu Pachauri
         Attachments: ignite-config.xml, ignite.log

We are using Ignite as a persistant caching system primarily to write KVs using the redis interface; we define redis caches statically in the xml config. 

We have been plagued by an issue where restarting a node in an existing stable cluster does not work and the node fails every time trying to join the cluster giving a NullPointerException. This happens with any and every node in the cluster and persists no matter how many times the node is started up.  After a full cluster restart the issue goes away. 

 

Following is the stacktrace we see in the logs of the failed node:
{code:java}
[10:51:34,769][SEVERE][tcp-disco-msg-worker-[fa915882 10.132.0.114:47500]-#2-#57][TcpDiscoverySpi] TcpDiscoverSpi's message worker thread failed abnormally. S
topping the node in order to prevent cluster wide instability.
java.lang.NullPointerException: Cannot invoke "org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$CachePredicate.addClientNode(java.util.UUID,
 boolean)" because "p" is null
        at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.addClientNode(GridDiscoveryManager.java:428)
        at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.addReceivedClientNodesToDiscovery(ClusterCachesInfo.java:1600)
        at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.onGridDataReceived(ClusterCachesInfo.java:1519)
        at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onGridDataReceived(GridCacheProcessor.java:3137)
        at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onExchange(GridDiscoveryManager.java:1019)
        at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.onExchange(TcpDiscoverySpi.java:2197)
        at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processNodeAddFinishedMessage(ServerImpl.java:5359)
        at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:3242)
        at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:2918)
        at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorker.body(ServerImpl.java:8048)
        at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:3089)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
        at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(ServerImpl.java:7979)
        at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) {code}
Attaching the config and logs for a test cluster for reference.

[^ignite-config.xml]

[^ignite.log]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)