You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Eduard Shangareev (JIRA)" <ji...@apache.org> on 2018/08/03 09:22:00 UTC

[jira] [Updated] (IGNITE-9175) AssertionError on simultaneous nodes stop

     [ https://issues.apache.org/jira/browse/IGNITE-9175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eduard Shangareev updated IGNITE-9175:
--------------------------------------
    Description: 
https://ci.ignite.apache.org/viewLog.html?buildId=1577915&

"New" assertion errors which were found in {{GridCacheDhtPreloadMultiThreadedSelfTest#testConcurrentNodesStartStop}} after issue IGNITE-9159 was fixed.

{code}
[2018-08-02 20:28:06,639][ERROR][tcp-disco-msg-worker-#6163%grid-tester-3%][TcpDiscoverySpi] TcpDiscoverSpi's message worker thread failed abnormally. Stopping the node in order to prevent cluster wide instability.
java.lang.AssertionError
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.sendMessageAcrossRing(ServerImpl.java:2922)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processNodeLeftMessage(ServerImpl.java:4846)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:2810)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:2604)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorker.body(ServerImpl.java:7115)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:2688)
	at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(ServerImpl.java:7059)
	at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
{code}

{code}
[2018-08-02 09:56:25,337][ERROR][tester-4][IgniteKernal%grid-tester-4] Got exception while starting (will rollback startup routine).
java.lang.AssertionError: Topology version out of order [this.topVer=Snapshot [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]], topVer=1, node=TcpDiscoveryNode [id=e3be6dc3-78bb-489c-a00f-1c14e4110b51, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47505], discPort=47505, order=1, intOrder=1, lastExchangeTime=1533203783365, loc=true, ver=2.7.0#20180802-sha1:7b79fc20, isClient=false], nextTopVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], evt=NODE_JOINED]
    at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery0(GridDiscoveryManager.java:747)
    at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery(GridDiscoveryManager.java:590)
    at org.apache.ignite.spi.discovery.tcp.ServerImpl.notifyDiscovery(ServerImpl.java:1443)
    at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:934)
    at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:389)
    at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2002)
    at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:297)
    at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:916)
    at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1754)
    at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1050)
    at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:2020)
    at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1725)
    at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1153)
    at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:673)
    at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:598)
    at org.apache.ignite.Ignition.start(Ignition.java:327)
    at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1349)
    at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1332)
    at org.apache.ignite.internal.processors.cache.distributed.dht.GridCacheDhtPreloadMultiThreadedSelfTest.access$500(GridCacheDhtPreloadMultiThreadedSelfTest.java:42)
    at org.apache.ignite.internal.processors.cache.distributed.dht.GridCacheDhtPreloadMultiThreadedSelfTest$4.call(GridCacheDhtPreloadMultiThreadedSelfTest.java:146)
    at org.apache.ignite.testframework.GridTestThread.run(GridTestThread.java:86)
[2018-08-02 09:56:25,393][WARN ][tcp-disco-msg-worker-#3278%grid-tester-2%][TcpDisco
{code}

  was:
{code}
[2018-08-02 20:28:06,639][ERROR][tcp-disco-msg-worker-#6163%grid-tester-3%][TcpDiscoverySpi] TcpDiscoverSpi's message worker thread failed abnormally. Stopping the node in order to prevent cluster wide instability.
java.lang.AssertionError
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.sendMessageAcrossRing(ServerImpl.java:2922)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processNodeLeftMessage(ServerImpl.java:4846)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:2810)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:2604)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorker.body(ServerImpl.java:7115)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:2688)
	at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(ServerImpl.java:7059)
	at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
{code}


> AssertionError on simultaneous nodes stop
> -----------------------------------------
>
>                 Key: IGNITE-9175
>                 URL: https://issues.apache.org/jira/browse/IGNITE-9175
>             Project: Ignite
>          Issue Type: Bug
>            Reporter: Eduard Shangareev
>            Priority: Major
>
> https://ci.ignite.apache.org/viewLog.html?buildId=1577915&
> "New" assertion errors which were found in {{GridCacheDhtPreloadMultiThreadedSelfTest#testConcurrentNodesStartStop}} after issue IGNITE-9159 was fixed.
> {code}
> [2018-08-02 20:28:06,639][ERROR][tcp-disco-msg-worker-#6163%grid-tester-3%][TcpDiscoverySpi] TcpDiscoverSpi's message worker thread failed abnormally. Stopping the node in order to prevent cluster wide instability.
> java.lang.AssertionError
> 	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.sendMessageAcrossRing(ServerImpl.java:2922)
> 	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processNodeLeftMessage(ServerImpl.java:4846)
> 	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:2810)
> 	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:2604)
> 	at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorker.body(ServerImpl.java:7115)
> 	at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:2688)
> 	at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
> 	at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(ServerImpl.java:7059)
> 	at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
> {code}
> {code}
> [2018-08-02 09:56:25,337][ERROR][tester-4][IgniteKernal%grid-tester-4] Got exception while starting (will rollback startup routine).
> java.lang.AssertionError: Topology version out of order [this.topVer=Snapshot [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]], topVer=1, node=TcpDiscoveryNode [id=e3be6dc3-78bb-489c-a00f-1c14e4110b51, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47505], discPort=47505, order=1, intOrder=1, lastExchangeTime=1533203783365, loc=true, ver=2.7.0#20180802-sha1:7b79fc20, isClient=false], nextTopVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], evt=NODE_JOINED]
>     at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery0(GridDiscoveryManager.java:747)
>     at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery(GridDiscoveryManager.java:590)
>     at org.apache.ignite.spi.discovery.tcp.ServerImpl.notifyDiscovery(ServerImpl.java:1443)
>     at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:934)
>     at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:389)
>     at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2002)
>     at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:297)
>     at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:916)
>     at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1754)
>     at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1050)
>     at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:2020)
>     at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1725)
>     at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1153)
>     at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:673)
>     at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:598)
>     at org.apache.ignite.Ignition.start(Ignition.java:327)
>     at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1349)
>     at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1332)
>     at org.apache.ignite.internal.processors.cache.distributed.dht.GridCacheDhtPreloadMultiThreadedSelfTest.access$500(GridCacheDhtPreloadMultiThreadedSelfTest.java:42)
>     at org.apache.ignite.internal.processors.cache.distributed.dht.GridCacheDhtPreloadMultiThreadedSelfTest$4.call(GridCacheDhtPreloadMultiThreadedSelfTest.java:146)
>     at org.apache.ignite.testframework.GridTestThread.run(GridTestThread.java:86)
> [2018-08-02 09:56:25,393][WARN ][tcp-disco-msg-worker-#3278%grid-tester-2%][TcpDisco
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)