[jira] [Created] (GEODE-5592) During commit, cleanupTransactionIfNoLongerHost could fail with DistributedSystemDisconnectedException

["Eric Shu (JIRA)" <ji...@apache.org>]

Eric Shu created GEODE-5592:
-------------------------------

             Summary: During commit, cleanupTransactionIfNoLongerHost could fail with DistributedSystemDisconnectedException
                 Key: GEODE-5592
                 URL: https://issues.apache.org/jira/browse/GEODE-5592
             Project: Geode
          Issue Type: Bug
          Components: transactions
            Reporter: Eric Shu


The exception stack is as following:
<ServerConnection on port 21816 Thread 2> tid=0x71] commit caught exception
org.apache.geode.distributed.DistributedSystemDisconnectedException: Distribution manager on 10.32.110.218(bridgep1_host1_11874:11874)<v4>:1025 started at Thu Aug 16 14:29:38 PDT 2018: Membership coordinator 10.32.110.218(locatorp1_host1_11910:11910:locator)<ec><v1>:1024 has declared that a network partition has occurred, caused by org.apache.geode.ForcedDisconnectException: Membership coordinator 10.32.110.218(locatorp1_host1_11910:11910:locator)<ec><v1>:1024 has declared that a network partition has occurred
        at org.apache.geode.distributed.internal.ClusterDistributionManager$Stopper.generateCancelledException(ClusterDistributionManager.java:4518)
        at org.apache.geode.distributed.internal.InternalDistributedSystem$Stopper.generateCancelledException(InternalDistributedSystem.java:963)
        at org.apache.geode.CancelCriterion.checkCancelInProgress(CancelCriterion.java:83)
        at org.apache.geode.internal.cache.locks.TXLockServiceImpl.<init>(TXLockServiceImpl.java:80)
        at org.apache.geode.internal.cache.locks.TXLockService.createDTLS(TXLockService.java:53)
        at org.apache.geode.internal.cache.TXLockRequest.releaseDistributed(TXLockRequest.java:108)
        at org.apache.geode.internal.cache.TXLockRequest.cleanup(TXLockRequest.java:142)
        at org.apache.geode.internal.cache.TXState.cleanup(TXState.java:871)
        at org.apache.geode.internal.cache.TXManagerImpl.cleanupTransactionIfNoLongerHost(TXManagerImpl.java:1045)
        at org.apache.geode.internal.cache.TXManagerImpl.unmasquerade(TXManagerImpl.java:1028)
        at org.apache.geode.internal.cache.tier.sockets.BaseCommand.execute(BaseCommand.java:177)
        at org.apache.geode.internal.cache.tier.sockets.ServerConnection.doNormalMsg(ServerConnection.java:869)
        at org.apache.geode.internal.cache.tier.sockets.OriginalServerConnection.doOneMessage(OriginalServerConnection.java:77)
        at org.apache.geode.internal.cache.tier.sockets.ServerConnection.run(ServerConnection.java:1217)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at org.apache.geode.internal.cache.tier.sockets.AcceptorImpl$4$1.run(AcceptorImpl.java:645)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.geode.ForcedDisconnectException: Membership coordinator 10.32.110.218(locatorp1_host1_11910:11910:locator)<ec><v1>:1024 has declared that a network partition has occurred
        at org.apache.geode.distributed.internal.membership.gms.mgr.GMSMembershipManager.forceDisconnect(GMSMembershipManager.java:2534)
        at org.apache.geode.distributed.internal.membership.gms.membership.GMSJoinLeave.forceDisconnect(GMSJoinLeave.java:1054)
        at org.apache.geode.distributed.internal.membership.gms.membership.GMSJoinLeave.processNetworkPartitionMessage(GMSJoinLeave.java:1373)
        at org.apache.geode.distributed.internal.membership.gms.membership.GMSJoinLeave.processMessage(GMSJoinLeave.java:1823)
        at org.apache.geode.distributed.internal.membership.gms.messenger.JGroupsMessenger$JGroupsReceiver.receive(JGroupsMessenger.java:1305)
        at org.jgroups.JChannel.invokeCallback(JChannel.java:816)
        at org.jgroups.JChannel.up(JChannel.java:741)
        at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:1030)
        at org.jgroups.protocols.FRAG2.up(FRAG2.java:165)
        at org.jgroups.protocols.FlowControl.up(FlowControl.java:390)
        at org.jgroups.protocols.UNICAST3.deliverMessage(UNICAST3.java:1077)
        at org.jgroups.protocols.UNICAST3.handleDataReceived(UNICAST3.java:792)
        at org.jgroups.protocols.UNICAST3.up(UNICAST3.java:433)
        at org.apache.geode.distributed.internal.membership.gms.messenger.StatRecorder.up(StatRecorder.java:73)
        at org.apache.geode.distributed.internal.membership.gms.messenger.AddressManager.up(AddressManager.java:72)
        at org.jgroups.protocols.TP.passMessageUp(TP.java:1658)
        at org.jgroups.protocols.TP$SingleMessageHandler.run(TP.java:1876)
        at org.jgroups.util.DirectExecutor.execute(DirectExecutor.java:10)
        at org.jgroups.protocols.TP.handleSingleMessage(TP.java:1789)
        at org.jgroups.protocols.TP.receive(TP.java:1714)
        at org.apache.geode.distributed.internal.membership.gms.messenger.Transport.receive(Transport.java:152)
        at org.jgroups.protocols.UDP$PacketReceiver.run(UDP.java:701)
        ... 1 more

This cause the lock held by the thread not properly released and the lock will block the cache close.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)