You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Yakov Zhdanov (JIRA)" <ji...@apache.org> on 2016/11/03 15:35:58 UTC

[jira] [Created] (IGNITE-4174) binary meta cache throws exception on sending compute

Yakov Zhdanov created IGNITE-4174:
-------------------------------------

             Summary: binary meta cache throws exception on sending compute
                 Key: IGNITE-4174
                 URL: https://issues.apache.org/jira/browse/IGNITE-4174
             Project: Ignite
          Issue Type: Bug
          Components: binary
    Affects Versions: 1.8
            Reporter: Yakov Zhdanov


{noformat}
/Library/Java/JavaVirtualMachines/jdk1.7.0_40.jdk/Contents/Home/bin/java -org.apache.ignite.examples.datagrid.ClientReconnectExample
[19:29:11]    __________  ________________ 
[19:29:11]   /  _/ ___/ |/ /  _/_  __/ __/ 
[19:29:11]  _/ // (7 7    // /  / / / _/   
[19:29:11] /___/\___/_/|_/___/ /_/ /___/  
[19:29:11] 
[19:29:11] ver. 1.7.0#20160801-sha1:383273e3
[19:29:11] 2016 Copyright(C) Apache Software Foundation
[19:29:11] 
[19:29:11] Ignite documentation: http://ignite.apache.org
[19:29:11] 
[19:29:11] Quiet mode.
[19:29:11]   ^-- Logging to file '/Users/yzhdanov/projects/apache-ignite-fabric-1.7.0-bin/work/log/ignite-9ed7b39d.log'
[19:29:11]   ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat}
[19:29:11] 
[19:29:11] OS: Mac OS X 10.12.1 x86_64
[19:29:11] VM information: Java(TM) SE Runtime Environment 1.7.0_40-b43 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 24.0-b56
[19:29:11] Initial heap size is 256MB (should be no less than 512MB, use -Xms512m -Xmx512m).
[19:29:11] Configured plugins:
[19:29:11]   ^-- None
[19:29:11] 
[19:29:11] Security status [authentication=off, tls/ssl=off]
[19:29:13] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat}
[19:29:13] 
[19:29:13] Ignite node started OK (id=9ed7b39d, grid=server1)
[19:29:13] Topology snapshot [ver=1, servers=1, clients=0, CPUs=8, heap=3.6GB]
[19:29:13]    __________  ________________ 
[19:29:13]   /  _/ ___/ |/ /  _/_  __/ __/ 
[19:29:13]  _/ // (7 7    // /  / / / _/   
[19:29:13] /___/\___/_/|_/___/ /_/ /___/  
[19:29:13] 
[19:29:13] ver. 1.7.0#20160801-sha1:383273e3
[19:29:13] 2016 Copyright(C) Apache Software Foundation
[19:29:13] 
[19:29:13] Ignite documentation: http://ignite.apache.org
[19:29:13] 
[19:29:13] Quiet mode.
[19:29:13]   ^-- Logging to file '/Users/yzhdanov/projects/apache-ignite-fabric-1.7.0-bin/work/log/ignite-17162cf1.log'
[19:29:13]   ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat}
[19:29:13] 
[19:29:13] OS: Mac OS X 10.12.1 x86_64
[19:29:13] VM information: Java(TM) SE Runtime Environment 1.7.0_40-b43 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 24.0-b56
[19:29:13] Initial heap size is 256MB (should be no less than 512MB, use -Xms512m -Xmx512m).
[19:29:13] Configured plugins:
[19:29:13]   ^-- None
[19:29:13] 
[19:29:13] Security status [authentication=off, tls/ssl=off]
[19:29:13] Topology snapshot [ver=2, servers=1, clients=1, CPUs=8, heap=3.6GB]
[19:29:13] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat}
[19:29:13] 
[19:29:13] Ignite node started OK (id=17162cf1, grid=client1)
[19:29:13] Topology snapshot [ver=2, servers=1, clients=1, CPUs=8, heap=3.6GB]
[19:29:13]    __________  ________________ 
[19:29:13]   /  _/ ___/ |/ /  _/_  __/ __/ 
[19:29:13]  _/ // (7 7    // /  / / / _/   
[19:29:13] /___/\___/_/|_/___/ /_/ /___/  
[19:29:13] 
[19:29:13] ver. 1.7.0#20160801-sha1:383273e3
[19:29:13] 2016 Copyright(C) Apache Software Foundation
[19:29:13] 
[19:29:13] Ignite documentation: http://ignite.apache.org
[19:29:13] 
[19:29:13] Quiet mode.
[19:29:13]   ^-- Logging to file '/Users/yzhdanov/projects/apache-ignite-fabric-1.7.0-bin/work/log/ignite-8394d1e6.log'
[19:29:13]   ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat}
[19:29:13] 
[19:29:13] OS: Mac OS X 10.12.1 x86_64
[19:29:13] VM information: Java(TM) SE Runtime Environment 1.7.0_40-b43 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 24.0-b56
[19:29:13] Initial heap size is 256MB (should be no less than 512MB, use -Xms512m -Xmx512m).
[19:29:13] Configured plugins:
[19:29:13]   ^-- None
[19:29:13] 
[19:29:13] Security status [authentication=off, tls/ssl=off]
[19:29:13] Topology snapshot [ver=3, servers=2, clients=1, CPUs=8, heap=3.6GB]
[19:29:13] Topology snapshot [ver=3, servers=2, clients=1, CPUs=8, heap=3.6GB]
[19:29:13] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat}
[19:29:13] 
[19:29:13] Ignite node started OK (id=8394d1e6, grid=server2)
[19:29:13] Topology snapshot [ver=3, servers=2, clients=1, CPUs=8, heap=3.6GB]
[19:29:13] Topology snapshot [ver=4, servers=1, clients=1, CPUs=8, heap=3.6GB]
[19:29:13] Topology snapshot [ver=4, servers=1, clients=1, CPUs=8, heap=3.6GB]
[19:29:13] Ignite node stopped OK [name=server1, uptime=00:00:00:823]
[19:29:13] Failed to connect to any address from IP finder (will retry to join topology every 2 secs): [/127.0.0.1:47500, /127.0.0.1:47501, /127.0.0.1:47502, /127.0.0.1:47503, /127.0.0.1:47504, /127.0.0.1:47505, /127.0.0.1:47506, /127.0.0.1:47507, /127.0.0.1:47508, /127.0.0.1:47509]
[19:29:13] Ignite node stopped OK [name=server2, uptime=00:00:00:060]
[19:29:13]    __________  ________________ 
[19:29:13]   /  _/ ___/ |/ /  _/_  __/ __/ 
[19:29:13]  _/ // (7 7    // /  / / / _/   
[19:29:13] /___/\___/_/|_/___/ /_/ /___/  
[19:29:13] 
[19:29:13] ver. 1.7.0#20160801-sha1:383273e3
[19:29:13] 2016 Copyright(C) Apache Software Foundation
[19:29:13] 
[19:29:13] Ignite documentation: http://ignite.apache.org
[19:29:13] 
[19:29:13] Quiet mode.
[19:29:13]   ^-- Logging to file '/Users/yzhdanov/projects/apache-ignite-fabric-1.7.0-bin/work/log/ignite-899e367d.log'
[19:29:13]   ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat}
[19:29:13] 
[19:29:13] OS: Mac OS X 10.12.1 x86_64
[19:29:13] VM information: Java(TM) SE Runtime Environment 1.7.0_40-b43 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 24.0-b56
[19:29:13] Initial heap size is 256MB (should be no less than 512MB, use -Xms512m -Xmx512m).
[19:29:13] Configured plugins:
[19:29:13]   ^-- None
[19:29:13] 
[19:29:13] Security status [authentication=off, tls/ssl=off]
[19:29:14] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat}
[19:29:14] 
[19:29:14] Ignite node started OK (id=899e367d, grid=server2)
[19:29:14] Topology snapshot [ver=1, servers=1, clients=0, CPUs=8, heap=3.6GB]
[19:29:15] (err) Failed to execute compound future reducer: GridNearTxFinishFuture [futId=022eeca2851-ec87dacf-94ee-4d8c-94ae-f5ef5c5d5166, tx=GridNearTxLocal [mappings=IgniteTxMappingsSingleImpl [mapping=GridDistributedTxMapping [entries=[IgniteTxEntry [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], cacheId=-2100569601, partId=-1, txKey=IgniteTxKey [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], cacheId=-2100569601], val=[op=TRANSFORM, val=null], prevVal=[op=NOOP, val=null], entryProcessorsCol=[IgniteBiTuple [val1=MetadataProcessor [newMeta=BinaryMetadata [typeId=381717247, typeName=o.a.i.examples.datagrid.ClientReconnectExample$1$1, fields={this$0=103}, affKeyFieldName=null, isEnum=false]], val2=[Ljava.lang.Object;@4bd33a89]], ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=[], filtersPassed=false, filtersSet=true, entry=GridDhtDetachedCacheEntry [super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], val=null, startVer=1478186953378, ver=GridCacheVersion [topVer=89666956, time=1478186954425, order=1478186953378, nodeOrder=2], hash=381717247, extras=null, flags=0]]], prepared=0, locked=false, nodeId=9ed7b39d-eac5-41e3-af21-c1bb0d1cd8cb, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=0, serReadVer=null, xidVer=GridCacheVersion [topVer=89666956, time=1478186954402, order=1478186953376, nodeOrder=2]]], explicitLock=false, dhtVer=null, last=false, near=false, clientFirst=false, node=9ed7b39d-eac5-41e3-af21-c1bb0d1cd8cb]], nearLocallyMapped=false, colocatedLocallyMapped=false, needCheckBackup=false, hasRemoteLocks=false, thread=Thread-8, mappings=IgniteTxMappingsSingleImpl [mapping=GridDistributedTxMapping [entries=[IgniteTxEntry [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], cacheId=-2100569601, partId=-1, txKey=IgniteTxKey [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], cacheId=-2100569601], val=[op=TRANSFORM, val=null], prevVal=[op=NOOP, val=null], entryProcessorsCol=[IgniteBiTuple [val1=MetadataProcessor [newMeta=BinaryMetadata [typeId=381717247, typeName=o.a.i.examples.datagrid.ClientReconnectExample$1$1, fields={this$0=103}, affKeyFieldName=null, isEnum=false]], val2=[Ljava.lang.Object;@4bd33a89]], ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=[], filtersPassed=false, filtersSet=true, entry=GridDhtDetachedCacheEntry [super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], val=null, startVer=1478186953378, ver=GridCacheVersion [topVer=89666956, time=1478186954425, order=1478186953378, nodeOrder=2], hash=381717247, extras=null, flags=0]]], prepared=0, locked=false, nodeId=9ed7b39d-eac5-41e3-af21-c1bb0d1cd8cb, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=0, serReadVer=null, xidVer=GridCacheVersion [topVer=89666956, time=1478186954402, order=1478186953376, nodeOrder=2]]], explicitLock=false, dhtVer=null, last=false, near=false, clientFirst=false, node=9ed7b39d-eac5-41e3-af21-c1bb0d1cd8cb]], super=GridDhtTxLocalAdapter [nearOnOriginatingNode=false, nearNodes=[], dhtNodes=[], explicitLock=false, super=IgniteTxLocalAdapter [completedBase=null, sndTransformedVals=false, depEnabled=false, txState=IgniteTxImplicitSingleStateImpl [init=true], super=IgniteTxAdapter [xidVer=GridCacheVersion [topVer=89666956, time=1478186954402, order=1478186953376, nodeOrder=2], writeVer=null, implicit=true, loc=true, threadId=149, startTime=1478186954400, nodeId=17162cf1-c3d6-4fc9-ab0b-8546983b87ac, startVer=GridCacheVersion [topVer=89666956, time=1478186954402, order=1478186953376, nodeOrder=2], endVer=null, isolation=READ_COMMITTED, concurrency=OPTIMISTIC, timeout=0, sysInvalidate=false, sys=true, plc=5, commitVer=GridCacheVersion [topVer=89666956, time=1478186954402, order=1478186953376, nodeOrder=2], finalizing=NONE, preparing=false, invalidParts=null, state=PREPARED, timedOut=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], duration=1536ms, onePhaseCommit=true], size=1]]], commit=true, mappings=IgniteTxMappingsSingleImpl [mapping=GridDistributedTxMapping [entries=[IgniteTxEntry [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], cacheId=-2100569601, partId=-1, txKey=IgniteTxKey [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], cacheId=-2100569601], val=[op=TRANSFORM, val=null], prevVal=[op=NOOP, val=null], entryProcessorsCol=[IgniteBiTuple [val1=MetadataProcessor [newMeta=BinaryMetadata [typeId=381717247, typeName=o.a.i.examples.datagrid.ClientReconnectExample$1$1, fields={this$0=103}, affKeyFieldName=null, isEnum=false]], val2=[Ljava.lang.Object;@4bd33a89]], ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=[], filtersPassed=false, filtersSet=true, entry=GridDhtDetachedCacheEntry [super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], val=null, startVer=1478186953378, ver=GridCacheVersion [topVer=89666956, time=1478186954425, order=1478186953378, nodeOrder=2], hash=381717247, extras=null, flags=0]]], prepared=0, locked=false, nodeId=9ed7b39d-eac5-41e3-af21-c1bb0d1cd8cb, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=0, serReadVer=null, xidVer=GridCacheVersion [topVer=89666956, time=1478186954402, order=1478186953376, nodeOrder=2]]], explicitLock=false, dhtVer=null, last=false, near=false, clientFirst=false, node=9ed7b39d-eac5-41e3-af21-c1bb0d1cd8cb]], trackable=true, finishOnePhaseCalled=true, innerFuts=[CheckBackupFuture[node=8394d1e6-276f-4fef-8493-e25ec670407e, loc=false, done=true]], super=GridCompoundIdentityFuture [super=GridCompoundFuture [rdc=o.a.i.i.util.lang.GridFunc$27@70daeb2d, initFlag=0, lsnrCalls=0, done=false, cancelled=false, err=null, futs=[true]]]]class org.apache.ignite.internal.IgniteClientDisconnectedCheckedException: Failed to ping node, client node disconnected.
	at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.pingNode(GridDiscoveryManager.java:1401)
	at org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:836)
	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxFinishFuture.checkBackup(GridNearTxFinishFuture.java:510)
	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxFinishFuture.finish(GridNearTxFinishFuture.java:395)
	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal$4.apply(GridNearTxLocal.java:860)
	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal$4.apply(GridNearTxLocal.java:852)
	at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:263)
	at org.apache.ignite.internal.util.future.GridFutureAdapter.listen(GridFutureAdapter.java:226)
	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal.commitAsync(GridNearTxLocal.java:852)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.optimisticPutFuture(IgniteTxLocalAdapter.java:3201)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.putAsync0(IgniteTxLocalAdapter.java:2989)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.invokeAsync(IgniteTxLocalAdapter.java:1875)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter$25.op(GridCacheAdapter.java:2334)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter$25.op(GridCacheAdapter.java:2326)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter.syncOp(GridCacheAdapter.java:4351)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter.invoke0(GridCacheAdapter.java:2326)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter.invoke(GridCacheAdapter.java:2297)
	at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(IgniteCacheProxy.java:1649)
	at org.apache.ignite.internal.processors.cache.binary.CacheObjectBinaryProcessorImpl.addMeta(CacheObjectBinaryProcessorImpl.java:562)
	at org.apache.ignite.internal.processors.cache.binary.CacheObjectBinaryProcessorImpl$2.addMeta(CacheObjectBinaryProcessorImpl.java:200)
	at org.apache.ignite.internal.binary.BinaryContext.registerUserClassDescriptor(BinaryContext.java:774)
	at org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(BinaryContext.java:726)
	at org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(BinaryContext.java:598)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:145)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:132)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.doWriteObject(BinaryWriterExImpl.java:450)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.writeObject(BinaryWriterExImpl.java:1374)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2V2.writeBinary(GridClosureProcessor.java:2019)
	at org.apache.ignite.internal.binary.BinaryClassDescriptor.write(BinaryClassDescriptor.java:688)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:200)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:132)
	at org.apache.ignite.internal.binary.GridBinaryMarshaller.marshal(GridBinaryMarshaller.java:239)
	at org.apache.ignite.internal.binary.BinaryMarshaller.marshal(BinaryMarshaller.java:92)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.sendRequest(GridTaskWorker.java:1250)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.processMappedJobs(GridTaskWorker.java:612)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:504)
	at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
	at org.apache.ignite.internal.processors.task.GridTaskProcessor.startTask(GridTaskProcessor.java:678)
	at org.apache.ignite.internal.processors.task.GridTaskProcessor.execute(GridTaskProcessor.java:403)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor.callAsync(GridClosureProcessor.java:411)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor.callAsync(GridClosureProcessor.java:384)
	at org.apache.ignite.internal.IgniteComputeImpl.broadcast(IgniteComputeImpl.java:267)
	at org.apache.ignite.examples.datagrid.ClientReconnectExample$1.run(ClientReconnectExample.java:51)
	at java.lang.Thread.run(Thread.java:724)
[19:29:15,954][ERROR][Thread-8][GridDhtColocatedCache] <ignite-sys-cache> Failed to rollback transaction (cache may contain stale locks): GridNearTxLocal [mappings=IgniteTxMappingsSingleImpl [mapping=GridDistributedTxMapping [entries=[IgniteTxEntry [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], cacheId=-2100569601, partId=-1, txKey=IgniteTxKey [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], cacheId=-2100569601], val=[op=TRANSFORM, val=null], prevVal=[op=NOOP, val=null], entryProcessorsCol=[IgniteBiTuple [val1=MetadataProcessor [newMeta=BinaryMetadata [typeId=381717247, typeName=o.a.i.examples.datagrid.ClientReconnectExample$1$1, fields={this$0=103}, affKeyFieldName=null, isEnum=false]], val2=[Ljava.lang.Object;@4bd33a89]], ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=[], filtersPassed=false, filtersSet=true, entry=GridDhtDetachedCacheEntry [super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], val=null, startVer=1478186953378, ver=GridCacheVersion [topVer=89666956, time=1478186954425, order=1478186953378, nodeOrder=2], hash=381717247, extras=null, flags=0]]], prepared=0, locked=false, nodeId=9ed7b39d-eac5-41e3-af21-c1bb0d1cd8cb, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=0, serReadVer=null, xidVer=GridCacheVersion [topVer=89666956, time=1478186954402, order=1478186953376, nodeOrder=2]]], explicitLock=false, dhtVer=null, last=false, near=false, clientFirst=false, node=9ed7b39d-eac5-41e3-af21-c1bb0d1cd8cb]], nearLocallyMapped=false, colocatedLocallyMapped=false, needCheckBackup=false, hasRemoteLocks=false, thread=Thread-8, mappings=IgniteTxMappingsSingleImpl [mapping=GridDistributedTxMapping [entries=[IgniteTxEntry [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], cacheId=-2100569601, partId=-1, txKey=IgniteTxKey [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], cacheId=-2100569601], val=[op=TRANSFORM, val=null], prevVal=[op=NOOP, val=null], entryProcessorsCol=[IgniteBiTuple [val1=MetadataProcessor [newMeta=BinaryMetadata [typeId=381717247, typeName=o.a.i.examples.datagrid.ClientReconnectExample$1$1, fields={this$0=103}, affKeyFieldName=null, isEnum=false]], val2=[Ljava.lang.Object;@4bd33a89]], ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=[], filtersPassed=false, filtersSet=true, entry=GridDhtDetachedCacheEntry [super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [val=BinaryMetadataKey [typeId=381717247], hasValBytes=true], val=null, startVer=1478186953378, ver=GridCacheVersion [topVer=89666956, time=1478186954425, order=1478186953378, nodeOrder=2], hash=381717247, extras=null, flags=0]]], prepared=0, locked=false, nodeId=9ed7b39d-eac5-41e3-af21-c1bb0d1cd8cb, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=0, serReadVer=null, xidVer=GridCacheVersion [topVer=89666956, time=1478186954402, order=1478186953376, nodeOrder=2]]], explicitLock=false, dhtVer=null, last=false, near=false, clientFirst=false, node=9ed7b39d-eac5-41e3-af21-c1bb0d1cd8cb]], super=GridDhtTxLocalAdapter [nearOnOriginatingNode=false, nearNodes=[], dhtNodes=[], explicitLock=false, super=IgniteTxLocalAdapter [completedBase=null, sndTransformedVals=false, depEnabled=false, txState=IgniteTxImplicitSingleStateImpl [init=true], super=IgniteTxAdapter [xidVer=GridCacheVersion [topVer=89666956, time=1478186954402, order=1478186953376, nodeOrder=2], writeVer=null, implicit=true, loc=true, threadId=149, startTime=1478186954400, nodeId=17162cf1-c3d6-4fc9-ab0b-8546983b87ac, startVer=GridCacheVersion [topVer=89666956, time=1478186954402, order=1478186953376, nodeOrder=2], endVer=null, isolation=READ_COMMITTED, concurrency=OPTIMISTIC, timeout=0, sysInvalidate=false, sys=true, plc=5, commitVer=GridCacheVersion [topVer=89666956, time=1478186954402, order=1478186953376, nodeOrder=2], finalizing=NONE, preparing=false, invalidParts=null, state=ROLLED_BACK, timedOut=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], duration=1547ms, onePhaseCommit=true], size=1]]]
class org.apache.ignite.internal.IgniteClientDisconnectedCheckedException: Operation has been cancelled (client node disconnected).
	at org.apache.ignite.internal.processors.cache.GridCacheMvccManager.disconnectedError(GridCacheMvccManager.java:402)
	at org.apache.ignite.internal.processors.cache.GridCacheMvccManager.onFutureAdded(GridCacheMvccManager.java:580)
	at org.apache.ignite.internal.processors.cache.GridCacheMvccManager.addFuture(GridCacheMvccManager.java:475)
	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal.rollbackAsync(GridNearTxLocal.java:905)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter$11.applyx(IgniteTxLocalAdapter.java:3219)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter$11.applyx(IgniteTxLocalAdapter.java:3202)
	at org.apache.ignite.internal.util.lang.IgniteClosureX.apply(IgniteClosureX.java:38)
	at org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
	at org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
	at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:263)
	at org.apache.ignite.internal.util.future.GridFutureAdapter.listen(GridFutureAdapter.java:226)
	at org.apache.ignite.internal.util.future.GridFutureAdapter$ChainFuture.<init>(GridFutureAdapter.java:490)
	at org.apache.ignite.internal.util.future.GridFutureAdapter.chain(GridFutureAdapter.java:231)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.optimisticPutFuture(IgniteTxLocalAdapter.java:3201)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.putAsync0(IgniteTxLocalAdapter.java:2989)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.invokeAsync(IgniteTxLocalAdapter.java:1875)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter$25.op(GridCacheAdapter.java:2334)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter$25.op(GridCacheAdapter.java:2326)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter.syncOp(GridCacheAdapter.java:4351)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter.invoke0(GridCacheAdapter.java:2326)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter.invoke(GridCacheAdapter.java:2297)
	at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(IgniteCacheProxy.java:1649)
	at org.apache.ignite.internal.processors.cache.binary.CacheObjectBinaryProcessorImpl.addMeta(CacheObjectBinaryProcessorImpl.java:562)
	at org.apache.ignite.internal.processors.cache.binary.CacheObjectBinaryProcessorImpl$2.addMeta(CacheObjectBinaryProcessorImpl.java:200)
	at org.apache.ignite.internal.binary.BinaryContext.registerUserClassDescriptor(BinaryContext.java:774)
	at org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(BinaryContext.java:726)
	at org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(BinaryContext.java:598)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:145)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:132)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.doWriteObject(BinaryWriterExImpl.java:450)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.writeObject(BinaryWriterExImpl.java:1374)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2V2.writeBinary(GridClosureProcessor.java:2019)
	at org.apache.ignite.internal.binary.BinaryClassDescriptor.write(BinaryClassDescriptor.java:688)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:200)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:132)
	at org.apache.ignite.internal.binary.GridBinaryMarshaller.marshal(GridBinaryMarshaller.java:239)
	at org.apache.ignite.internal.binary.BinaryMarshaller.marshal(BinaryMarshaller.java:92)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.sendRequest(GridTaskWorker.java:1250)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.processMappedJobs(GridTaskWorker.java:612)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:504)
	at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
	at org.apache.ignite.internal.processors.task.GridTaskProcessor.startTask(GridTaskProcessor.java:678)
	at org.apache.ignite.internal.processors.task.GridTaskProcessor.execute(GridTaskProcessor.java:403)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor.callAsync(GridClosureProcessor.java:411)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor.callAsync(GridClosureProcessor.java:384)
	at org.apache.ignite.internal.IgniteComputeImpl.broadcast(IgniteComputeImpl.java:267)
	at org.apache.ignite.examples.datagrid.ClientReconnectExample$1.run(ClientReconnectExample.java:51)
	at java.lang.Thread.run(Thread.java:724)
Will wait on future.
[19:29:15,959][ERROR][Thread-8][GridTaskWorker] Failed to map task jobs to nodes: GridTaskSessionImpl [taskName=o.a.i.examples.datagrid.ClientReconnectExample$1$1, dep=LocalDeployment [super=GridDeployment [ts=1478186953106, depMode=SHARED, clsLdr=sun.misc.Launcher$AppClassLoader@6cc2060e, clsLdrId=581eeca2851-17162cf1-c3d6-4fc9-ab0b-8546983b87ac, userVer=0, loc=true, sampleClsName=java.lang.String, pendingUndeploy=false, undeployed=false, usage=0]], taskClsName=o.a.i.examples.datagrid.ClientReconnectExample$1$1, sesId=a12eeca2851-17162cf1-c3d6-4fc9-ab0b-8546983b87ac, startTime=1478186954355, endTime=9223372036854775807, taskNodeId=17162cf1-c3d6-4fc9-ab0b-8546983b87ac, clsLdr=sun.misc.Launcher$AppClassLoader@6cc2060e, closed=false, cpSpi=null, failSpi=null, loadSpi=null, usage=1, fullSup=false, subjId=17162cf1-c3d6-4fc9-ab0b-8546983b87ac, mapFut=IgniteFuture [orig=GridFutureAdapter [resFlag=2, res=null, startTime=1478186954367, endTime=1478186954377, ignoreInterrupts=false, state=DONE]]]
class org.apache.ignite.binary.BinaryObjectException: Failed to update meta data for type: org.apache.ignite.examples.datagrid.ClientReconnectExample$1$1
	at org.apache.ignite.internal.processors.cache.binary.CacheObjectBinaryProcessorImpl.addMeta(CacheObjectBinaryProcessorImpl.java:568)
	at org.apache.ignite.internal.processors.cache.binary.CacheObjectBinaryProcessorImpl$2.addMeta(CacheObjectBinaryProcessorImpl.java:200)
	at org.apache.ignite.internal.binary.BinaryContext.registerUserClassDescriptor(BinaryContext.java:774)
	at org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(BinaryContext.java:726)
	at org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(BinaryContext.java:598)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:145)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:132)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.doWriteObject(BinaryWriterExImpl.java:450)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.writeObject(BinaryWriterExImpl.java:1374)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2V2.writeBinary(GridClosureProcessor.java:2019)
	at org.apache.ignite.internal.binary.BinaryClassDescriptor.write(BinaryClassDescriptor.java:688)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:200)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:132)
	at org.apache.ignite.internal.binary.GridBinaryMarshaller.marshal(GridBinaryMarshaller.java:239)
	at org.apache.ignite.internal.binary.BinaryMarshaller.marshal(BinaryMarshaller.java:92)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.sendRequest(GridTaskWorker.java:1250)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.processMappedJobs(GridTaskWorker.java:612)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:504)
	at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
	at org.apache.ignite.internal.processors.task.GridTaskProcessor.startTask(GridTaskProcessor.java:678)
	at org.apache.ignite.internal.processors.task.GridTaskProcessor.execute(GridTaskProcessor.java:403)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor.callAsync(GridClosureProcessor.java:411)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor.callAsync(GridClosureProcessor.java:384)
	at org.apache.ignite.internal.IgniteComputeImpl.broadcast(IgniteComputeImpl.java:267)
	at org.apache.ignite.examples.datagrid.ClientReconnectExample$1.run(ClientReconnectExample.java:51)
	at java.lang.Thread.run(Thread.java:724)
Caused by: javax.cache.CacheException: class org.apache.ignite.IgniteClientDisconnectedException: Operation has been cancelled (client node disconnected).
	at org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1502)
	at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.cacheException(IgniteCacheProxy.java:2021)
	at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(IgniteCacheProxy.java:1659)
	at org.apache.ignite.internal.processors.cache.binary.CacheObjectBinaryProcessorImpl.addMeta(CacheObjectBinaryProcessorImpl.java:562)
	... 25 more
Caused by: class org.apache.ignite.IgniteClientDisconnectedException: Operation has been cancelled (client node disconnected).
	at org.apache.ignite.internal.util.IgniteUtils$14.apply(IgniteUtils.java:829)
	at org.apache.ignite.internal.util.IgniteUtils$14.apply(IgniteUtils.java:827)
	... 29 more
Caused by: class org.apache.ignite.internal.IgniteClientDisconnectedCheckedException: Operation has been cancelled (client node disconnected).
	at org.apache.ignite.internal.processors.cache.GridCacheMvccManager.disconnectedError(GridCacheMvccManager.java:402)
	at org.apache.ignite.internal.processors.cache.GridCacheMvccManager.onDisconnected(GridCacheMvccManager.java:378)
	at org.apache.ignite.internal.processors.cache.GridCacheSharedContext.onDisconnected(GridCacheSharedContext.java:224)
	at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onDisconnected(GridCacheProcessor.java:968)
	at org.apache.ignite.internal.IgniteKernal.onDisconnected(IgniteKernal.java:3190)
	at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery(GridDiscoveryManager.java:596)
	at org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.notifyDiscovery(ClientImpl.java:2065)
	at org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.notifyDiscovery(ClientImpl.java:2046)
	at org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.body(ClientImpl.java:1435)
	at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
Caused by: class org.apache.ignite.internal.IgniteClientDisconnectedCheckedException: Operation has been cancelled (client node disconnected).
	at org.apache.ignite.internal.processors.cache.GridCacheMvccManager.disconnectedError(GridCacheMvccManager.java:402)
	at org.apache.ignite.internal.processors.cache.GridCacheMvccManager.onFutureAdded(GridCacheMvccManager.java:580)
	at org.apache.ignite.internal.processors.cache.GridCacheMvccManager.addFuture(GridCacheMvccManager.java:475)
	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal.rollbackAsync(GridNearTxLocal.java:905)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter$11.applyx(IgniteTxLocalAdapter.java:3219)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter$11.applyx(IgniteTxLocalAdapter.java:3202)
	at org.apache.ignite.internal.util.lang.IgniteClosureX.apply(IgniteClosureX.java:38)
	at org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:54)
	at org.apache.ignite.internal.util.future.GridFutureChainListener.apply(GridFutureChainListener.java:28)
	at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:263)
	at org.apache.ignite.internal.util.future.GridFutureAdapter.listen(GridFutureAdapter.java:226)
	at org.apache.ignite.internal.util.future.GridFutureAdapter$ChainFuture.<init>(GridFutureAdapter.java:490)
	at org.apache.ignite.internal.util.future.GridFutureAdapter.chain(GridFutureAdapter.java:231)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.optimisticPutFuture(IgniteTxLocalAdapter.java:3201)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.putAsync0(IgniteTxLocalAdapter.java:2989)
	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.invokeAsync(IgniteTxLocalAdapter.java:1875)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter$25.op(GridCacheAdapter.java:2334)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter$25.op(GridCacheAdapter.java:2326)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter.syncOp(GridCacheAdapter.java:4351)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter.invoke0(GridCacheAdapter.java:2326)
	at org.apache.ignite.internal.processors.cache.GridCacheAdapter.invoke(GridCacheAdapter.java:2297)
	at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(IgniteCacheProxy.java:1649)
	at org.apache.ignite.internal.processors.cache.binary.CacheObjectBinaryProcessorImpl.addMeta(CacheObjectBinaryProcessorImpl.java:562)
	at org.apache.ignite.internal.processors.cache.binary.CacheObjectBinaryProcessorImpl$2.addMeta(CacheObjectBinaryProcessorImpl.java:200)
	at org.apache.ignite.internal.binary.BinaryContext.registerUserClassDescriptor(BinaryContext.java:774)
	at org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(BinaryContext.java:726)
	at org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(BinaryContext.java:598)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:145)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:132)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.doWriteObject(BinaryWriterExImpl.java:450)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.writeObject(BinaryWriterExImpl.java:1374)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2V2.writeBinary(GridClosureProcessor.java:2019)
	at org.apache.ignite.internal.binary.BinaryClassDescriptor.write(BinaryClassDescriptor.java:688)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:200)
	at org.apache.ignite.internal.binary.BinaryWriterExImpl.marshal(BinaryWriterExImpl.java:132)
	at org.apache.ignite.internal.binary.GridBinaryMarshaller.marshal(GridBinaryMarshaller.java:239)
	at org.apache.ignite.internal.binary.BinaryMarshaller.marshal(BinaryMarshaller.java:92)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.sendRequest(GridTaskWorker.java:1250)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.processMappedJobs(GridTaskWorker.java:612)
	at org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:504)
	at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
	at org.apache.ignite.internal.processors.task.GridTaskProcessor.startTask(GridTaskProcessor.java:678)
	at org.apache.ignite.internal.processors.task.GridTaskProcessor.execute(GridTaskProcessor.java:403)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor.callAsync(GridClosureProcessor.java:411)
	at org.apache.ignite.internal.processors.closure.GridClosureProcessor.callAsync(GridClosureProcessor.java:384)
	at org.apache.ignite.internal.IgniteComputeImpl.broadcast(IgniteComputeImpl.java:267)
	at org.apache.ignite.examples.datagrid.ClientReconnectExample$1.run(ClientReconnectExample.java:51)
	at java.lang.Thread.run(Thread.java:724)
[19:29:15] Topology snapshot [ver=2, servers=1, clients=1, CPUs=8, heap=3.6GB]
[19:29:16] Client node was reconnected after it was already considered failed by the server topology (this could happen after all servers restarted or due to a long network outage between the client and servers). All continuous queries and remote event listeners created by this client will be unsubscribed, consider listening to EVT_CLIENT_NODE_RECONNECTED event to restore them.
[19:29:16,017][ERROR][grid-time-coordinator-#245%server2%][GridClockSyncProcessor] Failed to send time sync snapshot to remote node (did not leave grid?) [nodeId=0b66b76c-dcd2-4137-9d03-eaed7a68ba66, msg=GridClockDeltaSnapshotMessage [snapVer=GridClockDeltaVersion [ver=2, topVer=2], deltas={0b66b76c-dcd2-4137-9d03-eaed7a68ba66=0}], err=Failed to send message (node may have left the grid or TCP connection cannot be established due to firewall issues) [node=TcpDiscoveryNode [id=0b66b76c-dcd2-4137-9d03-eaed7a68ba66, addrs=[127.0.0.1], sockAddrs=[/127.0.0.1:0], discPort=0, order=2, intOrder=2, lastExchangeTime=1478186955968, loc=false, ver=1.7.0#20160801-sha1:383273e3, isClient=true], topic=TOPIC_TIME_SYNC, msg=GridClockDeltaSnapshotMessage [snapVer=GridClockDeltaVersion [ver=2, topVer=2], deltas={0b66b76c-dcd2-4137-9d03-eaed7a68ba66=0}], policy=2]]
Reconnected in (ms): 86
[19:29:16] Topology snapshot [ver=2, servers=1, clients=1, CPUs=8, heap=3.6GB]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
Running closure on [id=899e367d-97d6-4768-8b36-09ee3da0c51a, name=server2]
[19:30:02,192][ERROR][tcp-disco-client-message-worker-#26%server2%][TcpDiscoverySpi] Runtime error caught during grid runnable execution: IgniteSpiThread [name=tcp-disco-client-message-worker-#26%server2%]
class org.apache.ignite.spi.IgniteSpiException: Wrong Ignite instance is set: null
	at org.apache.ignite.spi.IgniteSpiAdapter$GridDummySpiContext.addTimeoutObject(IgniteSpiAdapter.java:906)
	at org.apache.ignite.spi.IgniteSpiAdapter.addTimeoutObject(IgniteSpiAdapter.java:638)
	at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.writeToSocket(TcpDiscoverySpi.java:1313)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$ClientMessageWorker.processMessage(ServerImpl.java:5968)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$ClientMessageWorker.processMessage(ServerImpl.java:5865)
	at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerAdapter.body(ServerImpl.java:6123)
	at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
[19:30:02] Ignite node stopped OK [name=client1, uptime=00:00:48:844]
[19:30:02] Ignite node stopped OK [name=server2, uptime=00:00:48:157]

Process finished with exit code 130 (interrupted by signal 2: SIGINT)
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)