You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by "Gordon Reid (Nine Mile)" <go...@ninemilefinancial.com> on 2017/07/04 05:44:55 UTC

Ignite very very chatty when java server nodes and .net client when using Service Grid

Hi Ignite Experts,

I have a situation like this.

1 Java Server with ignite cache
1 .NET running in client mode

Running on different machines.

When I DO NOT deploy any services onto the java node, the traffic between java server and .net client seems totally reasonable.

If I do deploy an ignite service on the java node I see a huge amount of network traffic. Around 0.5Mb continuous. There is no data changing in the application cache. The service itself is not doing anything.

0.5Mb continuous per idle client is unusable for us, with an outbound server pipe of only 15Mb

Note

  *   This happens even if the deployed service is not actually started on the Java node. For example, using a NodeFilter.
  *   If the client is a java client, the problem does not occur.
  *   If I start two java server nodes and deploy a service, the traffic between the two server nodes is also low, and seems reasonable.

If I turn on debug logging on the .net client, I see the following, over and over again at high speed.

Any ideas?
Thanks,
Gordon.

2017-07-04 15:33:27,576 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,586 [51] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,586 [51] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=GridServiceAssignmentsKey [name=PositionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,587 [51] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=GridServiceAssignmentsKey [name=PositionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,587 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=GridServiceAssignmentsKey [name=ABNFIXExecutionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.fix.FIXExecutionService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=GridServiceAssignmentsKey [name=ABNFIXExecutionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.fix.FIXExecutionService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,597 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=GridServiceAssignmentsKey [name=FXService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=GridServiceAssignmentsKey [name=FXService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,607 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,616 [49] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,617 [49] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=GridServiceAssignmentsKey [name=RefPriceService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,617 [49] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=GridServiceAssignmentsKey [name=RefPriceService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,617 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,627 [47] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,672 [47] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=GridServiceAssignmentsKey [name=ExecutionRouterService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,672 [47] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=GridServiceAssignmentsKey [name=ExecutionRouterService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,672 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=GridServiceAssignmentsKey [name=BBGMarketDataService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.bbg.BBGMarketDataService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=GridServiceAssignmentsKey [name=BBGMarketDataService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.bbg.BBGMarketDataService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,682 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=GridServiceAssignmentsKey [name=ClusterMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ClusterMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=GridServiceAssignmentsKey [name=ClusterMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ClusterMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,692 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=GridServiceAssignmentsKey [name=ServiceMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ServiceMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=GridServiceAssignmentsKey [name=ServiceMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ServiceMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]


This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252

RE: Ignite very very chatty when java server nodes and .net client when using Service Grid

Posted by "Gordon Reid (Nine Mile)" <go...@ninemilefinancial.com>.
Hi Pavel,

Yes that’s correct, in this case we were calling Ignite.GetServices().GetServiceProxy() every second.

When the .NET client is remote from the java server, this caused a large amount of traffic. As service descriptors for services that were not even deployed (so basically all the services types that we define), was being sent back every second.

The reason we were calling like this, is because we didn’t want to have to manage a stale service proxy in the case of topology change.

Thanks,
Gordon.

From: Pavel Tupitsyn [mailto:ptupitsyn@apache.org]
Sent: Thursday, 6 July 2017 6:42 PM
To: user@ignite.apache.org
Subject: Re: Ignite very very chatty when java server nodes and .net client when using Service Grid

Hi Gordon,

I see that you solved the problem, but I'm still curious: what did you have and what did you change to solve this?
Did you call Ignite.GetServices().GetServiceProxy() every second, or something else?

Thanks,

Pavel

On Thu, Jul 6, 2017 at 3:07 AM, Gordon Reid (Nine Mile) <go...@ninemilefinancial.com>> wrote:
It looks like the problem here is that the Ignite.GetServices is a relatively expensive call from the client. We have a pinger which tells the server a client is “healthy” every 1 second. Caching the service proxy seems to do the trick. And we can manage topology change and refreshing a stale proxy another way.
Thanks.

From: Gordon Reid (Nine Mile) [mailto:gordon.reid@ninemilefinancial.com<ma...@ninemilefinancial.com>]
Sent: Tuesday, 4 July 2017 3:50 PM
To: user@ignite.apache.org<ma...@ignite.apache.org>
Subject: RE: Ignite very very chatty when java server nodes and .net client when using Service Grid

Some additional log which might be useful.

Why is it scanning for services when it’s running in client=true?

2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.processors.resource.GridResourceProcessor - Injecting resources: org.apache.ignite.internal.cluster.ClusterGroupAdapter$AttributeFilter@3398bf2d<ma...@3398bf2d>
2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheQueryAdapter - <ignite-sys-cache> Executing query [query=GridCacheQueryAdapter [type=SCAN, clsName=null, clause=null, filter=ServiceDeploymentPredicate [], transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=org.apache.ignite.internal.cluster.ClusterGroupAdapter@628833ed<ma...@628833ed>, keepBinary=false, subjId=null, taskHash=0], nodes=[TcpDiscoveryNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], sockAddrs=[/0:0:0:0:0:0:0:1%lo:48900, /127.0.0.1:48900<http://127.0.0.1:48900>, /172.31.21.182:48900<http://172.31.21.182:48900>], discPort=48900, order=1, intOrder=1, lastExchangeTime=1499146293372, loc=false, ver=2.0.0#20170430-sha1:d4eef3c6, isClient=false]]]
2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager - <ignite-sys-cache> Executing distributed query: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=SCAN, clsName=null, clause=null, filter=ServiceDeploymentPredicate [], transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=org.apache.ignite.internal.cluster.ClusterGroupAdapter@628833ed<ma...@628833ed>, keepBinary=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskHash=0], rdc=null, trans=null]
2017-07-04 15:33:27,305 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridCacheQueryRequest [id=4766, cacheName=ignite-sys-cache, type=SCAN, fields=false, clause=null, clsName=null, keyValFilter=ServiceDeploymentPredicate [], rdc=null, trans=null, pageSize=1024, incBackups=false, cancel=false, incMeta=false, all=false, keepPortable=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskHash=0, part=-1, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], super=GridCacheMessage [msgId=4767, depInfo=null, err=null, skipPrepare=false, cacheId=-2100569601, cacheId=-2100569601]], nodes=Grid nodes [cnt=1, ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]]
2017-07-04 15:33:27,305 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sent cache message [msg=GridCacheQueryRequest [id=4766, cacheName=ignite-sys-cache, type=SCAN, fields=false, clause=null, clsName=null, keyValFilter=ServiceDeploymentPredicate [], rdc=null, trans=null, pageSize=1024, incBackups=false, cancel=false, incMeta=false, all=false, keepPortable=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskHash=0, part=-1, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], super=GridCacheMessage [msgId=4767, depInfo=null, err=null, skipPrepare=false, cacheId=-2100569601, cacheId=-2100569601]], nodes=Grid nodes [cnt=1, ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]]
2017-07-04 15:33:27,565 [42] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received cache ordered message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridCacheQueryResponse [finished=true, reqId=4766, err=null, fields=false, metadata=null]]
2017-07-04 15:33:27,565 [42] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager - <ignite-sys-cache> Received query response: GridCacheQueryResponse [finished=true, reqId=4766, err=null, fields=false, metadata=null]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter - Received query result page [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, data=[[GridServiceDeploymentKey [name=DeadMansSwitchService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.DeadMansSwitchService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=PositionService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ABNFIXExecutionService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.fix.FIXExecutionService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=FXService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=RefPriceService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ExecutionRouterService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=BBGMarketDataService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.bbg.BBGMarketDataService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ClusterMonitorService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ClusterMonitorService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ServiceMonitorService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ServiceMonitorService, svcCls=, nodeFilterCls=NodeFilter]]]], err=null, finished=true]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.managers.communication.GridIoManager - Removed message listener [topic=T4 [topic=TOPIC_CACHE, id1=56620808-72ee-3e1e-9cee-ec5750198283, id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, id3=4766], lsnr=org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener@230e85f<ma...@230e85f>]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Unregistered ordered cache communication handler for topic:T4 [topic=TOPIC_CACHE, id1=56620808-72ee-3e1e-9cee-ec5750198283, id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, id3=4766]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridCacheQueryResponse [finished=true, reqId=4766, err=null, fields=false, metadata=null]]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.managers.communication.GridIoManager - Message set has not been changed: GridCommunicationMessageSet [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, endTime=9223372036854775807, timeoutId=dc5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, topic=T4 [topic=TOPIC_CACHE, id1=56620808-72ee-3e1e-9cee-ec5750198283, id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, id3=4766], plc=10, msgs=[], reserved=false, timeout=9223372036854775807, skipOnTimeout=false, lastTs=1499146407562]
2017-07-04 15:33:27,566 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=ec5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fc5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]


From: Gordon Reid (Nine Mile) [mailto:gordon.reid@ninemilefinancial.com]
Sent: Tuesday, 4 July 2017 3:45 PM
To: user@ignite.apache.org<ma...@ignite.apache.org>
Subject: Ignite very very chatty when java server nodes and .net client when using Service Grid

Hi Ignite Experts,

I have a situation like this.

1 Java Server with ignite cache
1 .NET running in client mode

Running on different machines.

When I DO NOT deploy any services onto the java node, the traffic between java server and .net client seems totally reasonable.

If I do deploy an ignite service on the java node I see a huge amount of network traffic. Around 0.5Mb continuous. There is no data changing in the application cache. The service itself is not doing anything.

0.5Mb continuous per idle client is unusable for us, with an outbound server pipe of only 15Mb

Note

  *   This happens even if the deployed service is not actually started on the Java node. For example, using a NodeFilter.
  *   If the client is a java client, the problem does not occur.
  *   If I start two java server nodes and deploy a service, the traffic between the two server nodes is also low, and seems reasonable.

If I turn on debug logging on the .net client, I see the following, over and over again at high speed.

Any ideas?
Thanks,
Gordon.

2017-07-04 15:33:27,576 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,586 [51] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,586 [51] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=GridServiceAssignmentsKey [name=PositionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,587 [51] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=GridServiceAssignmentsKey [name=PositionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,587 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=GridServiceAssignmentsKey [name=ABNFIXExecutionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.fix.FIXExecutionService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=GridServiceAssignmentsKey [name=ABNFIXExecutionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.fix.FIXExecutionService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,597 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=GridServiceAssignmentsKey [name=FXService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=GridServiceAssignmentsKey [name=FXService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,607 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,616 [49] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,617 [49] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=GridServiceAssignmentsKey [name=RefPriceService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,617 [49] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=GridServiceAssignmentsKey [name=RefPriceService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,617 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,627 [47] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,672 [47] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=GridServiceAssignmentsKey [name=ExecutionRouterService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,672 [47] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=GridServiceAssignmentsKey [name=ExecutionRouterService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,672 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=GridServiceAssignmentsKey [name=BBGMarketDataService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.bbg.BBGMarketDataService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=GridServiceAssignmentsKey [name=BBGMarketDataService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.bbg.BBGMarketDataService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,682 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=GridServiceAssignmentsKey [name=ClusterMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ClusterMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=GridServiceAssignmentsKey [name=ClusterMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ClusterMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,692 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=GridServiceAssignmentsKey [name=ServiceMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ServiceMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=GridServiceAssignmentsKey [name=ServiceMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ServiceMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]



This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252


This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252


This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252


This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252


This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252



This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252

Re: Ignite very very chatty when java server nodes and .net client when using Service Grid

Posted by Pavel Tupitsyn <pt...@apache.org>.
Hi Gordon,

I see that you solved the problem, but I'm still curious: what did you have
and what did you change to solve this?
Did you call Ignite.GetServices().GetServiceProxy() every second, or
something else?

Thanks,

Pavel

On Thu, Jul 6, 2017 at 3:07 AM, Gordon Reid (Nine Mile) <
gordon.reid@ninemilefinancial.com> wrote:

> It looks like the problem here is that the Ignite.GetServices is a
> relatively expensive call from the client. We have a pinger which tells the
> server a client is “healthy” every 1 second. Caching the service proxy
> seems to do the trick. And we can manage topology change and refreshing a
> stale proxy another way.
>
> Thanks.
>
>
>
> *From:* Gordon Reid (Nine Mile) [mailto:gordon.reid@ninemilefinancial.com]
>
> *Sent:* Tuesday, 4 July 2017 3:50 PM
> *To:* user@ignite.apache.org
> *Subject:* RE: Ignite very very chatty when java server nodes and .net
> client when using Service Grid
>
>
>
> Some additional log which might be useful.
>
>
>
> Why is it scanning for services when it’s running in client=true?
>
>
>
> 2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.
> processors.resource.GridResourceProcessor - Injecting resources:
> org.apache.ignite.internal.cluster.ClusterGroupAdapter$
> AttributeFilter@3398bf2d
>
> 2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.
> processors.cache.query.GridCacheQueryAdapter - <ignite-sys-cache>
> Executing query [query=GridCacheQueryAdapter [type=SCAN, clsName=null,
> clause=null, filter=ServiceDeploymentPredicate [], transform=null,
> part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter
> [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0,
> completed=0, fails=0], pageSize=1024, timeout=0, keepAll=false,
> incBackups=false, dedup=false, prj=org.apache.ignite.internal.cluster.
> ClusterGroupAdapter@628833ed, keepBinary=false, subjId=null, taskHash=0],
> nodes=[TcpDiscoveryNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182],
> sockAddrs=[/0:0:0:0:0:0:0:1%lo:48900, /127.0.0.1:48900, /
> 172.31.21.182:48900], discPort=48900, order=1, intOrder=1,
> lastExchangeTime=1499146293372, loc=false, ver=2.0.0#20170430-sha1:d4eef3c6,
> isClient=false]]]
>
> 2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.
> processors.cache.query.GridCacheDistributedQueryManager -
> <ignite-sys-cache> Executing distributed query: GridCacheQueryBean
> [qry=GridCacheQueryAdapter [type=SCAN, clsName=null, clause=null, filter=ServiceDeploymentPredicate
> [], transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter
> [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0,
> completed=0, fails=0], pageSize=1024, timeout=0, keepAll=false,
> incBackups=false, dedup=false, prj=org.apache.ignite.internal.cluster.
> ClusterGroupAdapter@628833ed, keepBinary=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e,
> taskHash=0], rdc=null, trans=null]
>
> 2017-07-04 15:33:27,305 [11] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Sending cache message
> [msg=GridCacheQueryRequest [id=4766, cacheName=ignite-sys-cache, type=SCAN,
> fields=false, clause=null, clsName=null, keyValFilter=ServiceDeploymentPredicate
> [], rdc=null, trans=null, pageSize=1024, incBackups=false, cancel=false,
> incMeta=false, all=false, keepPortable=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e,
> taskHash=0, part=-1, topVer=AffinityTopologyVersion [topVer=18,
> minorTopVer=0], super=GridCacheMessage [msgId=4767, depInfo=null, err=null,
> skipPrepare=false, cacheId=-2100569601, cacheId=-2100569601]], nodes=Grid
> nodes [cnt=1, ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182],
> daemon=false]]]
>
> 2017-07-04 15:33:27,305 [11] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Sent cache message
> [msg=GridCacheQueryRequest [id=4766, cacheName=ignite-sys-cache, type=SCAN,
> fields=false, clause=null, clsName=null, keyValFilter=ServiceDeploymentPredicate
> [], rdc=null, trans=null, pageSize=1024, incBackups=false, cancel=false,
> incMeta=false, all=false, keepPortable=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e,
> taskHash=0, part=-1, topVer=AffinityTopologyVersion [topVer=18,
> minorTopVer=0], super=GridCacheMessage [msgId=4767, depInfo=null, err=null,
> skipPrepare=false, cacheId=-2100569601, cacheId=-2100569601]], nodes=Grid
> nodes [cnt=1, ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182],
> daemon=false]]]
>
> 2017-07-04 15:33:27,565 [42] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Received cache ordered message
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridCacheQueryResponse
> [finished=true, reqId=4766, err=null, fields=false, metadata=null]]
>
> 2017-07-04 15:33:27,565 [42] DEBUG org.apache.ignite.internal.
> processors.cache.query.GridCacheDistributedQueryManager -
> <ignite-sys-cache> Received query response: GridCacheQueryResponse
> [finished=true, reqId=4766, err=null, fields=false, metadata=null]
>
> 2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.
> processors.cache.query.GridCacheQueryFutureAdapter - Received query
> result page [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, data=[[GridServiceDeploymentKey
> [name=DeadMansSwitchService]=GridServiceDeployment
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.monitoring.DeadMansSwitchService, svcCls=,
> nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey
> [name=PositionService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl,
> svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey
> [name=ABNFIXExecutionService]=GridServiceDeployment
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.execution.fix.FIXExecutionService, svcCls=,
> nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=FXService]=GridServiceDeployment
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService,
> svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey
> [name=RefPriceService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.marketdata.RefPriceService, svcCls=,
> nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey
> [name=ExecutionRouterService]=GridServiceDeployment
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService,
> svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey
> [name=BBGMarketDataService]=GridServiceDeployment
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.marketdata.bbg.BBGMarketDataService, svcCls=,
> nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey
> [name=ClusterMonitorService]=GridServiceDeployment
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.monitoring.ClusterMonitorService, svcCls=,
> nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey
> [name=ServiceMonitorService]=GridServiceDeployment
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.monitoring.ServiceMonitorService, svcCls=,
> nodeFilterCls=NodeFilter]]]], err=null, finished=true]
>
> 2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.
> managers.communication.GridIoManager - Removed message listener [topic=T4
> [topic=TOPIC_CACHE, id1=56620808-72ee-3e1e-9cee-ec5750198283,
> id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, id3=4766],
> lsnr=org.apache.ignite.internal.processors.cache.GridCacheIoManager$
> OrderedMessageListener@230e85f]
>
> 2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Unregistered ordered cache
> communication handler for topic:T4 [topic=TOPIC_CACHE,
> id1=56620808-72ee-3e1e-9cee-ec5750198283, id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e,
> id3=4766]
>
> 2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Finished processing cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> msg=GridCacheQueryResponse [finished=true, reqId=4766, err=null,
> fields=false, metadata=null]]
>
> 2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.
> managers.communication.GridIoManager - Message set has not been changed:
> GridCommunicationMessageSet [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> endTime=9223372036854775807, timeoutId=dc5251c0d51-
> 39512f6f-9628-4133-8f73-1db61f8ad21f, topic=T4 [topic=TOPIC_CACHE,
> id1=56620808-72ee-3e1e-9cee-ec5750198283, id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e,
> id3=4766], plc=10, msgs=[], reserved=false, timeout=9223372036854775807,
> skipOnTimeout=false, lastTs=1499146407562]
>
> 2017-07-04 15:33:27,566 [11] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Sending cache message
> [msg=GridNearGetRequest [futId=ec5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=fc5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> keyMap=null, reload=false, readThrough=true, skipVals=false,
> recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0],
> subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0,
> createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
>
>
>
>
>
> *From:* Gordon Reid (Nine Mile) [mailto:gordon.reid@ninemilefinancial.com
> <go...@ninemilefinancial.com>]
> *Sent:* Tuesday, 4 July 2017 3:45 PM
> *To:* user@ignite.apache.org
> *Subject:* Ignite very very chatty when java server nodes and .net client
> when using Service Grid
>
>
>
> Hi Ignite Experts,
>
>
>
> I have a situation like this.
>
>
>
> 1 Java Server with ignite cache
>
> 1 .NET running in client mode
>
>
>
> Running on different machines.
>
>
>
> When I DO NOT deploy any services onto the java node, the traffic between
> java server and .net client seems totally reasonable.
>
>
>
> If I do deploy an ignite service on the java node I see a huge amount of
> network traffic. Around 0.5Mb continuous. There is no data changing in the
> application cache. The service itself is not doing anything.
>
>
>
> 0.5Mb continuous per idle client is unusable for us, with an outbound
> server pipe of only 15Mb
>
>
>
> Note
>
>    - This happens even if the deployed service is not actually started on
>    the Java node. For example, using a NodeFilter.
>    - If the client is a java client, the problem does not occur.
>    - If I start two java server nodes and deploy a service, the traffic
>    between the two server nodes is also low, and seems reasonable.
>
>
>
> If I turn on debug logging on the .net client, I see the following, over
> and over again at high speed.
>
>
>
> Any ideas?
>
> Thanks,
>
> Gordon.
>
>
>
> 2017-07-04 15:33:27,576 [11] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Sending cache message
> [msg=GridNearGetRequest [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> keyMap=null, reload=false, readThrough=true, skipVals=false,
> recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0],
> subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0,
> createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
>
> 2017-07-04 15:33:27,586 [51] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Received unordered cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse
> [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=null,
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null,
> hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion
> [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,586 [51] DEBUG org.apache.ignite.internal.
> processors.cache.distributed.dht.colocated.GridDhtColocatedCache -
> <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> res=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4,
> val=GridServiceAssignmentsKey [name=PositionService], hasValBytes=true],
> cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl,
> svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,587 [51] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Finished processing cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> msg=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4,
> val=GridServiceAssignmentsKey [name=PositionService], hasValBytes=true],
> cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl,
> svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
>
>
> 2017-07-04 15:33:27,587 [11] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Sending cache message
> [msg=GridNearGetRequest [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> keyMap=null, reload=false, readThrough=true, skipVals=false,
> recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0],
> subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0,
> createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
>
> 2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Received unordered cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse
> [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=null,
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null,
> hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion
> [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.
> processors.cache.distributed.dht.colocated.GridDhtColocatedCache -
> <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> res=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33,
> val=GridServiceAssignmentsKey [name=ABNFIXExecutionService],
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl
> [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.execution.fix.FIXExecutionService, svcCls=,
> nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Finished processing cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> msg=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33,
> val=GridServiceAssignmentsKey [name=ABNFIXExecutionService],
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl
> [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.execution.fix.FIXExecutionService, svcCls=,
> nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
>
>
> 2017-07-04 15:33:27,597 [11] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Sending cache message
> [msg=GridNearGetRequest [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> keyMap=null, reload=false, readThrough=true, skipVals=false,
> recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0],
> subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0,
> createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
>
> 2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Received unordered cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse
> [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=null,
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null,
> hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion
> [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.
> processors.cache.distributed.dht.colocated.GridDhtColocatedCache -
> <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> res=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47,
> val=GridServiceAssignmentsKey [name=FXService], hasValBytes=true],
> cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService,
> svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Finished processing cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> msg=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47,
> val=GridServiceAssignmentsKey [name=FXService], hasValBytes=true],
> cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService,
> svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
>
>
> 2017-07-04 15:33:27,607 [11] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Sending cache message
> [msg=GridNearGetRequest [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> keyMap=null, reload=false, readThrough=true, skipVals=false,
> recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0],
> subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0,
> createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
>
> 2017-07-04 15:33:27,616 [49] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Received unordered cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse
> [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=null,
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null,
> hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion
> [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,617 [49] DEBUG org.apache.ignite.internal.
> processors.cache.distributed.dht.colocated.GridDhtColocatedCache -
> <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> res=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55,
> val=GridServiceAssignmentsKey [name=RefPriceService], hasValBytes=true],
> cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter],
> assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true],
> ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981,
> order=1499145650699, nodeOrder=1], isNew=false, deleted=false]],
> invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0],
> err=null]]
>
> 2017-07-04 15:33:27,617 [49] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Finished processing cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> msg=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55,
> val=GridServiceAssignmentsKey [name=RefPriceService], hasValBytes=true],
> cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments
> [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18,
> cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter],
> assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true],
> ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981,
> order=1499145650699, nodeOrder=1], isNew=false, deleted=false]],
> invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0],
> err=null]]
>
>
>
> 2017-07-04 15:33:27,617 [11] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Sending cache message
> [msg=GridNearGetRequest [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> keyMap=null, reload=false, readThrough=true, skipVals=false,
> recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0],
> subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0,
> createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
>
> 2017-07-04 15:33:27,627 [47] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Received unordered cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse
> [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=null,
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null,
> hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion
> [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,672 [47] DEBUG org.apache.ignite.internal.
> processors.cache.distributed.dht.colocated.GridDhtColocatedCache -
> <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> res=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68,
> val=GridServiceAssignmentsKey [name=ExecutionRouterService],
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl
> [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.execution.ExecutionRouterService, svcCls=,
> nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,672 [47] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Finished processing cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> msg=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68,
> val=GridServiceAssignmentsKey [name=ExecutionRouterService],
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl
> [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.execution.ExecutionRouterService, svcCls=,
> nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
>
>
> 2017-07-04 15:33:27,672 [11] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Sending cache message
> [msg=GridNearGetRequest [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> keyMap=null, reload=false, readThrough=true, skipVals=false,
> recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0],
> subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0,
> createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
>
> 2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Received unordered cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse
> [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=null,
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null,
> hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion
> [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.
> processors.cache.distributed.dht.colocated.GridDhtColocatedCache -
> <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> res=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72,
> val=GridServiceAssignmentsKey [name=BBGMarketDataService],
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl
> [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.marketdata.bbg.BBGMarketDataService, svcCls=,
> nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Finished processing cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> msg=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72,
> val=GridServiceAssignmentsKey [name=BBGMarketDataService],
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl
> [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.marketdata.bbg.BBGMarketDataService, svcCls=,
> nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
>
>
> 2017-07-04 15:33:27,682 [11] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Sending cache message
> [msg=GridNearGetRequest [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> keyMap=null, reload=false, readThrough=true, skipVals=false,
> recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0],
> subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0,
> createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
>
> 2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Received unordered cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse
> [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=null,
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null,
> hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion
> [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.
> processors.cache.distributed.dht.colocated.GridDhtColocatedCache -
> <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> res=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87,
> val=GridServiceAssignmentsKey [name=ClusterMonitorService],
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl
> [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.monitoring.ClusterMonitorService, svcCls=,
> nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Finished processing cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> msg=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87,
> val=GridServiceAssignmentsKey [name=ClusterMonitorService],
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl
> [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.monitoring.ClusterMonitorService, svcCls=,
> nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
>
>
> 2017-07-04 15:33:27,692 [11] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Sending cache message
> [msg=GridNearGetRequest [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> keyMap=null, reload=false, readThrough=true, skipVals=false,
> recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0],
> subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0,
> createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624,
> order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
>
> 2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Received unordered cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse
> [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=null,
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null,
> hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion
> [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.
> processors.cache.distributed.dht.colocated.GridDhtColocatedCache -
> <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> res=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92,
> val=GridServiceAssignmentsKey [name=ServiceMonitorService],
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl
> [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.monitoring.ServiceMonitorService, svcCls=,
> nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
> 2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.
> processors.cache.GridCacheIoManager - Finished processing cache
> communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> msg=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f,
> miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null,
> entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92,
> val=GridServiceAssignmentsKey [name=ServiceMonitorService],
> hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl
> [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624,
> topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.
> services.monitoring.ServiceMonitorService, svcCls=,
> nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}],
> hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion
> [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false,
> deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion
> [topVer=18, minorTopVer=0], err=null]]
>
>
>
>
>
>
>
> This email and any attachments are proprietary & confidential and are
> intended solely for the use of the individuals to whom it is addressed. Any
> views or opinions expressed are solely for those of the author and do not
> necessarily reflect those of Nine Mile Financial Pty. Limited. If you have
> received this email in error, please let us know immediately by reply email
> and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346
> 1349 0252
>
>
>
>
>
> This email and any attachments are proprietary & confidential and are
> intended solely for the use of the individuals to whom it is addressed. Any
> views or opinions expressed are solely for those of the author and do not
> necessarily reflect those of Nine Mile Financial Pty. Limited. If you have
> received this email in error, please let us know immediately by reply email
> and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346
> 1349 0252
>
>
>
>
>
> This email and any attachments are proprietary & confidential and are
> intended solely for the use of the individuals to whom it is addressed. Any
> views or opinions expressed are solely for those of the author and do not
> necessarily reflect those of Nine Mile Financial Pty. Limited. If you have
> received this email in error, please let us know immediately by reply email
> and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346
> 1349 0252
>
>
>
>
>
> This email and any attachments are proprietary & confidential and are
> intended solely for the use of the individuals to whom it is addressed. Any
> views or opinions expressed are solely for those of the author and do not
> necessarily reflect those of Nine Mile Financial Pty. Limited. If you have
> received this email in error, please let us know immediately by reply email
> and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346
> 1349 0252
>
>
>
>
>
> This email and any attachments are proprietary & confidential and are
> intended solely for the use of the individuals to whom it is addressed. Any
> views or opinions expressed are solely for those of the author and do not
> necessarily reflect those of Nine Mile Financial Pty. Limited. If you have
> received this email in error, please let us know immediately by reply email
> and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346
> 1349 0252
>

RE: Ignite very very chatty when java server nodes and .net client when using Service Grid

Posted by "Gordon Reid (Nine Mile)" <go...@ninemilefinancial.com>.
It looks like the problem here is that the Ignite.GetServices is a relatively expensive call from the client. We have a pinger which tells the server a client is "healthy" every 1 second. Caching the service proxy seems to do the trick. And we can manage topology change and refreshing a stale proxy another way.
Thanks.

From: Gordon Reid (Nine Mile) [mailto:gordon.reid@ninemilefinancial.com]
Sent: Tuesday, 4 July 2017 3:50 PM
To: user@ignite.apache.org
Subject: RE: Ignite very very chatty when java server nodes and .net client when using Service Grid

Some additional log which might be useful.

Why is it scanning for services when it's running in client=true?

2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.processors.resource.GridResourceProcessor - Injecting resources: org.apache.ignite.internal.cluster.ClusterGroupAdapter$AttributeFilter@3398bf2d<ma...@3398bf2d>
2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheQueryAdapter - <ignite-sys-cache> Executing query [query=GridCacheQueryAdapter [type=SCAN, clsName=null, clause=null, filter=ServiceDeploymentPredicate [], transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=org.apache.ignite.internal.cluster.ClusterGroupAdapter@628833ed<ma...@628833ed>, keepBinary=false, subjId=null, taskHash=0], nodes=[TcpDiscoveryNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], sockAddrs=[/0:0:0:0:0:0:0:1%lo:48900, /127.0.0.1:48900, /172.31.21.182:48900], discPort=48900, order=1, intOrder=1, lastExchangeTime=1499146293372, loc=false, ver=2.0.0#20170430-sha1:d4eef3c6, isClient=false]]]
2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager - <ignite-sys-cache> Executing distributed query: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=SCAN, clsName=null, clause=null, filter=ServiceDeploymentPredicate [], transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=org.apache.ignite.internal.cluster.ClusterGroupAdapter@628833ed<ma...@628833ed>, keepBinary=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskHash=0], rdc=null, trans=null]
2017-07-04 15:33:27,305 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridCacheQueryRequest [id=4766, cacheName=ignite-sys-cache, type=SCAN, fields=false, clause=null, clsName=null, keyValFilter=ServiceDeploymentPredicate [], rdc=null, trans=null, pageSize=1024, incBackups=false, cancel=false, incMeta=false, all=false, keepPortable=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskHash=0, part=-1, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], super=GridCacheMessage [msgId=4767, depInfo=null, err=null, skipPrepare=false, cacheId=-2100569601, cacheId=-2100569601]], nodes=Grid nodes [cnt=1, ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]]
2017-07-04 15:33:27,305 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sent cache message [msg=GridCacheQueryRequest [id=4766, cacheName=ignite-sys-cache, type=SCAN, fields=false, clause=null, clsName=null, keyValFilter=ServiceDeploymentPredicate [], rdc=null, trans=null, pageSize=1024, incBackups=false, cancel=false, incMeta=false, all=false, keepPortable=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskHash=0, part=-1, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], super=GridCacheMessage [msgId=4767, depInfo=null, err=null, skipPrepare=false, cacheId=-2100569601, cacheId=-2100569601]], nodes=Grid nodes [cnt=1, ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]]
2017-07-04 15:33:27,565 [42] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received cache ordered message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridCacheQueryResponse [finished=true, reqId=4766, err=null, fields=false, metadata=null]]
2017-07-04 15:33:27,565 [42] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager - <ignite-sys-cache> Received query response: GridCacheQueryResponse [finished=true, reqId=4766, err=null, fields=false, metadata=null]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter - Received query result page [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, data=[[GridServiceDeploymentKey [name=DeadMansSwitchService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.DeadMansSwitchService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=PositionService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ABNFIXExecutionService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.fix.FIXExecutionService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=FXService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=RefPriceService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ExecutionRouterService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=BBGMarketDataService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.bbg.BBGMarketDataService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ClusterMonitorService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ClusterMonitorService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ServiceMonitorService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ServiceMonitorService, svcCls=, nodeFilterCls=NodeFilter]]]], err=null, finished=true]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.managers.communication.GridIoManager - Removed message listener [topic=T4 [topic=TOPIC_CACHE, id1=56620808-72ee-3e1e-9cee-ec5750198283, id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, id3=4766], lsnr=org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener@230e85f<ma...@230e85f>]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Unregistered ordered cache communication handler for topic:T4 [topic=TOPIC_CACHE, id1=56620808-72ee-3e1e-9cee-ec5750198283, id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, id3=4766]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridCacheQueryResponse [finished=true, reqId=4766, err=null, fields=false, metadata=null]]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.managers.communication.GridIoManager - Message set has not been changed: GridCommunicationMessageSet [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, endTime=9223372036854775807, timeoutId=dc5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, topic=T4 [topic=TOPIC_CACHE, id1=56620808-72ee-3e1e-9cee-ec5750198283, id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, id3=4766], plc=10, msgs=[], reserved=false, timeout=9223372036854775807, skipOnTimeout=false, lastTs=1499146407562]
2017-07-04 15:33:27,566 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=ec5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fc5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]


From: Gordon Reid (Nine Mile) [mailto:gordon.reid@ninemilefinancial.com]
Sent: Tuesday, 4 July 2017 3:45 PM
To: user@ignite.apache.org<ma...@ignite.apache.org>
Subject: Ignite very very chatty when java server nodes and .net client when using Service Grid

Hi Ignite Experts,

I have a situation like this.

1 Java Server with ignite cache
1 .NET running in client mode

Running on different machines.

When I DO NOT deploy any services onto the java node, the traffic between java server and .net client seems totally reasonable.

If I do deploy an ignite service on the java node I see a huge amount of network traffic. Around 0.5Mb continuous. There is no data changing in the application cache. The service itself is not doing anything.

0.5Mb continuous per idle client is unusable for us, with an outbound server pipe of only 15Mb

Note

  *   This happens even if the deployed service is not actually started on the Java node. For example, using a NodeFilter.
  *   If the client is a java client, the problem does not occur.
  *   If I start two java server nodes and deploy a service, the traffic between the two server nodes is also low, and seems reasonable.

If I turn on debug logging on the .net client, I see the following, over and over again at high speed.

Any ideas?
Thanks,
Gordon.

2017-07-04 15:33:27,576 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,586 [51] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,586 [51] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=GridServiceAssignmentsKey [name=PositionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,587 [51] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=GridServiceAssignmentsKey [name=PositionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,587 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=GridServiceAssignmentsKey [name=ABNFIXExecutionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.fix.FIXExecutionService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=GridServiceAssignmentsKey [name=ABNFIXExecutionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.fix.FIXExecutionService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,597 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=GridServiceAssignmentsKey [name=FXService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=GridServiceAssignmentsKey [name=FXService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,607 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,616 [49] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,617 [49] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=GridServiceAssignmentsKey [name=RefPriceService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,617 [49] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=GridServiceAssignmentsKey [name=RefPriceService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,617 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,627 [47] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,672 [47] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=GridServiceAssignmentsKey [name=ExecutionRouterService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,672 [47] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=GridServiceAssignmentsKey [name=ExecutionRouterService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,672 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=GridServiceAssignmentsKey [name=BBGMarketDataService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.bbg.BBGMarketDataService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=GridServiceAssignmentsKey [name=BBGMarketDataService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.bbg.BBGMarketDataService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,682 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=GridServiceAssignmentsKey [name=ClusterMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ClusterMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=GridServiceAssignmentsKey [name=ClusterMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ClusterMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,692 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=GridServiceAssignmentsKey [name=ServiceMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ServiceMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=GridServiceAssignmentsKey [name=ServiceMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ServiceMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]



This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252


This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252


This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252


This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252


This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252

RE: Ignite very very chatty when java server nodes and .net client when using Service Grid

Posted by "Gordon Reid (Nine Mile)" <go...@ninemilefinancial.com>.
Some additional log which might be useful.

Why is it scanning for services when it's running in client=true?

2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.processors.resource.GridResourceProcessor - Injecting resources: org.apache.ignite.internal.cluster.ClusterGroupAdapter$AttributeFilter@3398bf2d
2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheQueryAdapter - <ignite-sys-cache> Executing query [query=GridCacheQueryAdapter [type=SCAN, clsName=null, clause=null, filter=ServiceDeploymentPredicate [], transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=org.apache.ignite.internal.cluster.ClusterGroupAdapter@628833ed, keepBinary=false, subjId=null, taskHash=0], nodes=[TcpDiscoveryNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], sockAddrs=[/0:0:0:0:0:0:0:1%lo:48900, /127.0.0.1:48900, /172.31.21.182:48900], discPort=48900, order=1, intOrder=1, lastExchangeTime=1499146293372, loc=false, ver=2.0.0#20170430-sha1:d4eef3c6, isClient=false]]]
2017-07-04 15:33:27,304 [11] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager - <ignite-sys-cache> Executing distributed query: GridCacheQueryBean [qry=GridCacheQueryAdapter [type=SCAN, clsName=null, clause=null, filter=ServiceDeploymentPredicate [], transform=null, part=null, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=9223372036854775807, maxTime=0, sumTime=0, avgTime=0.0, execs=0, completed=0, fails=0], pageSize=1024, timeout=0, keepAll=false, incBackups=false, dedup=false, prj=org.apache.ignite.internal.cluster.ClusterGroupAdapter@628833ed, keepBinary=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskHash=0], rdc=null, trans=null]
2017-07-04 15:33:27,305 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridCacheQueryRequest [id=4766, cacheName=ignite-sys-cache, type=SCAN, fields=false, clause=null, clsName=null, keyValFilter=ServiceDeploymentPredicate [], rdc=null, trans=null, pageSize=1024, incBackups=false, cancel=false, incMeta=false, all=false, keepPortable=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskHash=0, part=-1, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], super=GridCacheMessage [msgId=4767, depInfo=null, err=null, skipPrepare=false, cacheId=-2100569601, cacheId=-2100569601]], nodes=Grid nodes [cnt=1, ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]]
2017-07-04 15:33:27,305 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sent cache message [msg=GridCacheQueryRequest [id=4766, cacheName=ignite-sys-cache, type=SCAN, fields=false, clause=null, clsName=null, keyValFilter=ServiceDeploymentPredicate [], rdc=null, trans=null, pageSize=1024, incBackups=false, cancel=false, incMeta=false, all=false, keepPortable=false, subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskHash=0, part=-1, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], super=GridCacheMessage [msgId=4767, depInfo=null, err=null, skipPrepare=false, cacheId=-2100569601, cacheId=-2100569601]], nodes=Grid nodes [cnt=1, ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]]
2017-07-04 15:33:27,565 [42] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received cache ordered message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridCacheQueryResponse [finished=true, reqId=4766, err=null, fields=false, metadata=null]]
2017-07-04 15:33:27,565 [42] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager - <ignite-sys-cache> Received query response: GridCacheQueryResponse [finished=true, reqId=4766, err=null, fields=false, metadata=null]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter - Received query result page [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, data=[[GridServiceDeploymentKey [name=DeadMansSwitchService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.DeadMansSwitchService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=PositionService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ABNFIXExecutionService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.fix.FIXExecutionService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=FXService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=RefPriceService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ExecutionRouterService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=BBGMarketDataService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.bbg.BBGMarketDataService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ClusterMonitorService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ClusterMonitorService, svcCls=, nodeFilterCls=NodeFilter]]], [GridServiceDeploymentKey [name=ServiceMonitorService]=GridServiceDeployment [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ServiceMonitorService, svcCls=, nodeFilterCls=NodeFilter]]]], err=null, finished=true]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.managers.communication.GridIoManager - Removed message listener [topic=T4 [topic=TOPIC_CACHE, id1=56620808-72ee-3e1e-9cee-ec5750198283, id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, id3=4766], lsnr=org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener@230e85f]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Unregistered ordered cache communication handler for topic:T4 [topic=TOPIC_CACHE, id1=56620808-72ee-3e1e-9cee-ec5750198283, id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, id3=4766]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridCacheQueryResponse [finished=true, reqId=4766, err=null, fields=false, metadata=null]]
2017-07-04 15:33:27,566 [42] DEBUG org.apache.ignite.internal.managers.communication.GridIoManager - Message set has not been changed: GridCommunicationMessageSet [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, endTime=9223372036854775807, timeoutId=dc5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, topic=T4 [topic=TOPIC_CACHE, id1=56620808-72ee-3e1e-9cee-ec5750198283, id2=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, id3=4766], plc=10, msgs=[], reserved=false, timeout=9223372036854775807, skipOnTimeout=false, lastTs=1499146407562]
2017-07-04 15:33:27,566 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=ec5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fc5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]

From: Gordon Reid (Nine Mile) [mailto:gordon.reid@ninemilefinancial.com]
Sent: Tuesday, 4 July 2017 3:45 PM
To: user@ignite.apache.org
Subject: Ignite very very chatty when java server nodes and .net client when using Service Grid

Hi Ignite Experts,

I have a situation like this.

1 Java Server with ignite cache
1 .NET running in client mode

Running on different machines.

When I DO NOT deploy any services onto the java node, the traffic between java server and .net client seems totally reasonable.

If I do deploy an ignite service on the java node I see a huge amount of network traffic. Around 0.5Mb continuous. There is no data changing in the application cache. The service itself is not doing anything.

0.5Mb continuous per idle client is unusable for us, with an outbound server pipe of only 15Mb

Note

  *   This happens even if the deployed service is not actually started on the Java node. For example, using a NodeFilter.
  *   If the client is a java client, the problem does not occur.
  *   If I start two java server nodes and deploy a service, the traffic between the two server nodes is also low, and seems reasonable.

If I turn on debug logging on the .net client, I see the following, over and over again at high speed.

Any ideas?
Thanks,
Gordon.

2017-07-04 15:33:27,576 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,586 [51] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,586 [51] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=GridServiceAssignmentsKey [name=PositionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,587 [51] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=0d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=1d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=4, val=GridServiceAssignmentsKey [name=PositionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.position.PositionServiceImpl, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650687, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,587 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=GridServiceAssignmentsKey [name=ABNFIXExecutionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.fix.FIXExecutionService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,597 [48] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=2d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=3d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=33, val=GridServiceAssignmentsKey [name=ABNFIXExecutionService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.fix.FIXExecutionService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650691, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,597 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=GridServiceAssignmentsKey [name=FXService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,607 [52] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=4d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=5d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=47, val=GridServiceAssignmentsKey [name=FXService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.FXService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650695, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,607 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,616 [49] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,617 [49] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=GridServiceAssignmentsKey [name=RefPriceService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,617 [49] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=6d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=7d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=55, val=GridServiceAssignmentsKey [name=RefPriceService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.RefPriceService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650699, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,617 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,627 [47] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,672 [47] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=GridServiceAssignmentsKey [name=ExecutionRouterService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,672 [47] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=8d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=9d5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=68, val=GridServiceAssignmentsKey [name=ExecutionRouterService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.execution.ExecutionRouterService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650703, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,672 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=GridServiceAssignmentsKey [name=BBGMarketDataService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.bbg.BBGMarketDataService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,682 [53] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=ad5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=bd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=72, val=GridServiceAssignmentsKey [name=BBGMarketDataService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.marketdata.bbg.BBGMarketDataService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650707, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,682 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=GridServiceAssignmentsKey [name=ClusterMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ClusterMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,692 [50] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=cd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=dd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=87, val=GridServiceAssignmentsKey [name=ClusterMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ClusterMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650711, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]

2017-07-04 15:33:27,692 [11] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Sending cache message [msg=GridNearGetRequest [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, keyMap=null, reload=false, readThrough=true, skipVals=false, recovery=false, topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], subjId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, taskNameHash=0, createTtl=-1, accessTtl=-1], node=ClusterNode [id=386f9b12-4dc3-48b4-a174-95a28387d624, order=1, addr=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.31.21.182], daemon=false]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Received unordered cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, locId=d30c7fa6-7a8e-4fe0-9bae-efb67d014a1e, msg=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=null, hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=null, hasValBytes=true], ttl=0, expireTime=-1, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.distributed.dht.colocated.GridDhtColocatedCache - <ignite-sys-cache> Processing near get response [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, res=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=GridServiceAssignmentsKey [name=ServiceMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ServiceMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]
2017-07-04 15:33:27,702 [54] DEBUG org.apache.ignite.internal.processors.cache.GridCacheIoManager - Finished processing cache communication message [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, msg=GridNearGetResponse [futId=ed5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, miniId=fd5251c0d51-39512f6f-9628-4133-8f73-1db61f8ad21f, ver=null, entries=[GridCacheEntryInfo [key=KeyCacheObjectImpl [part=92, val=GridServiceAssignmentsKey [name=ServiceMonitorService], hasValBytes=true], cacheId=-2100569601, val=CacheObjectImpl [val=GridServiceAssignments [nodeId=386f9b12-4dc3-48b4-a174-95a28387d624, topVer=18, cfg=LazyServiceConfiguration [srvcClsName=com.nmf.grid.services.monitoring.ServiceMonitorService, svcCls=, nodeFilterCls=NodeFilter], assigns={386f9b12-4dc3-48b4-a174-95a28387d624=1}], hasValBytes=true], ttl=0, expireTime=0, ver=GridCacheVersion [topVer=110621981, order=1499145650715, nodeOrder=1], isNew=false, deleted=false]], invalidParts=[], topVer=AffinityTopologyVersion [topVer=18, minorTopVer=0], err=null]]



This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252


This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252


This email and any attachments are proprietary & confidential and are intended solely for the use of the individuals to whom it is addressed. Any views or opinions expressed are solely for those of the author and do not necessarily reflect those of Nine Mile Financial Pty. Limited. If you have received this email in error, please let us know immediately by reply email and delete from your system. Nine Mile Financial Pty. Limited. ABN: 346 1349 0252