You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ignite.apache.org by "Ksenia Rybakova (JIRA)" <ji...@apache.org> on 2017/11/03 14:47:00 UTC
[jira] [Created] (IGNITE-6829) NPE at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager#exchangeFuture
Ksenia Rybakova created IGNITE-6829:
---------------------------------------
Summary: NPE at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager#exchangeFuture
Key: IGNITE-6829
URL: https://issues.apache.org/jira/browse/IGNITE-6829
Project: Ignite
Issue Type: Bug
Security Level: Public (Viewable by anyone)
Components: general
Affects Versions: 1.8
Reporter: Ksenia Rybakova
Priority: Normal
NPE at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager#exchangeFuture when client node is dropped from cluster:
{noformat}
[15:17:45,677][INFO ][main][IgniteKernal]
>>> __________ ________________
>>> / _/ ___/ |/ / _/_ __/ __/
>>> _/ // (7 7 // / / / / _/
>>> /___/\___/_/|_/___/ /_/ /___/
>>>
>>> ver. 1.9.0-SNAPSHOT#20171101-sha1:8b6b126a
>>> 2017 Copyright(C) Apache Software Foundation
>>>
>>> Ignite documentation: http://ignite.apache.org
[15:17:45,677][INFO ][main][IgniteKernal] Config URL: n/a
[15:17:45,677][INFO ][main][IgniteKernal] Daemon mode: off
[15:17:45,677][INFO ][main][IgniteKernal] OS: Linux 3.10.0-693.2.2.el7.x86_64 amd64
[15:17:45,677][INFO ][main][IgniteKernal] OS user: krybakova
[15:17:45,679][INFO ][main][IgniteKernal] PID: 21415
[15:17:45,679][INFO ][main][IgniteKernal] Language runtime: Java Platform API Specification ver. 1.8
[15:17:45,679][INFO ][main][IgniteKernal] VM information: Java(TM) SE Runtime Environment 1.8.0_141-b15 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.141-b15
[15:17:45,680][INFO ][main][IgniteKernal] VM total memory: 4.0GB
[15:17:45,681][INFO ][main][IgniteKernal] Remote Management [restart: off, REST: off, JMX (remote: off)]
[15:17:45,681][INFO ][main][IgniteKernal] IGNITE_HOME=/storage/ssd/krybakova/opts-set-b-2-d-3600-m-client-rev-8b6b126a-date-0311-151639/yardstick
[15:17:45,681][INFO ][main][IgniteKernal] VM arguments: [-Xms2g, -Xmx2g, -Djava.net.preferIPv4Stack=true, -DIGNITE_QUIET=false, -XX:+UseTLAB, -XX:NewSize=512m, -XX:MaxNewSize=512m, -XX:SurvivorRatio=6, -XX:+AlwaysPreTouch, -XX:+UseG1GC, -XX:MaxGCPauseMillis=2000, -XX:GCTimeRatio=4, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1HeapRegionSize=8M, -XX:ConcGCThreads=16, -XX:ParallelGCThreads=16, -XX:G1HeapWastePercent=10, -XX:+ScavengeBeforeFullGC, -XX:+DisableExplicitGC, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -verbose:gc, -DIGNITE_THREAD_DUMP_ON_EXCHANGE_TIMEOUT=true, -Xms4g, -Xmx4g, -Xloggc:./gc-driver0.log, -Dyardstick.driver0]
[15:17:45,681][INFO ][main][IgniteKernal] Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache', 'atomic', 'atomic-evict', 'atomic-offheap', 'atomic-offheap-values', 'tx', 'tx-evict', 'compute', 'tx-offheap', 'tx-offheap-values', 'atomic-index', 'query', 'orgCache']
[15:17:45,685][INFO ][main][IgniteKernal] 3-rd party licenses can be found at: /storage/ssd/krybakova/opts-set-b-2-d-3600-m-client-rev-8b6b126a-date-0311-151639/yardstick/libs/licenses
[15:17:45,764][INFO ][main][IgnitePluginProcessor] Configured plugins:
[15:17:45,764][INFO ][main][IgnitePluginProcessor] ^-- None
[15:17:45,765][INFO ][main][IgnitePluginProcessor]
[15:17:45,831][INFO ][main][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47103, locHost=0.0.0.0/0.0.0.0, selectorsCnt=8, selectorSpins=0, pairedConn=false]
[15:17:45,838][WARN ][main][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides.
[15:17:45,865][WARN ][main][NoopCheckpointSpi] Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation)
[15:17:45,897][WARN ][main][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival).
[15:17:45,899][WARN ][main][NoopSwapSpaceSpi] Swap space is disabled. To enable use FileSwapSpaceSpi.
[15:17:45,900][INFO ][main][IgniteKernal] Security status [authentication=off, tls/ssl=off]
[15:17:46,350][INFO ][main][GridRestProcessor] REST protocols do not start on client node. To start the protocols on client node set '-DIGNITE_REST_START_ON_CLIENT=true' system property.
[15:17:46,397][INFO ][main][IgniteKernal] Non-loopback local IPs: 172.17.0.1, 172.25.1.11
[15:17:46,398][INFO ][main][IgniteKernal] Enabled local MACs: 02429159579F, 2C55D3F375DE
[15:17:46,405][WARN ][main][TcpDiscoverySpi] Failure detection timeout will be ignored (one of SPI parameters has been set explicitly)
[15:18:21,121][WARN ][tcp-client-disco-msg-worker-#4%null%][TcpDiscoverySpi] Local node was dropped from cluster due to network problems, will try to reconnect with new id after 10000ms (reconnect delay can be changed using IGNITE_DISCO_
FAILED_CLIENT_RECONNECT_DELAY system property) [newId=87ecfbec-aa89-4c0d-ae06-93edbe2c15c0, prevId=75bb5363-5d4f-4f6e-b00e-f634844b30cb, locNode=TcpDiscoveryNode [id=75bb5363-5d4f-4f6e-b00e-f634844b30cb, addrs=[127.0.0.1, 172.17.0.1, 172
.25.1.11], sockAddrs=[/172.17.0.1:0, /127.0.0.1:0, lab11.gridgain.local/172.25.1.11:0], discPort=0, order=32, intOrder=0, lastExchangeTime=1509711466410, loc=true, ver=1.9.0#20171101-sha1:8b6b126a, isClient=true], nodeInitiatedFail=d9905
9eb-efa3-4566-898c-7ac2567be7f6, msg=Client node considered as unreachable and will be dropped from cluster, because no heartbeat messages received in interval: TcpDiscoverySpi.getHeartbeatFrequency() * TcpDiscoverySpi.getMaxMissedClient
Heartbeats() ms. It maybe caused by network problems or long GC pause on client node, try to increase mentioned parameters. [nodeId=75bb5363-5d4f-4f6e-b00e-f634844b30cb, heartBeatFrequency=2000, maxMissedClientHeartbeats=5]]
[15:18:21,402][INFO ][main][GridCacheProcessor] Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED]
[15:18:21,421][INFO ][main][GridCacheProcessor] Started cache [name=tx, mode=REPLICATED]
[15:18:21,428][WARN ][main][GridCacheEvictionManager] <tx-evict> Evictions are not synchronized with other nodes in topology which provides 2x-3x better performance but may cause data inconsistency if cache store is not configured (consi
der changing 'evictSynchronized' configuration property).
[15:18:21,429][INFO ][main][GridCacheProcessor] Started cache [name=tx-evict, mode=PARTITIONED]
[15:18:23,083][ERROR][tcp-client-disco-sock-writer-#2%null%][TcpDiscoverySpi] Failed to send message: TcpDiscoveryClientHeartbeatMessage [super=TcpDiscoveryAbstractMessage [sndNodeId=null, id=12bc0d18f51-75bb5363-5d4f-4f6e-b00e-f634844b3
0cb, verifierNodeId=null, topVer=0, pendingIdx=0, failedNodes=null, isClient=true]]
java.net.SocketException: Socket is closed
at java.net.Socket.getOutputStream(Socket.java:943)
at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.writeToSocket(TcpDiscoverySpi.java:1374)
at org.apache.ignite.spi.discovery.tcp.ClientImpl$SocketWriter.body(ClientImpl.java:1237)
at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
[15:18:31,491][ERROR][main][IgniteKernal] Got exception while starting (will rollback startup routine).
java.lang.NullPointerException
at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.exchangeFuture(GridCachePartitionExchangeManager.java:1106)
at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.onKernalStart0(GridCachePartitionExchangeManager.java:381)
at org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter.onKernalStart(GridCacheSharedManagerAdapter.java:101)
at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onKernalStart(GridCacheProcessor.java:819)
at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:983)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1814)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1605)
at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1042)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:549)
at org.apache.ignite.IgniteSpring.start(IgniteSpring.java:66)
at org.apache.ignite.yardstick.IgniteNode.start(IgniteNode.java:161)
at org.apache.ignite.yardstick.IgniteAbstractBenchmark.setUp(IgniteAbstractBenchmark.java:54)
at org.apache.ignite.yardstick.cache.load.IgniteCacheRandomOperationBenchmark.setUp(IgniteCacheRandomOperationBenchmark.java:136)
at org.yardstickframework.BenchmarkDriverStartUp.main(BenchmarkDriverStartUp.java:130)
[15:18:31,494][WARN ][tcp-client-disco-msg-worker-#4%null%][TcpDiscoverySpi] Client node was reconnected after it was already considered failed by the server topology (this could happen after all servers restarted or due to a long network outage between the client and servers). All continuous queries and remote event listeners created by this client will be unsubscribed, consider listening to EVT_CLIENT_NODE_RECONNECTED event to restore them.
[15:18:31] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=0, done=false, cancelled=false, err=null, futs=[true]]class org.apache.ignite.internal.IgniteInterruptedCheckedException: Node is stopping: null
at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.onKernalStop0(GridCachePartitionExchangeManager.java:506)
at org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter.onKernalStop(GridCacheSharedManagerAdapter.java:113)
at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onKernalStop(GridCacheProcessor.java:914)
at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2083)
at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2029)
at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1027)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1814)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1605)
at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1042)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:549)
at org.apache.ignite.IgniteSpring.start(IgniteSpring.java:66)
at org.apache.ignite.yardstick.IgniteNode.start(IgniteNode.java:161)
at org.apache.ignite.yardstick.IgniteAbstractBenchmark.setUp(IgniteAbstractBenchmark.java:54)
at org.apache.ignite.yardstick.cache.load.IgniteCacheRandomOperationBenchmark.setUp(IgniteCacheRandomOperationBenchmark.java:136)
at org.yardstickframework.BenchmarkDriverStartUp.main(BenchmarkDriverStartUp.java:130)
[15:18:31,500][ERROR][main][IgniteKernal] Failed to reconnect, will stop node.
class org.apache.ignite.internal.IgniteInterruptedCheckedException: Node is stopping: null
at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.onKernalStop0(GridCachePartitionExchangeManager.java:506)
at org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter.onKernalStop(GridCacheSharedManagerAdapter.java:113)
at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onKernalStop(GridCacheProcessor.java:914)
at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2083)
at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2029)
at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1027)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1814)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1605)
at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1042)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:549)
at org.apache.ignite.IgniteSpring.start(IgniteSpring.java:66)
at org.apache.ignite.yardstick.IgniteNode.start(IgniteNode.java:161)
at org.apache.ignite.yardstick.IgniteAbstractBenchmark.setUp(IgniteAbstractBenchmark.java:54)
at org.apache.ignite.yardstick.cache.load.IgniteCacheRandomOperationBenchmark.setUp(IgniteCacheRandomOperationBenchmark.java:136)
at org.yardstickframework.BenchmarkDriverStartUp.main(BenchmarkDriverStartUp.java:130)
[15:18:31,494][WARN ][tcp-client-disco-msg-worker-#4%null%][TcpDiscoverySpi] Client node was reconnected after it was already considered failed by the server topology (this could happen after all servers restarted or due to a long network outage between the client and servers). All continuous queries and remote event listeners created by this client will be unsubscribed, consider listening to EVT_CLIENT_NODE_RECONNECTED event to restore them.
[15:18:31] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=0, done=false, cancelled=false, err=null, futs=[true]]class org.apache.ignite.internal.IgniteInterruptedCheckedException: Node is stopping: null
at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.onKernalStop0(GridCachePartitionExchangeManager.java:506)
at org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter.onKernalStop(GridCacheSharedManagerAdapter.java:113)
at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onKernalStop(GridCacheProcessor.java:914)
at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2083)
at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2029)
at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1027)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1814)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1605)
at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1042)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:549)
at org.apache.ignite.IgniteSpring.start(IgniteSpring.java:66)
at org.apache.ignite.yardstick.IgniteNode.start(IgniteNode.java:161)
at org.apache.ignite.yardstick.IgniteAbstractBenchmark.setUp(IgniteAbstractBenchmark.java:54)
at org.apache.ignite.yardstick.cache.load.IgniteCacheRandomOperationBenchmark.setUp(IgniteCacheRandomOperationBenchmark.java:136)
at org.yardstickframework.BenchmarkDriverStartUp.main(BenchmarkDriverStartUp.java:130)
[15:18:31,500][ERROR][main][IgniteKernal] Failed to reconnect, will stop node.
class org.apache.ignite.internal.IgniteInterruptedCheckedException: Node is stopping: null
at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.onKernalStop0(GridCachePartitionExchangeManager.java:506)
at org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter.onKernalStop(GridCacheSharedManagerAdapter.java:113)
at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onKernalStop(GridCacheProcessor.java:914)
at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2083)
at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2029)
at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1027)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1814)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1605)
at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1042)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:549)
at org.apache.ignite.IgniteSpring.start(IgniteSpring.java:66)
at org.apache.ignite.yardstick.IgniteNode.start(IgniteNode.java:161)
at org.apache.ignite.yardstick.IgniteAbstractBenchmark.setUp(IgniteAbstractBenchmark.java:54)
at org.apache.ignite.yardstick.cache.load.IgniteCacheRandomOperationBenchmark.setUp(IgniteCacheRandomOperationBenchmark.java:136)
at org.yardstickframework.BenchmarkDriverStartUp.main(BenchmarkDriverStartUp.java:130)
[15:18:31,494][WARN ][tcp-client-disco-msg-worker-#4%null%][TcpDiscoverySpi] Client node was reconnected after it was already considered failed by the server topology (this could happen after all servers restarted or due to a long networ
k outage between the client and servers). All continuous queries and remote event listeners created by this client will be unsubscribed, consider listening to EVT_CLIENT_NODE_RECONNECTED event to restore them.
[15:18:31] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=0, done=false, cancelled=false, err=null, futs=[true]]class org.apache.ignite.internal.IgniteInterruptedCheckedException: Nod
e is stopping: null
at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.onKernalStop0(GridCachePartitionExchangeManager.java:506)
at org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter.onKernalStop(GridCacheSharedManagerAdapter.java:113)
at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onKernalStop(GridCacheProcessor.java:914)
at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2083)
at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2029)
at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1027)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1814)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1605)
at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1042)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:549)
at org.apache.ignite.IgniteSpring.start(IgniteSpring.java:66)
at org.apache.ignite.yardstick.IgniteNode.start(IgniteNode.java:161)
at org.apache.ignite.yardstick.IgniteAbstractBenchmark.setUp(IgniteAbstractBenchmark.java:54)
at org.apache.ignite.yardstick.cache.load.IgniteCacheRandomOperationBenchmark.setUp(IgniteCacheRandomOperationBenchmark.java:136)
at org.yardstickframework.BenchmarkDriverStartUp.main(BenchmarkDriverStartUp.java:130)
[15:18:31,500][ERROR][main][IgniteKernal] Failed to reconnect, will stop node.
class org.apache.ignite.internal.IgniteInterruptedCheckedException: Node is stopping: null
at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.onKernalStop0(GridCachePartitionExchangeManager.java:506)
at org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter.onKernalStop(GridCacheSharedManagerAdapter.java:113)
at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onKernalStop(GridCacheProcessor.java:914)
at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2083)
at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2029)
at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1027)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1814)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1605)
at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1042)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:549)
at org.apache.ignite.IgniteSpring.start(IgniteSpring.java:66)
at org.apache.ignite.yardstick.IgniteNode.start(IgniteNode.java:161)
at org.apache.ignite.yardstick.IgniteAbstractBenchmark.setUp(IgniteAbstractBenchmark.java:54)
at org.apache.ignite.yardstick.cache.load.IgniteCacheRandomOperationBenchmark.setUp(IgniteCacheRandomOperationBenchmark.java:136)
at org.yardstickframework.BenchmarkDriverStartUp.main(BenchmarkDriverStartUp.java:130)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)