You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by kay <go...@gmail.com> on 2020/09/08 06:26:09 UTC

Ignite Node shutdown..

Hello, I test if i use max heap size..

I got this error and node was shut down..

rmtAddr's client socket port is allocated by OS and it is randomized.

 
 

[2020.09.08 14:27:04.251] [ERROR] [] Critical system error detected.
Will be handled accordingly to configured handler
[hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0,
super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet
[SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]],
failureCtx=FailureContext [type=CRITICAL_ERROR, err=class
o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data region
[name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0 MiB,
persistenceEnabled=false] Try the following:
   ^-- Increase maximum off-heap memory size
(DataRegionConfiguration.maxSize)
   ^-- Enable Ignite persistence
(DataRegionConfiguration.persistenceEnabled)
   ^-- Enable eviction or expiration policies]]
  org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of
memory in data region [name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0
MiB, persistenceEnabled=false] Try the following:
   ^-- Increase maximum off-heap memory size
(DataRegionConfiguration.maxSize)
   ^-- Enable Ignite persistence
(DataRegionConfiguration.persistenceEnabled)
   ^-- Enable eviction or expiration policies
  at
org.apache.ignite.internal.processors.cache.persistence.IgniteCacheDatabaseSharedManager.ensureFreeSpaceForInsert(IgniteCacheDatabaseSharedManager.java:1063)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.RowStore.addRow(RowStore.java:106)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.createRow(IgniteCacheOffheapManagerImpl.java:1746)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.update(GridCacheMapEntry.java:6409)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.call(GridCacheMapEntry.java:6160)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.call(GridCacheMapEntry.java:5849)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.invokeClosure(BPlusTree.java:3817)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.access$5700(BPlusTree.java:3711)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invokeDown(BPlusTree.java:1955)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invoke(BPlusTree.java:1839)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke0(IgniteCacheOffheapManagerImpl.java:1696)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke(IgniteCacheOffheapManagerImpl.java:1679)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:441)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerUpdate(GridCacheMapEntry.java:2314)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateSingle(GridDhtAtomicCache.java:2636)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.update(GridDhtAtomicCache.java:2097)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateAllAsyncInternal0(GridDhtAtomicCache.java:1914)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateAllAsyncInternal(GridDhtAtomicCache.java:1714)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicAbstractUpdateFuture.sendSingleRequest(GridNearAtomicAbstractUpdateFuture.java:300)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFuture.java:486)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicSingleUpdateFuture.mapOnTopology(GridNearAtomicSingleUpdateFuture.java:446)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFuture.java:249)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1164)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.put0(GridDhtAtomicCache.java:624)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.put(GridCacheAdapter.java:2575)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.put(GridCacheAdapter.java:2552)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.put(IgniteCacheProxyImpl.java:1302)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GatewayProtectedCacheProxy.put(GatewayProtectedCacheProxy.java:856)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.platform.client.cache.ClientCachePutRequest.process(ClientCachePutRequest.java:40)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.platform.client.ClientRequestHandler.handle(ClientRequestHandler.java:98)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:195)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:49)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.nio.GridNioFilterChain$TailFilter.onMessageReceived(GridNioFilterChain.java:279)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.nio.GridNioAsyncNotifyFilter$3.body(GridNioAsyncNotifyFilter.java:97)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.worker.GridWorkerPool$1.run(GridWorkerPool.java:70)
[ignite-core-2.8.0.jar:2.8.0]
  at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_181]
  at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_181]
  at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
 [2020.09.08 14:27:04.259] [ERROR] [] JVM will be halted immediately
due to the failure: [failureCtx=FailureContext [type=CRITICAL_ERROR,
err=class o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data
region [name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0 MiB,
persistenceEnabled=false] Try the following:
   ^-- Increase maximum off-heap memory size
(DataRegionConfiguration.maxSize)
   ^-- Enable Ignite persistence
(DataRegionConfiguration.persistenceEnabled)
  ^-- Enable eviction or expiration policies]]

 
 


Is there any way i get only exception and node will not be shutdown??

I will wait for reply
Thank you so much.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite Node shutdown..

Posted by Michael Cherkasov <mi...@gmail.com>.
Hi, you don't have enough off heap space for your data, so I wondering,
what kind of tests do you try to do?
Might be you can enable persistence?

пн, 7 сент. 2020 г. в 23:26, kay <go...@gmail.com>:

> Hello, I test if i use max heap size..
>
> I got this error and node was shut down..
>
> rmtAddr's client socket port is allocated by OS and it is randomized.
>
>
>
>
>  [1;31m[2020.09.08 14:27:04.251] [ERROR] [] Critical system error detected.
> Will be handled accordingly to configured handler
> [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0,
> super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet
> [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]],
> failureCtx=FailureContext [type=CRITICAL_ERROR, err=class
> o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data region
> [name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0 MiB,
> persistenceEnabled=false] Try the following:
>    ^-- Increase maximum off-heap memory size
> (DataRegionConfiguration.maxSize)
>    ^-- Enable Ignite persistence
> (DataRegionConfiguration.persistenceEnabled)
>    ^-- Enable eviction or expiration policies]]
>   [m org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of
> memory in data region [name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0
> MiB, persistenceEnabled=false] Try the following:
>    ^-- Increase maximum off-heap memory size
> (DataRegionConfiguration.maxSize)
>    ^-- Enable Ignite persistence
> (DataRegionConfiguration.persistenceEnabled)
>    ^-- Enable eviction or expiration policies
>   at
>
> org.apache.ignite.internal.processors.cache.persistence.IgniteCacheDatabaseSharedManager.ensureFreeSpaceForInsert(IgniteCacheDatabaseSharedManager.java:1063)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.persistence.RowStore.addRow(RowStore.java:106)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.createRow(IgniteCacheOffheapManagerImpl.java:1746)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.update(GridCacheMapEntry.java:6409)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.call(GridCacheMapEntry.java:6160)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.call(GridCacheMapEntry.java:5849)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.invokeClosure(BPlusTree.java:3817)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.access$5700(BPlusTree.java:3711)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invokeDown(BPlusTree.java:1955)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invoke(BPlusTree.java:1839)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke0(IgniteCacheOffheapManagerImpl.java:1696)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke(IgniteCacheOffheapManagerImpl.java:1679)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:441)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerUpdate(GridCacheMapEntry.java:2314)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateSingle(GridDhtAtomicCache.java:2636)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.update(GridDhtAtomicCache.java:2097)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateAllAsyncInternal0(GridDhtAtomicCache.java:1914)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateAllAsyncInternal(GridDhtAtomicCache.java:1714)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicAbstractUpdateFuture.sendSingleRequest(GridNearAtomicAbstractUpdateFuture.java:300)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFuture.java:486)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicSingleUpdateFuture.mapOnTopology(GridNearAtomicSingleUpdateFuture.java:446)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFuture.java:249)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1164)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.put0(GridDhtAtomicCache.java:624)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.GridCacheAdapter.put(GridCacheAdapter.java:2575)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.GridCacheAdapter.put(GridCacheAdapter.java:2552)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.put(IgniteCacheProxyImpl.java:1302)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.cache.GatewayProtectedCacheProxy.put(GatewayProtectedCacheProxy.java:856)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.platform.client.cache.ClientCachePutRequest.process(ClientCachePutRequest.java:40)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.platform.client.ClientRequestHandler.handle(ClientRequestHandler.java:98)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:195)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:49)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.util.nio.GridNioFilterChain$TailFilter.onMessageReceived(GridNioFilterChain.java:279)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.util.nio.GridNioAsyncNotifyFilter$3.body(GridNioAsyncNotifyFilter.java:97)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> org.apache.ignite.internal.util.worker.GridWorkerPool$1.run(GridWorkerPool.java:70)
> [ignite-core-2.8.0.jar:2.8.0]
>   at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [?:1.8.0_181]
>   at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [?:1.8.0_181]
>   at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
>   [1;31m[2020.09.08 14:27:04.259] [ERROR] [] JVM will be halted immediately
> due to the failure: [failureCtx=FailureContext [type=CRITICAL_ERROR,
> err=class o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data
> region [name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0 MiB,
> persistenceEnabled=false] Try the following:
>    ^-- Increase maximum off-heap memory size
> (DataRegionConfiguration.maxSize)
>    ^-- Enable Ignite persistence
> (DataRegionConfiguration.persistenceEnabled)
>   ^-- Enable eviction or expiration policies]]
>
>
>
>
>
> Is there any way i get only exception and node will not be shutdown??
>
> I will wait for reply
> Thank you so much.
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>