Out of memory

["javastuff.sam@gmail.com" <ja...@gmail.com>]

In my application I have 100s of different caches defined. Some are LOCAL,
NEAR and OFFHEAP, in total all are 10GB and LOCAL are about 1GB. 
Running application with 4GB heap, machine have 48 CPU and 40GB RAM. I am
starting ignite from java code. Under bigger load getting OOM. Attaching
screenshot from heap dump. 

Am I missing anything or need to disable any kind of metrics? I had enabled
task and cache events, which I am planing to disable. 

Any hints will be good.  

Thanks,
-Sam
  
<http://apache-ignite-users.70518.x6.nabble.com/file/n7995/Ignite_OOM.png> 



--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Out-of-memory-tp7995.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Out of memory

[vdpyatkov <vl...@gmail.com>]

Sam,

Could you please provide heap dump from this node and configuration of
caches?


javastuff.sam@gmail.com wrote
> Good to know about future change. I will try your suggestion regarding
> system property. I do not think I will have scenario where insertion and
> deletion of same key happens at the same time. 
> 
> Where can I get more details on this system property? or many such
> internal tweaks.
> 
> BTW all of my cache are marked TRANSACTIONAL, just for the sack of having
> capability of explicit distributed lock. Hoping the system property
> suggested is not only limited for ATOMIC.
> 
> Thanks,
> -Sam





--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Out-of-memory-tp7995p8047.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Out of memory

["javastuff.sam@gmail.com" <ja...@gmail.com>]

Good to know about future change. I will try your suggestion regarding system
property. I do not think I will have scenario where insertion and deletion
of same key happens at the same time. 

BTW all of my cache are marked TRANSACTIONAL, just for the sack of having
capability of explicit distributed lock. Hoping the system property
suggested is not only limited for ATOMIC.

Thanks,
-Sam 



--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Out-of-memory-tp7995p8041.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Out of memory

["javastuff.sam@gmail.com" <ja...@gmail.com>]

Thank you for your reply Den. Many LOCAL cache are less than 10MB, would that
also need overhead of 20-30MB? 

When System is ideal, slowly consuming memory, so is there any
metrics/statistics/JMX being captured regularly which need to be turned off? 

I turned off task and cache events, still same issue. 

Any more hints or tweaks.

Thanks,
-Sam



--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Out-of-memory-tp7995p8026.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.