You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by mahesh76private <ma...@gmail.com> on 2019/05/23 15:25:42 UTC

apache ignite in client mode - memory leak?

Hi, 

When Ignite is in client mode, it constantly seems to consume 20MB. 
See the below metric, ignite spews out. Please explain.


Metrics for local node (to disable set 'metricsLogFrequency' to 0)
    ^-- Node [id=dba51c3c, uptime=00:56:00.345]
    ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
    ^-- CPU [cur=0.23%, avg=0.65%, GC=0%]
    ^-- PageMemory [pages=0]
    ^-- Heap [used=*1755MB*, free=57.14%, comm=1824MB]
    ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
    ^-- Outbound messages queue [size=0]
    ^-- Public thread pool [active=0, idle=0, qSize=0]
    ^-- System thread pool [active=0, idle=0, qSize=0]
2019-05-23 15:22:06.886  INFO 33 --- [eout-worker-#23]
org.apache.ignite.internal.IgniteKernal  : 
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
    ^-- Node [id=dba51c3c, uptime=00:57:00.348]
    ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
    ^-- CPU [cur=0.27%, avg=0.64%, GC=0%]
    ^-- PageMemory [pages=0]
    ^-- Heap [used=*1774MB*, free=56.68%, comm=1824MB]
    ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
    ^-- Outbound messages queue [size=0]
    ^-- Public thread pool [active=0, idle=0, qSize=0]
    ^-- System thread pool [active=0, idle=0, qSize=0]
2019-05-23 15:23:07.019  INFO 33 --- [eout-worker-#23]
org.apache.ignite.internal.IgniteKernal  : 
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
    ^-- Node [id=dba51c3c, uptime=00:58:00.350]
    ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
    ^-- CPU [cur=0.23%, avg=0.63%, GC=0%]
    ^-- PageMemory [pages=0]
    ^-- Heap [used=*1793MB*, free=56.21%, comm=1824MB]
    ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
    ^-- Outbound messages queue [size=0]
    ^-- Public thread pool [active=0, idle=0, qSize=0]
    ^-- System thread pool [active=0, idle=0, qSize=0]




--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: apache ignite in client mode - memory leak?

Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!

Please also collect heap histogram of classes. It is most likely that leak
is outside of Ignite.

Regards,
-- 
Ilya Kasnacheev


вс, 26 мая 2019 г. в 07:20, mahesh76private <ma...@gmail.com>:

> This doesn't look like a ignite memory optimization. A steady consumption
> of
> 20MB till it exhausts the memory allocated via -XMX, followed by a GC, is
> continuously happening. Doesn't feel like you should ignore it, unless
> ignite has a good reason behind it.
>
> Moreover, this is happening on a node, configured as a client.
>
> I will take GC logs
>
> regards
> mahesh
>
>
>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: apache ignite in client mode - memory leak?

Posted by mahesh76private <ma...@gmail.com>.
This doesn't look like a ignite memory optimization. A steady consumption of
20MB till it exhausts the memory allocated via -XMX, followed by a GC, is
continuously happening. Doesn't feel like you should ignore it, unless
ignite has a good reason behind it. 

Moreover, this is happening on a node, configured as a client. 

I will take GC logs

regards
mahesh







--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: apache ignite in client mode - memory leak?

Posted by Denis Magda <dm...@apache.org>.
Is it a big deal? Ignite might use extra space for internal needs to
optimize performance and response time. As long as the memory consumption
is low and that's not a memory leak, I wouldn't pay much attention to this.


-
Denis


On Thu, May 23, 2019 at 8:33 AM mahesh76private <ma...@gmail.com>
wrote:

> >>What happens if you trigger garbage collection?
> It frees up some amount of memory then continues to increase (as shown in
> earlier message)
>
>
> Haven't taken GC logs. is there a quick way to take these?
>
>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: apache ignite in client mode - memory leak?

Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!

https://gceasy.io/ - please refer to "How it works?" section.

Regards,
-- 
Ilya Kasnacheev


чт, 23 мая 2019 г. в 18:33, mahesh76private <ma...@gmail.com>:

> >>What happens if you trigger garbage collection?
> It frees up some amount of memory then continues to increase (as shown in
> earlier message)
>
>
> Haven't taken GC logs. is there a quick way to take these?
>
>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: apache ignite in client mode - memory leak?

Posted by mahesh76private <ma...@gmail.com>.
>>What happens if you trigger garbage collection?
It frees up some amount of memory then continues to increase (as shown in
earlier message)


Haven't taken GC logs. is there a quick way to take these?






--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: apache ignite in client mode - memory leak?

Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!

Do you have GC logs? What happens if you trigger garbage collection?

Regards,
-- 
Ilya Kasnacheev


чт, 23 мая 2019 г. в 18:25, mahesh76private <ma...@gmail.com>:

> Hi,
>
> When Ignite is in client mode, it constantly seems to consume 20MB.
> See the below metric, ignite spews out. Please explain.
>
>
> Metrics for local node (to disable set 'metricsLogFrequency' to 0)
>     ^-- Node [id=dba51c3c, uptime=00:56:00.345]
>     ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
>     ^-- CPU [cur=0.23%, avg=0.65%, GC=0%]
>     ^-- PageMemory [pages=0]
>     ^-- Heap [used=*1755MB*, free=57.14%, comm=1824MB]
>     ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
>     ^-- Outbound messages queue [size=0]
>     ^-- Public thread pool [active=0, idle=0, qSize=0]
>     ^-- System thread pool [active=0, idle=0, qSize=0]
> 2019-05-23 15:22:06.886  INFO 33 --- [eout-worker-#23]
> org.apache.ignite.internal.IgniteKernal  :
> Metrics for local node (to disable set 'metricsLogFrequency' to 0)
>     ^-- Node [id=dba51c3c, uptime=00:57:00.348]
>     ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
>     ^-- CPU [cur=0.27%, avg=0.64%, GC=0%]
>     ^-- PageMemory [pages=0]
>     ^-- Heap [used=*1774MB*, free=56.68%, comm=1824MB]
>     ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
>     ^-- Outbound messages queue [size=0]
>     ^-- Public thread pool [active=0, idle=0, qSize=0]
>     ^-- System thread pool [active=0, idle=0, qSize=0]
> 2019-05-23 15:23:07.019  INFO 33 --- [eout-worker-#23]
> org.apache.ignite.internal.IgniteKernal  :
> Metrics for local node (to disable set 'metricsLogFrequency' to 0)
>     ^-- Node [id=dba51c3c, uptime=00:58:00.350]
>     ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
>     ^-- CPU [cur=0.23%, avg=0.63%, GC=0%]
>     ^-- PageMemory [pages=0]
>     ^-- Heap [used=*1793MB*, free=56.21%, comm=1824MB]
>     ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
>     ^-- Outbound messages queue [size=0]
>     ^-- Public thread pool [active=0, idle=0, qSize=0]
>     ^-- System thread pool [active=0, idle=0, qSize=0]
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>