You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Naveen <na...@gmail.com> on 2017/12/15 12:24:48 UTC
Trying to pass memory arguments to Ignite.sh - ./bin/ignite.sh -J
-Xms2g -Xmx10g -v config/IgnitePOC-NoCacheInfo.xml
Hi
Am using 2.3
I am trying to run some tests with eviction, seems eviction only works when
we use on-heap memory, so I was trying to keep 1 million records in on-heap
and start evicting.
Getting GC overlimit exceeded, so trying to increase heap by passing memory
arguments to ignite.sh
./bin/ignite.sh -J -Xms2g -Xmx10g -v config/IgnitePOC-NoCacheInfo.xml
Ignite Command Line Startup, ver. 2.3.0#20171028-sha1:8add7fd5
2017 Copyright(C) Apache Software Foundation
[17:44:42,359][INFO][main][IgniteKernal%IgnitePOC]
>>> __________ ________________
>>> / _/ ___/ |/ / _/_ __/ __/
>>> _/ // (7 7 // / / / / _/
>>> /___/\___/_/|_/___/ /_/ /___/
>>>
>>> ver. 2.3.0#20171028-sha1:8add7fd5
>>> 2017 Copyright(C) Apache Software Foundation
>>>
>>> Ignite documentation: http://ignite.apache.org
[17:44:42,360][INFO][main][IgniteKernal%IgnitePOC] Config URL:
file:/app/Ignite/apache-ignite-fabric-2.3.0-bin/config/IgnitePOC-NoCacheInfo.xml
[17:44:42,360][INFO][main][IgniteKernal%IgnitePOC] Daemon mode: off
[17:44:42,361][INFO][main][IgniteKernal%IgnitePOC] OS: Linux
3.10.0-693.11.1.el7.x86_64 amd64
[17:44:42,361][INFO][main][IgniteKernal%IgnitePOC] OS user: tibusr
[17:44:42,361][INFO][main][IgniteKernal%IgnitePOC] PID: 49645
[17:44:42,362][INFO][main][IgniteKernal%IgnitePOC] Language runtime: Java
Platform API Specification ver. 1.8
[17:44:42,362][INFO][main][IgniteKernal%IgnitePOC] VM information: Java(TM)
SE Runtime Environment 1.8.0_151-b12 Oracle Corporation Java HotSpot(TM)
64-Bit Server VM 25.151-b12
[17:44:42,365][INFO][main][IgniteKernal%IgnitePOC] VM total memory: 0.96GB
[17:44:42,366][INFO][main][IgniteKernal%IgnitePOC] Remote Management
[restart: on, REST: on, JMX (remote: on, port: 49170, auth: off, ssl: off)]
[17:44:42,370][INFO][main][IgniteKernal%IgnitePOC]
IGNITE_HOME=/app/Ignite/apache-ignite-fabric-2.3.0-bin
[17:44:42,371][INFO][main][IgniteKernal%IgnitePOC] VM arguments: [-Xms1g,
-Xmx1g, -XX:+AggressiveOpts, -XX:MaxMetaspaceSize=256m,
-DIGNITE_QUIET=false,
-DIGNITE_SUCCESS_FILE=/app/Ignite/apache-ignite-fabric-2.3.0-bin/work/ignite_success_ec19c42f-0af0-41ce-ad12-40dcaa883b95,
-Dcom.sun.management.jmxremote, -Dcom.sun.management.jmxremote.port=49170,
-Dcom.sun.management.jmxremote.authenticate=false,
-Dcom.sun.management.jmxremote.ssl=false,
-DIGNITE_HOME=/app/Ignite/apache-ignite-fabric-2.3.0-bin,
-DIGNITE_PROG_NAME=./bin/ignite.sh]
[17:44:42,371][INFO][main][IgniteKernal%IgnitePOC] System cache's DataRegion
size is configured to 40 MB. Use
DataStorageConfiguration.systemCacheMemorySize property to change the
setting.
How did it decide that total VM memory is 0.96GB. Its a 30GB VM and below is
the free -h output
*[17:44:42,365][INFO][main][IgniteKernal%IgnitePOC] VM total memory: 0.96GB*
[tibusr@JMNGD1BAQ10V03 apache-ignite-fabric-2.3.0-bin]$ free -h
total used free shared buff/cache
available
Mem: 30G 620M 27G 1.1G 3.0G
28G
Swap: 0B 0B 0B
[tibusr@JMNGD1BAQ10V03 apache-ignite-fabric-2.3.0-bin]$
This is the log snippet, why the heap is not getting changed though I am
passing -Xms and -Xmx arguments.
>>> CPU(s): 8
>>> Heap: 1.0GB
>>> VM name: 49645@JMNGD1BAQ10V03
>>> Ignite instance name: IgnitePOC
Anything wrong I am doing.
Thanks
Naveen
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Trying to pass memory arguments to Ignite.sh - ./bin/ignite.sh -J
-Xms2g -Xmx10g -v config/IgnitePOC-NoCacheInfo.xml
Posted by Denis Magda <dm...@apache.org>.
Naveen,
The off-heap memory supports following page-based eviction policies:
https://apacheignite.readme.io/docs/evictions#section-off-heap-memory <https://apacheignite.readme.io/docs/evictions#section-off-heap-memory>
Do you really need the on-heap caching option in Ignite?
https://apacheignite.readme.io/docs/memory-configuration#section-on-heap-caching <https://apacheignite.readme.io/docs/memory-configuration#section-on-heap-caching>
The on-heap caching is optional and I’m not sure you use it.
All the data and indexes are stored in the off-heap page memory. By default, Java heap is used to store temporary objects generated by your app and Ignite in runtime (unless you enable the on-heap caching).
—
Denis
> On Dec 15, 2017, at 4:24 AM, Naveen <na...@gmail.com> wrote:
>
> Hi
>
> Am using 2.3
> I am trying to run some tests with eviction, seems eviction only works when
> we use on-heap memory, so I was trying to keep 1 million records in on-heap
> and start evicting.
> Getting GC overlimit exceeded, so trying to increase heap by passing memory
> arguments to ignite.sh
>
> ./bin/ignite.sh -J -Xms2g -Xmx10g -v config/IgnitePOC-NoCacheInfo.xml
>
> Ignite Command Line Startup, ver. 2.3.0#20171028-sha1:8add7fd5
> 2017 Copyright(C) Apache Software Foundation
>
> [17:44:42,359][INFO][main][IgniteKernal%IgnitePOC]
>
>>>> __________ ________________
>>>> / _/ ___/ |/ / _/_ __/ __/
>>>> _/ // (7 7 // / / / / _/
>>>> /___/\___/_/|_/___/ /_/ /___/
>>>>
>>>> ver. 2.3.0#20171028-sha1:8add7fd5
>>>> 2017 Copyright(C) Apache Software Foundation
>>>>
>>>> Ignite documentation: http://ignite.apache.org
>
> [17:44:42,360][INFO][main][IgniteKernal%IgnitePOC] Config URL:
> file:/app/Ignite/apache-ignite-fabric-2.3.0-bin/config/IgnitePOC-NoCacheInfo.xml
> [17:44:42,360][INFO][main][IgniteKernal%IgnitePOC] Daemon mode: off
> [17:44:42,361][INFO][main][IgniteKernal%IgnitePOC] OS: Linux
> 3.10.0-693.11.1.el7.x86_64 amd64
> [17:44:42,361][INFO][main][IgniteKernal%IgnitePOC] OS user: tibusr
> [17:44:42,361][INFO][main][IgniteKernal%IgnitePOC] PID: 49645
> [17:44:42,362][INFO][main][IgniteKernal%IgnitePOC] Language runtime: Java
> Platform API Specification ver. 1.8
> [17:44:42,362][INFO][main][IgniteKernal%IgnitePOC] VM information: Java(TM)
> SE Runtime Environment 1.8.0_151-b12 Oracle Corporation Java HotSpot(TM)
> 64-Bit Server VM 25.151-b12
> [17:44:42,365][INFO][main][IgniteKernal%IgnitePOC] VM total memory: 0.96GB
> [17:44:42,366][INFO][main][IgniteKernal%IgnitePOC] Remote Management
> [restart: on, REST: on, JMX (remote: on, port: 49170, auth: off, ssl: off)]
> [17:44:42,370][INFO][main][IgniteKernal%IgnitePOC]
> IGNITE_HOME=/app/Ignite/apache-ignite-fabric-2.3.0-bin
> [17:44:42,371][INFO][main][IgniteKernal%IgnitePOC] VM arguments: [-Xms1g,
> -Xmx1g, -XX:+AggressiveOpts, -XX:MaxMetaspaceSize=256m,
> -DIGNITE_QUIET=false,
> -DIGNITE_SUCCESS_FILE=/app/Ignite/apache-ignite-fabric-2.3.0-bin/work/ignite_success_ec19c42f-0af0-41ce-ad12-40dcaa883b95,
> -Dcom.sun.management.jmxremote, -Dcom.sun.management.jmxremote.port=49170,
> -Dcom.sun.management.jmxremote.authenticate=false,
> -Dcom.sun.management.jmxremote.ssl=false,
> -DIGNITE_HOME=/app/Ignite/apache-ignite-fabric-2.3.0-bin,
> -DIGNITE_PROG_NAME=./bin/ignite.sh]
> [17:44:42,371][INFO][main][IgniteKernal%IgnitePOC] System cache's DataRegion
> size is configured to 40 MB. Use
> DataStorageConfiguration.systemCacheMemorySize property to change the
> setting.
>
> How did it decide that total VM memory is 0.96GB. Its a 30GB VM and below is
> the free -h output
> *[17:44:42,365][INFO][main][IgniteKernal%IgnitePOC] VM total memory: 0.96GB*
>
>
> [tibusr@JMNGD1BAQ10V03 apache-ignite-fabric-2.3.0-bin]$ free -h
> total used free shared buff/cache
> available
> Mem: 30G 620M 27G 1.1G 3.0G
> 28G
> Swap: 0B 0B 0B
> [tibusr@JMNGD1BAQ10V03 apache-ignite-fabric-2.3.0-bin]$
>
> This is the log snippet, why the heap is not getting changed though I am
> passing -Xms and -Xmx arguments.
>
>>>> CPU(s): 8
>>>> Heap: 1.0GB
>>>> VM name: 49645@JMNGD1BAQ10V03
>>>> Ignite instance name: IgnitePOC
>
> Anything wrong I am doing.
>
> Thanks
> Naveen
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Trying to pass memory arguments to Ignite.sh - ./bin/ignite.sh
-J -Xms2g -Xmx10g -v config/IgnitePOC-NoCacheInfo.xml
Posted by afedotov <al...@gmail.com>.
Hi,
Yes, you are right. Probably -J"-Xms4g -Xmx8g" should have worked too.
Kind regards,
Alex
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Trying to pass memory arguments to Ignite.sh - ./bin/ignite.sh
-J -Xms2g -Xmx10g -v config/IgnitePOC-NoCacheInfo.xml
Posted by Naveen <na...@gmail.com>.
It worked after changing like
./bin/ignite.sh -J-Xms4g -J-Xmx8g -v config/IgnitePOC-NoCacheInfo.xml
>>> +----------------------------------------------------------------------+
>>> Ignite ver. 2.3.0#20171028-sha1:8add7fd5b501b40658096cdde48af9e948aa8150
>>> +----------------------------------------------------------------------+
>>> OS name: Linux 3.10.0-693.11.1.el7.x86_64 amd64
>>> CPU(s): 8
>>> Heap: 7.1GB
>>> VM name: 18748@JMNGD1BAQ10V03
>>> Ignite instance name: IgnitePOC
>>> Local node [ID=2BE67400-4537-43B3-9320-6A29F9704DA4, order=1,
>>> clientMode=false]
>>> Local node addresses: [172.17.0.1/0:0:0:0:0:0:0:1%lo,
>>> 2405:200:a70:f651:250:56ff:feb4:237b%eno16780032/10.144.114.113,
>>> JMNGD1BAQ10V03/127.0.0.1, /172.17.0.1,
>>> /2405:200:a70:f651:250:56ff:feb4:237b%eno16780032]
>>> Local ports: TCP:8080 TCP:10800 TCP:11211 TCP:47100 TCP:47500
[19:28:36,955][INFO][main][GridDiscoveryManager] Topology snapshot [ver=1,
servers=1, clients=0, CPUs=8, heap=7.1GB]
I could see heap getting reflected..
Thanks
Naveen
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/