You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by arthi <Ar...@nielsen.com> on 2016/04/26 02:29:33 UTC

Cluster Stopped when no activity for hours

Hi Team,

I have a ignite cluster with 11 nodes, and I have four partitioned caches
all using off heap memory.
I want to load several GBs of data into the caches (each node is 256GB RAM).
I use loadCache API to load, and it takes a lot of time to load the data
into cache.

I leave the cluster as is at night (my timeout!), and try to log in the next
day, all the nodes are stopped!

I only see these in the work logs, and was not sure if this is a setting
issue or something -
[20:06:43,854][INFO ][Thread-2][G] Invoking shutdown hook...
[20:06:43,860][INFO ][Thread-2][GridTcpRestProtocol] Command protocol
successfully stopped: TCP binary
[20:06:46,462][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
ignite-marshaller-sys-cache
[20:06:46,462][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
ignite-sys-cache
[20:06:46,463][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
ignite-atomics-sys-cache
[20:06:46,463][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
TOP_SHOP_DATA_CACHE
[20:06:46,463][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
PROD_HIER_CACHE
[20:06:46,463][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
MARKET_POD_ACV_CACHE
[20:06:46,464][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
SHOP_ITEM_BITMAP_CACHE
[20:06:46,757][INFO ][Thread-2][IgniteKernal%cip]

>>> +---------------------------------------------------------------------------------------+
>>> Ignite ver.
>>> 1.5.0-final#20151229-sha1:f1f8cda2f3f62231f42a59951bf34c39577c1bec
>>> stopped OK
>>> +---------------------------------------------------------------------------------------+
>>> Grid name: cip
>>> Grid uptime: 07:32:12:877

Here is my config file -
cip-ignite-client.xml
<http://apache-ignite-users.70518.x6.nabble.com/file/n4519/cip-ignite-client.xml>  

Thanks,
Arthi




--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cluster-Stopped-when-no-activity-for-hours-tp4519.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Cluster Stopped when no activity for hours

Posted by Dmitriy Setrakyan <ds...@apache.org>.
Something is causing your nodes to stop. Do the servers enter a hibernation
state of some sort? Or maybe rebooted overnight?

On Mon, Apr 25, 2016 at 5:29 PM, arthi <Ar...@nielsen.com>
wrote:

> Hi Team,
>
> I have a ignite cluster with 11 nodes, and I have four partitioned caches
> all using off heap memory.
> I want to load several GBs of data into the caches (each node is 256GB
> RAM).
> I use loadCache API to load, and it takes a lot of time to load the data
> into cache.
>
> I leave the cluster as is at night (my timeout!), and try to log in the
> next
> day, all the nodes are stopped!
>
> I only see these in the work logs, and was not sure if this is a setting
> issue or something -
> [20:06:43,854][INFO ][Thread-2][G] Invoking shutdown hook...
> [20:06:43,860][INFO ][Thread-2][GridTcpRestProtocol] Command protocol
> successfully stopped: TCP binary
> [20:06:46,462][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
> ignite-marshaller-sys-cache
> [20:06:46,462][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
> ignite-sys-cache
> [20:06:46,463][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
> ignite-atomics-sys-cache
> [20:06:46,463][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
> TOP_SHOP_DATA_CACHE
> [20:06:46,463][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
> PROD_HIER_CACHE
> [20:06:46,463][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
> MARKET_POD_ACV_CACHE
> [20:06:46,464][INFO ][Thread-2][GridCacheProcessor] Stopped cache:
> SHOP_ITEM_BITMAP_CACHE
> [20:06:46,757][INFO ][Thread-2][IgniteKernal%cip]
>
> >>>
> +---------------------------------------------------------------------------------------+
> >>> Ignite ver.
> >>> 1.5.0-final#20151229-sha1:f1f8cda2f3f62231f42a59951bf34c39577c1bec
> >>> stopped OK
> >>>
> +---------------------------------------------------------------------------------------+
> >>> Grid name: cip
> >>> Grid uptime: 07:32:12:877
>
> Here is my config file -
> cip-ignite-client.xml
> <
> http://apache-ignite-users.70518.x6.nabble.com/file/n4519/cip-ignite-client.xml
> >
>
> Thanks,
> Arthi
>
>
>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/Cluster-Stopped-when-no-activity-for-hours-tp4519.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>