You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Olexandr K <ol...@gmail.com> on 2018/06/20 08:39:07 UTC

No writes to WAL files for the whole day?

Hi Ignite team,

I noticed that nothing is written into WAL files even on Ignite restart.

My testing steps:

1) bounce application and ignite cluster
2) perform load testing
3) bounce application and ignite cluster
4) check ignite files:

data files have recent modification time - OK

latest WAL file was modified yesterday... Why? Is it expected / explainable?

PS F:\ignite-wal\V_HP_LK_DCN01> ls
Mode                LastWriteTime     Length Name
----                -------------     ------ ----
-a---         6/15/2018   2:21 PM   67108864 0000000000000000.wal
-a---         6/15/2018   3:27 PM   67108864 0000000000000001.wal
-a---         6/15/2018   3:44 PM   67108864 0000000000000002.wal
-a---         6/16/2018   1:18 AM   67108864 0000000000000003.wal
-a---         6/18/2018   6:35 PM   67108864 0000000000000004.wal
-a---         6/18/2018   9:30 PM   67108864 0000000000000005.wal
-a---         6/19/2018  12:05 AM   67108864 0000000000000006.wal
-a---         6/19/2018  12:49 AM   67108864 0000000000000007.wal
-a---         6/19/2018   1:42 AM   67108864 0000000000000008.wal
-a---         6/19/2018   2:50 PM   67108864 0000000000000009.wal

BR, Oleksandr

Re: No writes to WAL files for the whole day?

Posted by Olexandr K <ol...@gmail.com>.
Yes, you are right, hashes for 00.wal and 01.wal are different before/after
load test
(last-modified-time still showing june 15th)

BEFORE

PS F:\ignite-wal\V_HP_LK_DCN01> get-filehash .\*

Algorithm       Hash
---------       ----
SHA256
40A373D58ADF4C9E15B3F0969ED3B5E4D52AC24BC807AD9C8EE4F92982B71925
SHA256
DE2B96517256C844524CD9A1C4ED8EDE18FA92440C348A762DE96A3CA6AAFC89
SHA256
9077E6ED38B77E142C65AD4125717A7630D90FC402F0CDFBC7FBF95660C21016
...

PS F:\ignite-wal\V_HP_LK_DCN01> ls

Mode                LastWriteTime     Length Name
----                -------------     ------ ----
-a---         6/15/2018   2:21 PM   67108864 0000000000000000.wal
-a---         6/15/2018   3:27 PM   67108864 0000000000000001.wal
-a---         6/15/2018   3:44 PM   67108864 0000000000000002.wal
...

AFTER

PS F:\ignite-wal\V_HP_LK_DCN01> get-filehash .\*

Algorithm       Hash
---------       ----
SHA256
B7CA93C0FEEE94CD60C468F615E2C16B009DF13AD3F799DAC5A8CAB1A6E3438D
SHA256
E3290E24F2C7F9967A6FD800466ECE6382BBC969274C6C1B49A1119C2B3ECE29
SHA256
9077E6ED38B77E142C65AD4125717A7630D90FC402F0CDFBC7FBF95660C21016
...

PS F:\ignite-wal\V_HP_LK_DCN01> ls

Mode                LastWriteTime     Length Name
----                -------------     ------ ----
-a---         6/15/2018   2:21 PM   67108864 0000000000000000.wal
-a---         6/15/2018   3:27 PM   67108864 0000000000000001.wal
-a---         6/15/2018   3:44 PM   67108864 0000000000000002.wal
...


On Wed, Jun 20, 2018 at 1:12 PM, dkarachentsev <dk...@gridgain.com>
wrote:

> I suppose that is issue with updating timestamps, rather with WAL writes.
> Try to make a load test and compare hash sum of files before load test and
> after. Also check if WAL history grow.
>
> Thanks!
> -Dmitry
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: No writes to WAL files for the whole day?

Posted by dkarachentsev <dk...@gridgain.com>.
I suppose that is issue with updating timestamps, rather with WAL writes.
Try to make a load test and compare hash sum of files before load test and
after. Also check if WAL history grow.

Thanks!
-Dmitry



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: No writes to WAL files for the whole day?

Posted by Olexandr K <ol...@gmail.com>.
WAL mode is default one, all caches are FULL_ASYNC

...and now I see one of my Ignite servers updated WAL files but other one
still have 19th last-modification-time
it looks like WAL files are updated once per day

<bean class="org.apache.ignite.configuration.CacheConfiguration">
                    <property name="name" value="RefreshToken"/>
                    <property name="dataRegionName"
value="auth_durable_region"/>
                    <property name="atomicityMode" value="ATOMIC"/>
                    <property name="writeSynchronizationMode"
value="FULL_ASYNC"/>
                    <property name="cacheMode" value="PARTITIONED"/>
                    <property name="backups" value="1"/>
                    <property name="eagerTtl" value="true"/>
                </bean>

here is my data storage config:

<property name="dataStorageConfiguration">
            <bean
class="org.apache.ignite.configuration.DataStorageConfiguration">
                <property name="metricsEnabled" value="true" />
                <property name="storagePath" value="d:\\ignite-data"/>
                <property name="walPath" value="f:\\ignite-wal"/>
                <property name="walArchivePath"
value="f:\\ignite-wal\\archive"/>
                <property name="defaultDataRegionConfiguration">
                    <bean
class="org.apache.ignite.configuration.DataRegionConfiguration">
                        <property name="name" value="default_mem_region"/>
                        <property name="persistenceEnabled" value="false"/>
                        <property name="maxSize" value="#{4L * 1024 * 1024
* 1024}"/> <!-- 4 GB -->
                        <property name="metricsEnabled" value="true" />
                    </bean>
                </property>
                <property name="dataRegionConfigurations">
                    <list>
                        <bean
class="org.apache.ignite.configuration.DataRegionConfiguration">
                            <property name="name"
value="auth_durable_region"/>
                            <property name="persistenceEnabled"
value="true"/>
                            <property name="maxSize" value="#{4L * 1024 *
1024 * 1024}"/> <!-- 4 GB -->
                            <property name="metricsEnabled" value="true"
/>
                        </bean>
                    </list>
                </property>
            </bean>
        </property>


On Wed, Jun 20, 2018 at 11:51 AM, dkarachentsev <dk...@gridgain.com>
wrote:

> Hi,
>
> What is your configuration? Check WAL mode and path to persistence.
>
> Thanks!
> -Dmitry
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: No writes to WAL files for the whole day?

Posted by dkarachentsev <dk...@gridgain.com>.
Hi,

What is your configuration? Check WAL mode and path to persistence.

Thanks!
-Dmitry



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/