You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by KR Kumar <ig...@gmail.com> on 2019/06/23 10:36:02 UTC
too many dirty pages
Hi - I have ignite persistence enabled cache that has about 100 cache tables
that i created using Ignite SQL. When I am writing data ( lot of data ) in
these tables, I see these warnings in the logs and writes hang for some time
and then resume.
[2019-06-23 10:12:47,647][INFO
][db-checkpoint-thread-#144][GridCacheDatabaseSharedManager] Checkpoint
started [checkpointId=d067e58d-d62d-4914-9ce8-531369e08c33,
startPtr=FileWALPointer [idx=214, fileOff=1199995119, len=2123305],
checkpointLockWait=0ms, checkpointLockHoldTime=1727ms,
walCpRecordFsyncDuration=2305ms, pages=304819, reason='too many dirty
pages']
Any pointers, please let me know ??
Thanx and Regards,
KR Kumar
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: too many dirty pages
Posted by Evgenii Zhuravlev <e....@gmail.com>.
Hi,
It's not a warning, it's just an INFO message about writing checkpoint to
the disk. The reason for this checkpoint was that there were "too many
dirty pages". Here is how Ignite persistence works:
https://cwiki.apache.org/confluence/display/IGNITE/Ignite+Persistent+Store+-+under+the+hood
Best Regards,
Evgenii
вс, 23 июн. 2019 г. в 13:36, KR Kumar <ig...@gmail.com>:
> Hi - I have ignite persistence enabled cache that has about 100 cache
> tables
> that i created using Ignite SQL. When I am writing data ( lot of data ) in
> these tables, I see these warnings in the logs and writes hang for some
> time
> and then resume.
>
> [2019-06-23 10:12:47,647][INFO
> ][db-checkpoint-thread-#144][GridCacheDatabaseSharedManager] Checkpoint
> started [checkpointId=d067e58d-d62d-4914-9ce8-531369e08c33,
> startPtr=FileWALPointer [idx=214, fileOff=1199995119, len=2123305],
> checkpointLockWait=0ms, checkpointLockHoldTime=1727ms,
> walCpRecordFsyncDuration=2305ms, pages=304819, reason='too many dirty
> pages']
>
> Any pointers, please let me know ??
>
> Thanx and Regards,
> KR Kumar
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Re: too many dirty pages
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
If you see writes hang after seeing this message, it means that your
checkpoint page buffer gets exhaused. Consider increasing it:
https://apacheignite.readme.io/docs/durable-memory-tuning#section-checkpointing-buffer-size
Regards,
--
Ilya Kasnacheev
вс, 23 июн. 2019 г. в 13:36, KR Kumar <ig...@gmail.com>:
> Hi - I have ignite persistence enabled cache that has about 100 cache
> tables
> that i created using Ignite SQL. When I am writing data ( lot of data ) in
> these tables, I see these warnings in the logs and writes hang for some
> time
> and then resume.
>
> [2019-06-23 10:12:47,647][INFO
> ][db-checkpoint-thread-#144][GridCacheDatabaseSharedManager] Checkpoint
> started [checkpointId=d067e58d-d62d-4914-9ce8-531369e08c33,
> startPtr=FileWALPointer [idx=214, fileOff=1199995119, len=2123305],
> checkpointLockWait=0ms, checkpointLockHoldTime=1727ms,
> walCpRecordFsyncDuration=2305ms, pages=304819, reason='too many dirty
> pages']
>
> Any pointers, please let me know ??
>
> Thanx and Regards,
> KR Kumar
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>