You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by rihan123 <ri...@gmail.com> on 2020/12/04 11:31:56 UTC
WAL is growing exponentially
Hi
I am doing POC to see if Ignite is good for my usecase and i achieved
required data ingestion rate but after ingesting huge data i am seeing WAL
disk is growing exponentially.
To check the number of records ingested i just connected to visor after this
i saw WAL is growing exponentially.
There are lot of messeges like this --
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=c1f85a50-c218-4e38-a692-0aa87380d295, timestamp=1606979161926,
ptr=FileWALPointer [idx=1427, fileOff=51216143, len=9667]], history map size
is 4
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=c1f85a50-c218-4e38-a692-0aa87380d295, timestamp=1606979161926,
ptr=FileWALPointer [idx=1427, fileOff=51216143, len=9667]], history map size
is 5
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=c1f85a50-c218-4e38-a692-0aa87380d295, timestamp=1606979161926,
ptr=FileWALPointer [idx=1427, fileOff=51216143, len=9667]], history map size
is 6
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=c1f85a50-c218-4e38-a692-0aa87380d295, timestamp=1606979161926,
ptr=FileWALPointer [idx=1427, fileOff=51216143, len=9667]], history map size
is 7
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=5b4cfe31-99e6-4c00-b306-9c590df8fdfb, timestamp=1606979174328,
ptr=FileWALPointer [idx=1520, fileOff=59350658, len=10066]], history map
size is 2
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=5b4cfe31-99e6-4c00-b306-9c590df8fdfb, timestamp=1606979174328,
ptr=FileWALPointer [idx=1520, fileOff=59350658, len=10066]], history map
size is 4
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=5b4cfe31-99e6-4c00-b306-9c590df8fdfb, timestamp=1606979174328,
ptr=FileWALPointer [idx=1520, fileOff=59350658, len=10066]], history map
size is 5
Any suggestions on this issue is greatly appreciated
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
RE: WAL is growing exponentially
Posted by Alexandr Shapkin <le...@gmail.com>.
Hi,
What version do you use?
Is it possible to share the full log files?
**From:**[rihan123](mailto:rihaanhussain143@gmail.com)
**Sent:** Friday, December 4, 2020 2:32 PM
**To:**[user@ignite.apache.org](mailto:user@ignite.apache.org)
**Subject:** WAL is growing exponentially
Hi
I am doing POC to see if Ignite is good for my usecase and i achieved
required data ingestion rate but after ingesting huge data i am seeing WAL
disk is growing exponentially.
To check the number of records ingested i just connected to visor after this
i saw WAL is growing exponentially.
There are lot of messeges like this --
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=c1f85a50-c218-4e38-a692-0aa87380d295, timestamp=1606979161926,
ptr=FileWALPointer [idx=1427, fileOff=51216143, len=9667]], history map size
is 4
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=c1f85a50-c218-4e38-a692-0aa87380d295, timestamp=1606979161926,
ptr=FileWALPointer [idx=1427, fileOff=51216143, len=9667]], history map size
is 5
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=c1f85a50-c218-4e38-a692-0aa87380d295, timestamp=1606979161926,
ptr=FileWALPointer [idx=1427, fileOff=51216143, len=9667]], history map size
is 6
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=c1f85a50-c218-4e38-a692-0aa87380d295, timestamp=1606979161926,
ptr=FileWALPointer [idx=1427, fileOff=51216143, len=9667]], history map size
is 7
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=5b4cfe31-99e6-4c00-b306-9c590df8fdfb, timestamp=1606979174328,
ptr=FileWALPointer [idx=1520, fileOff=59350658, len=10066]], history map
size is 2
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=5b4cfe31-99e6-4c00-b306-9c590df8fdfb, timestamp=1606979174328,
ptr=FileWALPointer [idx=1520, fileOff=59350658, len=10066]], history map
size is 4
Could not clear historyMap due to WAL reservation on cp: CheckpointEntry
[id=5b4cfe31-99e6-4c00-b306-9c590df8fdfb, timestamp=1606979174328,
ptr=FileWALPointer [idx=1520, fileOff=59350658, len=10066]], history map
size is 5
Any suggestions on this issue is greatly appreciated
\--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/