Calculation of Size

[adipro <ad...@zohocorp.com>]

I have persistence enabled. How much size do I need for Off-Heap if I wish
not to have "too many dirty pages" checkpointing?

Our application has many threads which simultaneously write/read data. With
total 1L records in all caches I'm seeing 770MB of size occupied in Off-heap
while running for 1 thread. If more threads run, then we can multiply 770Mb
with number of threads.

If I don't provide Off-heap at all, I'm getting delayed performance.

What should I do and how should I calculate how much Off-heap I need for
better performance?



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Calculation of Size

[Ilya Kasnacheev <il...@gmail.com>]

Hello!

Why do you focus on "too many dirty pages" message? It is purely
informational.

If you wish to avoid that, you need to make sure that less than half of
checkpoint page buffer is ever filled with updates which are pending to the
written to disk, between scheduled checkpoints.

Ideally you should have more off-heap than the amount of data you are
having, this way there will not be page eviction or forced checkpoints.

Regards,
-- 
Ilya Kasnacheev


вс, 17 мая 2020 г. в 16:51, adipro <ad...@zohocorp.com>:

> I have persistence enabled. How much size do I need for Off-Heap if I wish
> not to have "too many dirty pages" checkpointing?
>
> Our application has many threads which simultaneously write/read data. With
> total 1L records in all caches I'm seeing 770MB of size occupied in
> Off-heap
> while running for 1 thread. If more threads run, then we can multiply 770Mb
> with number of threads.
>
> If I don't provide Off-heap at all, I'm getting delayed performance.
>
> What should I do and how should I calculate how much Off-heap I need for
> better performance?
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>