You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Arunima Barik <ar...@gmail.com> on 2023/07/12 15:19:00 UTC
OOM
I have enabled Page eviction to Random-2-LRU for default region
Still whenever I write a big Spark DataFrame to Ignite
Like spark_df.write.format("ignite")
It is throwing Java OOM error
Why so.. Can anyone please tell me.
Regards
Arunima Barik
Re: OOM
Posted by Ilya Korol <ll...@gmail.com>.
What kind of OOM you've faced? Lack of free memory in data region or in
Java Heap?
Consider to share some logs.
On 12.07.2023 18:19, Arunima Barik wrote:
> I have enabled Page eviction to Random-2-LRU for default region
>
> Still whenever I write a big Spark DataFrame to Ignite
> Like spark_df.write.format("ignite")
> It is throwing Java OOM error
>
> Why so.. Can anyone please tell me.
>
> Regards
> Arunima Barik
Re: OOM
Posted by Stephen Darlington <st...@gridgain.com>.
https://ignite.apache.org/docs/latest/perf-and-troubleshooting/memory-tuning#java-heap-and-gc-tuning
> On 12 Jul 2023, at 17:29, Arunima Barik <ar...@gmail.com> wrote:
>
> java.lang.OutOfMemory
>
> On Wed, 12 Jul, 2023, 8:54 pm Stephen Darlington, <stephen.darlington@gridgain.com <ma...@gridgain.com>> wrote:
>> Is it java.lang.OutOfMemoryException or an IgniteOutOfMemoryException?
>>
>> > On 12 Jul 2023, at 16:19, Arunima Barik <arunimabarik75@gmail.com <ma...@gmail.com>> wrote:
>> >
>> > I have enabled Page eviction to Random-2-LRU for default region
>> >
>> > Still whenever I write a big Spark DataFrame to Ignite
>> > Like spark_df.write.format("ignite")
>> > It is throwing Java OOM error
>> >
>> > Why so.. Can anyone please tell me.
>> >
>> > Regards
>> > Arunima Barik
>>
Re: OOM
Posted by Arunima Barik <ar...@gmail.com>.
java.lang.OutOfMemory
On Wed, 12 Jul, 2023, 8:54 pm Stephen Darlington, <
stephen.darlington@gridgain.com> wrote:
> Is it java.lang.OutOfMemoryException or an IgniteOutOfMemoryException?
>
> > On 12 Jul 2023, at 16:19, Arunima Barik <ar...@gmail.com>
> wrote:
> >
> > I have enabled Page eviction to Random-2-LRU for default region
> >
> > Still whenever I write a big Spark DataFrame to Ignite
> > Like spark_df.write.format("ignite")
> > It is throwing Java OOM error
> >
> > Why so.. Can anyone please tell me.
> >
> > Regards
> > Arunima Barik
>
>
Re: OOM
Posted by Stephen Darlington <st...@gridgain.com>.
Is it java.lang.OutOfMemoryException or an IgniteOutOfMemoryException?
> On 12 Jul 2023, at 16:19, Arunima Barik <ar...@gmail.com> wrote:
>
> I have enabled Page eviction to Random-2-LRU for default region
>
> Still whenever I write a big Spark DataFrame to Ignite
> Like spark_df.write.format("ignite")
> It is throwing Java OOM error
>
> Why so.. Can anyone please tell me.
>
> Regards
> Arunima Barik