You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by "Orel Weinstock (ExposeBox)" <or...@exposebox.com> on 2018/08/06 15:00:39 UTC
MySQL cache load causes java.sql.SQLException: GC overhead limit exceeded
Hi all,
Changing the MAIN_CLASS env variable and tweaking the default heap size
(2.7GB) and default data region size (8GB), I'm trying to load a small
(<4GB) MySQL table into the cache and get a GC overhead limit error. Should
I increase memory? Is there a configuration I'm missing?
Thanks,
--
--
*Orel Weinstock*
Software Engineer
Email: orel@exposebox.com <ro...@exposebox.com>
Website: www.exposebox.com
Re: MySQL cache load causes java.sql.SQLException: GC overhead limit exceeded
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
We will be glad to hear if you will gather more details about the issue.
Regards,
--
Ilya Kasnacheev
2018-08-07 22:35 GMT+03:00 Orel Weinstock (ExposeBox) <or...@exposebox.com>:
> I've used the web-console generated LoadCaches file. From what I
> understand, looking at the source code, this is not supposed to keep it
> on-heap at all (and I've supplied ample off-heap space).
>
> It "just worked" with a HUGE memory allocation, but I will optimize it
> later.
>
> On 7 August 2018 at 17:16, Ilya Kasnacheev <il...@gmail.com>
> wrote:
>
>> Hello!
>>
>> This is likely caused by trying to keep all the table data in memory
>> during data load. Can you share your code so that we could take a look?
>>
>> Regards,
>>
>>
>> --
>> Ilya Kasnacheev
>>
>> 2018-08-06 18:00 GMT+03:00 Orel Weinstock (ExposeBox) <orel@exposebox.com
>> >:
>>
>>> Hi all,
>>>
>>> Changing the MAIN_CLASS env variable and tweaking the default heap size
>>> (2.7GB) and default data region size (8GB), I'm trying to load a small
>>> (<4GB) MySQL table into the cache and get a GC overhead limit error. Should
>>> I increase memory? Is there a configuration I'm missing?
>>>
>>> Thanks,
>>> --
>>>
>>> --
>>> *Orel Weinstock*
>>> Software Engineer
>>> Email: orel@exposebox.com <ro...@exposebox.com>
>>> Website: www.exposebox.com
>>>
>>>
>>
>
>
> --
>
> --
> *Orel Weinstock*
> Software Engineer
> Email: orel@exposebox.com <ro...@exposebox.com>
> Website: www.exposebox.com
>
>
Re: MySQL cache load causes java.sql.SQLException: GC overhead limit exceeded
Posted by "Orel Weinstock (ExposeBox)" <or...@exposebox.com>.
I've used the web-console generated LoadCaches file. From what I
understand, looking at the source code, this is not supposed to keep it
on-heap at all (and I've supplied ample off-heap space).
It "just worked" with a HUGE memory allocation, but I will optimize it
later.
On 7 August 2018 at 17:16, Ilya Kasnacheev <il...@gmail.com>
wrote:
> Hello!
>
> This is likely caused by trying to keep all the table data in memory
> during data load. Can you share your code so that we could take a look?
>
> Regards,
>
>
> --
> Ilya Kasnacheev
>
> 2018-08-06 18:00 GMT+03:00 Orel Weinstock (ExposeBox) <or...@exposebox.com>
> :
>
>> Hi all,
>>
>> Changing the MAIN_CLASS env variable and tweaking the default heap size
>> (2.7GB) and default data region size (8GB), I'm trying to load a small
>> (<4GB) MySQL table into the cache and get a GC overhead limit error. Should
>> I increase memory? Is there a configuration I'm missing?
>>
>> Thanks,
>> --
>>
>> --
>> *Orel Weinstock*
>> Software Engineer
>> Email: orel@exposebox.com <ro...@exposebox.com>
>> Website: www.exposebox.com
>>
>>
>
--
--
*Orel Weinstock*
Software Engineer
Email: orel@exposebox.com <ro...@exposebox.com>
Website: www.exposebox.com
Re: MySQL cache load causes java.sql.SQLException: GC overhead limit exceeded
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
This is likely caused by trying to keep all the table data in memory during
data load. Can you share your code so that we could take a look?
Regards,
--
Ilya Kasnacheev
2018-08-06 18:00 GMT+03:00 Orel Weinstock (ExposeBox) <or...@exposebox.com>:
> Hi all,
>
> Changing the MAIN_CLASS env variable and tweaking the default heap size
> (2.7GB) and default data region size (8GB), I'm trying to load a small
> (<4GB) MySQL table into the cache and get a GC overhead limit error. Should
> I increase memory? Is there a configuration I'm missing?
>
> Thanks,
> --
>
> --
> *Orel Weinstock*
> Software Engineer
> Email: orel@exposebox.com <ro...@exposebox.com>
> Website: www.exposebox.com
>
>