You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by rakshita04 <ra...@siemens.com> on 2021/04/08 12:05:21 UTC
Abrupt stop of application on using sql
Hi Team,
We are using sql queries and sql feature of C++ for our existing cache data
on our application.
The code runs perfectly fine on AMD linux version but on ARM machine, it
abruptly stops the application , after few entries in the DB.
If we try to again start the application, it again stops it until we clear
the DB and run the application.
I am attaching the ignite logs here for your reference.
Can you please have a look and let us know the probable reason for this
abrupt stop? and possible solution to this?
There is no error or exception on terminal when application is stopped.
regards,
Rakshita Chaudhary ignite-acbac2f8.log
<http://apache-ignite-users.70518.x6.nabble.com/file/t2857/ignite-acbac2f8.log>
ignite-c372f3e8.log
<http://apache-ignite-users.70518.x6.nabble.com/file/t2857/ignite-c372f3e8.log>
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Abrupt stop of application on using sql
Posted by rakshita04 <ra...@siemens.com>.
Hi Ilya,
No hs_err logs are being generated.
No information on terminal as well, its just a stop of application.
Regards,
Rakshita chaudhary
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Abrupt stop of application on using sql
Posted by rakshita04 <ra...@siemens.com>.
Hi Team,
Can you please respond to my query above?
regards,
Rakshita Chaudhary
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Abrupt stop of application on using sql
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
This sounds like https://issues.apache.org/jira/browse/IGNITE-8702
Maybe there are some issues left with poll versus select, or maybe it is
your own code that is using select() instead of poll()
Regards,
--
Ilya Kasnacheev
пн, 19 апр. 2021 г. в 15:30, rakshita04 <ra...@siemens.com>:
> hello Ilya,
>
> As i mentioned it is an abrupt closure of application.
> So we dont have the exit code.
> There is one information that i have which might be useful for you. We
> noticed that number of open file descriptor goes beyond 1024(max range of
> open file range of the system).
> When we disable the persistence there is no problem and applications runs
> smoothly
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Re: Abrupt stop of application on using sql
Posted by rakshita04 <ra...@siemens.com>.
hello Ilya,
As i mentioned it is an abrupt closure of application.
So we dont have the exit code.
There is one information that i have which might be useful for you. We
noticed that number of open file descriptor goes beyond 1024(max range of
open file range of the system).
When we disable the persistence there is no problem and applications runs
smoothly
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Abrupt stop of application on using sql
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
You still did not respond about the return code of the process.
I recommend attaching a debugger to the process to see what happens.
Regards,
--
Ilya Kasnacheev
чт, 15 апр. 2021 г. в 15:16, rakshita04 <ra...@siemens.com>:
> Hi Ilya,
>
> How is decreasing maxSize of data region related to "Buffer Overflow"
> problem?
> I mean we dont get any Out of memory log in DeMsg logs and also "top"
> command shows enough available RAM.
> We tried decreasing maxSize to 50mb now but the problem still persists.
> Can this also be related to checkpointing?
>
> regards,
> Rakshita Chaudhary
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Re: Abrupt stop of application on using sql
Posted by rakshita04 <ra...@siemens.com>.
Hi Ilya,
How is decreasing maxSize of data region related to "Buffer Overflow"
problem?
I mean we dont get any Out of memory log in DeMsg logs and also "top"
command shows enough available RAM.
We tried decreasing maxSize to 50mb now but the problem still persists.
Can this also be related to checkpointing?
regards,
Rakshita Chaudhary
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Abrupt stop of application on using sql
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
You should probably decrease maxSize until you stop seeing this issue, and
then some more.
Regards,
--
Ilya Kasnacheev
ср, 14 апр. 2021 г. в 13:09, rakshita04 <ra...@siemens.com>:
> Hi Ilya,
>
> We only have one node.
> Attached is our DataBaseConfig.xml file for your reference
> DataBaseConfig.xml
> <
> http://apache-ignite-users.70518.x6.nabble.com/file/t2857/DataBaseConfig.xml>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Re: Abrupt stop of application on using sql
Posted by rakshita04 <ra...@siemens.com>.
Hi Ilya,
We only have one node.
Attached is our DataBaseConfig.xml file for your reference
DataBaseConfig.xml
<http://apache-ignite-users.70518.x6.nabble.com/file/t2857/DataBaseConfig.xml>
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Abrupt stop of application on using sql
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
How many nodes do you have?
Maybe when you start killing nodes, remaining nodes start rebalancing data
and they keep more data locally than fits in your memory.
The recommendation stays the same - decrease your data regions' and heap
size until it fits comfortably in the available memory to not trigger
OOMKiller.
Regards,
--
Ilya Kasnacheev
ср, 14 апр. 2021 г. в 07:39, rakshita04 <ra...@siemens.com>:
> Hi Ilya,
>
> we could find out the problem of the application stop.
> We see "Buffer Overflow" error when application stops.
> We commented out mCache.Put() in our code(basically not calling Put API to
> write data to DB) and the restart did not happen.
> Also this restart happens after a certain number of entries in DB.
> Do you have any idea what can cause this buffer overflow while write in DB?
> and is there anything we can do to avoid it?
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Re: Abrupt stop of application on using sql
Posted by rakshita04 <ra...@siemens.com>.
Hi Ilya,
we could find out the problem of the application stop.
We see "Buffer Overflow" error when application stops.
We commented out mCache.Put() in our code(basically not calling Put API to
write data to DB) and the restart did not happen.
Also this restart happens after a certain number of entries in DB.
Do you have any idea what can cause this buffer overflow while write in DB?
and is there anything we can do to avoid it?
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Abrupt stop of application on using sql
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
What is the return code of the Java process?
I recommend checking dmesg output for OOMKiller messages. Seems to be a
popular failure mode these days.
Regards,
--
Ilya Kasnacheev
пт, 9 апр. 2021 г. в 11:58, rakshita04 <ra...@siemens.com>:
> Hi Team,
>
> Do you have any update on this issue?
>
> regards,
> Rakshita chaudhary
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Re: Abrupt stop of application on using sql
Posted by rakshita04 <ra...@siemens.com>.
Hi Team,
Do you have any update on this issue?
regards,
Rakshita chaudhary
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Abrupt stop of application on using sql
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
Are there hs_err_pid*.log files around after the abrupt stopping? If there
are, please share the latest one.
Regards,
--
Ilya Kasnacheev
чт, 8 апр. 2021 г. в 15:06, rakshita04 <ra...@siemens.com>:
> Hi Team,
>
> We are using sql queries and sql feature of C++ for our existing cache data
> on our application.
> The code runs perfectly fine on AMD linux version but on ARM machine, it
> abruptly stops the application , after few entries in the DB.
> If we try to again start the application, it again stops it until we clear
> the DB and run the application.
> I am attaching the ignite logs here for your reference.
> Can you please have a look and let us know the probable reason for this
> abrupt stop? and possible solution to this?
> There is no error or exception on terminal when application is stopped.
>
> regards,
> Rakshita Chaudhary ignite-acbac2f8.log
> <
> http://apache-ignite-users.70518.x6.nabble.com/file/t2857/ignite-acbac2f8.log>
>
> ignite-c372f3e8.log
> <
> http://apache-ignite-users.70518.x6.nabble.com/file/t2857/ignite-c372f3e8.log>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>