You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@activemq.apache.org by Stefan Lemdal <sl...@exiger.com> on 2021/04/20 14:01:32 UTC
Messages disappearing
Every now and then a queue after consuming a few million messages will end up showing a queue size of 0, but the message store size is above 0, indicating there are still messages in the queue but not able to be seen or consumed. When the server is restarted, the messages show up in the queue and then get consumed. Wondering if anyone has seen this or have any tips on fixing this from happening?
Thanks!
–––––––––––––––––––––––––––––––––––––
The information contained in this message and any attachments may be confidential and/or restricted and protected from disclosure. If the reader of this message is not the intended recipient, disclosure, copying, use, or distribution of the information included in this message is prohibited - please destroy all electronic and paper copies and notify the sender immediately.
Re: Messages disappearing
Posted by Stefan Lemdal <sl...@exiger.com>.
Yeah fair enough, was more curious if anyone had heard of this happening before, nothing has really stood out in logs, but will keep looking and try increasing logging level to see if anything stands out.
Thanks!
Stefan
On Tue, 2021-04-20 at 09:28 -0500, Matt Pavlovich wrote:
External Email: Use caution opening links & attachments.
Hi Stefan-
That can be difficult to troubleshoot without analyzing the logs and kahadb files directly— which understandably can be problematic in enterprise use cases where there is sensitive data stored.
That being said, if the issue was wide-spread there would be an expectation of users reporting the same. Given that, I suggest starting reviewing logs for ERRORs and WARNs to see if anything jumps out. If the environment is unstable or you are running up against resource limits you maybe seeing side-effects of other system problems.
If you find something concrete, please open a JIRA to share activemq.xml configuration, activemq logs and kahadb files (when possible).
Thanks,
Matt Pavlovich
On Apr 20, 2021, at 9:10 AM, Stefan Lemdal <sl...@exiger.com>> wrote:
5.16.0, this was also happening in an older version 5.15.2
On Tue, 2021-04-20 at 09:07 -0500, Justin Bertram wrote:
External Email: Use caution opening links & attachments.
What version are you using?
Justin
On Tue, Apr 20, 2021 at 9:02 AM Stefan Lemdal <sl...@exiger.com>>
wrote:
Every now and then a queue after consuming a few million messages
will end
up showing a queue size of 0, but the message store size is above
0,
indicating there are still messages in the queue but not able to be
seen or
consumed. When the server is restarted, the messages show up in the
queue
and then get consumed. Wondering if anyone has seen this or have
any tips
on fixing this from happening?
Thanks!
–––––––––––––––––––––––––––––––––––––
The information contained in this message and any attachments may
be
confidential and/or restricted and protected from disclosure. If
the reader
of this message is not the intended recipient, disclosure, copying,
use, or
distribution of the information included in this message is
prohibited -
please destroy all electronic and paper copies and notify the
sender
immediately.
–––––––––––––––––––––––––––––––––––––
The information contained in this message and any attachments may be confidential and/or restricted and protected from disclosure. If the reader of this message is not the intended recipient, disclosure, copying, use, or distribution of the information included in this message is prohibited - please destroy all electronic and paper copies and notify the sender immediately.
–––––––––––––––––––––––––––––––––––––
The information contained in this message and any attachments may be confidential and/or restricted and protected from disclosure. If the reader of this message is not the intended recipient, disclosure, copying, use, or distribution of the information included in this message is prohibited - please destroy all electronic and paper copies and notify the sender immediately.
Re: Messages disappearing
Posted by Matt Pavlovich <ma...@gmail.com>.
Hi Stefan-
That can be difficult to troubleshoot without analyzing the logs and kahadb files directly— which understandably can be problematic in enterprise use cases where there is sensitive data stored.
That being said, if the issue was wide-spread there would be an expectation of users reporting the same. Given that, I suggest starting reviewing logs for ERRORs and WARNs to see if anything jumps out. If the environment is unstable or you are running up against resource limits you maybe seeing side-effects of other system problems.
If you find something concrete, please open a JIRA to share activemq.xml configuration, activemq logs and kahadb files (when possible).
Thanks,
Matt Pavlovich
> On Apr 20, 2021, at 9:10 AM, Stefan Lemdal <sl...@exiger.com> wrote:
>
> 5.16.0, this was also happening in an older version 5.15.2
>
> On Tue, 2021-04-20 at 09:07 -0500, Justin Bertram wrote:
>> External Email: Use caution opening links & attachments.
>>
>>
>> What version are you using?
>>
>>
>> Justin
>>
>> On Tue, Apr 20, 2021 at 9:02 AM Stefan Lemdal <sl...@exiger.com>
>> wrote:
>>
>>> Every now and then a queue after consuming a few million messages
>>> will end
>>> up showing a queue size of 0, but the message store size is above
>>> 0,
>>> indicating there are still messages in the queue but not able to be
>>> seen or
>>> consumed. When the server is restarted, the messages show up in the
>>> queue
>>> and then get consumed. Wondering if anyone has seen this or have
>>> any tips
>>> on fixing this from happening?
>>>
>>> Thanks!
>>>
>>>
>>> –––––––––––––––––––––––––––––––––––––
>>> The information contained in this message and any attachments may
>>> be
>>> confidential and/or restricted and protected from disclosure. If
>>> the reader
>>> of this message is not the intended recipient, disclosure, copying,
>>> use, or
>>> distribution of the information included in this message is
>>> prohibited -
>>> please destroy all electronic and paper copies and notify the
>>> sender
>>> immediately.
>>>
>
>
> –––––––––––––––––––––––––––––––––––––
> The information contained in this message and any attachments may be confidential and/or restricted and protected from disclosure. If the reader of this message is not the intended recipient, disclosure, copying, use, or distribution of the information included in this message is prohibited - please destroy all electronic and paper copies and notify the sender immediately.
Re: Messages disappearing
Posted by Stefan Lemdal <sl...@exiger.com>.
5.16.0, this was also happening in an older version 5.15.2
On Tue, 2021-04-20 at 09:07 -0500, Justin Bertram wrote:
> External Email: Use caution opening links & attachments.
>
>
> What version are you using?
>
>
> Justin
>
> On Tue, Apr 20, 2021 at 9:02 AM Stefan Lemdal <sl...@exiger.com>
> wrote:
>
> > Every now and then a queue after consuming a few million messages
> > will end
> > up showing a queue size of 0, but the message store size is above
> > 0,
> > indicating there are still messages in the queue but not able to be
> > seen or
> > consumed. When the server is restarted, the messages show up in the
> > queue
> > and then get consumed. Wondering if anyone has seen this or have
> > any tips
> > on fixing this from happening?
> >
> > Thanks!
> >
> >
> > –––––––––––––––––––––––––––––––––––––
> > The information contained in this message and any attachments may
> > be
> > confidential and/or restricted and protected from disclosure. If
> > the reader
> > of this message is not the intended recipient, disclosure, copying,
> > use, or
> > distribution of the information included in this message is
> > prohibited -
> > please destroy all electronic and paper copies and notify the
> > sender
> > immediately.
> >
–––––––––––––––––––––––––––––––––––––
The information contained in this message and any attachments may be confidential and/or restricted and protected from disclosure. If the reader of this message is not the intended recipient, disclosure, copying, use, or distribution of the information included in this message is prohibited - please destroy all electronic and paper copies and notify the sender immediately.
Re: Messages disappearing
Posted by Justin Bertram <jb...@apache.org>.
What version are you using?
Justin
On Tue, Apr 20, 2021 at 9:02 AM Stefan Lemdal <sl...@exiger.com> wrote:
> Every now and then a queue after consuming a few million messages will end
> up showing a queue size of 0, but the message store size is above 0,
> indicating there are still messages in the queue but not able to be seen or
> consumed. When the server is restarted, the messages show up in the queue
> and then get consumed. Wondering if anyone has seen this or have any tips
> on fixing this from happening?
>
> Thanks!
>
>
> –––––––––––––––––––––––––––––––––––––
> The information contained in this message and any attachments may be
> confidential and/or restricted and protected from disclosure. If the reader
> of this message is not the intended recipient, disclosure, copying, use, or
> distribution of the information included in this message is prohibited -
> please destroy all electronic and paper copies and notify the sender
> immediately.
>