You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@qpid.apache.org by Patrick Westphal <pa...@informatik.uni-leipzig.de> on 2015/09/08 17:28:59 UTC
'queue consumer closed' log message
Hello Qpid users,
I'm running the Qpid Java broker in a master-workers setup where a
master process continuously puts tasks into a queue which are then
processed by the workers. When finished a worker sends back its result
to the master and looks for new tasks to process. After running a few
minutes I realized that the master process logs an increasing number of
lines like this:
Received a message(1681529877)[1246] from queue consumer(341) is
closed rejecting(requeue)...
Unfortunately I could not find out what this actually means, i.e. if
this is a severe issue (it is logged as 'info' message), what could have
caused it and how to prevent it.
Can you give me some pointers?
Thanks in advance,
Patrick
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: 'queue consumer closed' log message
Posted by Lorenz Quack <qu...@gmail.com>.
Hello Patrick,
the message seems to suggest that the consumer on the master closes
while there are still messages in the pre-fetch queue. Those messages
will be requeued.
It is hard to tell why this is happening without knowing more about how
you are using JMS in your application.
How exactly are the workers reporting their results to the master?
Do they use the same queue or do they have separate queues?
Do you have a single consumer on the master or several consumers?
How, in your application, can the consumer(s) on the master be closed?
Also, may I ask which version of the Qpid client/broker you are using?
Kind regards,
Lorenz
On 08/09/15 16:28, Patrick Westphal wrote:
> Hello Qpid users,
>
> I'm running the Qpid Java broker in a master-workers setup where a
> master process continuously puts tasks into a queue which are then
> processed by the workers. When finished a worker sends back its result
> to the master and looks for new tasks to process. After running a few
> minutes I realized that the master process logs an increasing number
> of lines like this:
>
> Received a message(1681529877)[1246] from queue consumer(341) is
> closed rejecting(requeue)...
>
> Unfortunately I could not find out what this actually means, i.e. if
> this is a severe issue (it is logged as 'info' message), what could
> have caused it and how to prevent it.
> Can you give me some pointers?
>
> Thanks in advance,
> Patrick
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: 'queue consumer closed' log message
Posted by Lorenz Quack <qu...@gmail.com>.
Hi Patrick,
glad I could help but one more thing.
Creating a consumer for each message is an unusual pattern in JMS.
Obviously, I don't know your specific use case but you might want to
consider rethinking that design.
Should you stick with it then, yes, you should probably set the prefetch
to 0 or 1.
Kind regards,
Lorenz
On 08/09/15 17:32, Patrick Westphal wrote:
> Hi Lorenz,
>
> On 09/08/2015 06:01 PM, Lorenz Quack wrote:
>> Hello Patrick,
>>
>> the message seems to suggest that the consumer on the master closes
>> while there are still messages in the pre-fetch queue. Those messages
>> will be requeued.
> I think this is exactly the bit of information I was looking for. :) I
> just didn't know about the pre-fetching. The log lines were then
> created because I'm closing the consumer after reading a single message.
>
> Thanks a lot!
>>
>> It is hard to tell why this is happening without knowing more about
>> how you are using JMS in your application.
>> How exactly are the workers reporting their results to the master?
>> Do they use the same queue or do they have separate queues?
>> Do you have a single consumer on the master or several consumers?
>> How, in your application, can the consumer(s) on the master be closed?
>>
>> Also, may I ask which version of the Qpid client/broker you are using?
>>
>> Kind regards,
>> Lorenz
>>
>>
>> On 08/09/15 16:28, Patrick Westphal wrote:
>>> Hello Qpid users,
>>>
>>> I'm running the Qpid Java broker in a master-workers setup where a
>>> master process continuously puts tasks into a queue which are then
>>> processed by the workers. When finished a worker sends back its
>>> result to the master and looks for new tasks to process. After
>>> running a few minutes I realized that the master process logs an
>>> increasing number of lines like this:
>>>
>>> Received a message(1681529877)[1246] from queue consumer(341) is
>>> closed rejecting(requeue)...
>>>
>>> Unfortunately I could not find out what this actually means, i.e. if
>>> this is a severe issue (it is logged as 'info' message), what could
>>> have caused it and how to prevent it.
>>> Can you give me some pointers?
>>>
>>> Thanks in advance,
>>> Patrick
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
>>> For additional commands, e-mail: users-help@qpid.apache.org
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
>> For additional commands, e-mail: users-help@qpid.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: 'queue consumer closed' log message
Posted by Patrick Westphal <pa...@informatik.uni-leipzig.de>.
Hi Lorenz,
On 09/08/2015 06:01 PM, Lorenz Quack wrote:
> Hello Patrick,
>
> the message seems to suggest that the consumer on the master closes
> while there are still messages in the pre-fetch queue. Those messages
> will be requeued.
I think this is exactly the bit of information I was looking for. :) I
just didn't know about the pre-fetching. The log lines were then created
because I'm closing the consumer after reading a single message.
Thanks a lot!
>
> It is hard to tell why this is happening without knowing more about
> how you are using JMS in your application.
> How exactly are the workers reporting their results to the master?
> Do they use the same queue or do they have separate queues?
> Do you have a single consumer on the master or several consumers?
> How, in your application, can the consumer(s) on the master be closed?
>
> Also, may I ask which version of the Qpid client/broker you are using?
>
> Kind regards,
> Lorenz
>
>
> On 08/09/15 16:28, Patrick Westphal wrote:
>> Hello Qpid users,
>>
>> I'm running the Qpid Java broker in a master-workers setup where a
>> master process continuously puts tasks into a queue which are then
>> processed by the workers. When finished a worker sends back its
>> result to the master and looks for new tasks to process. After
>> running a few minutes I realized that the master process logs an
>> increasing number of lines like this:
>>
>> Received a message(1681529877)[1246] from queue consumer(341) is
>> closed rejecting(requeue)...
>>
>> Unfortunately I could not find out what this actually means, i.e. if
>> this is a severe issue (it is logged as 'info' message), what could
>> have caused it and how to prevent it.
>> Can you give me some pointers?
>>
>> Thanks in advance,
>> Patrick
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
>> For additional commands, e-mail: users-help@qpid.apache.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: 'queue consumer closed' log message
Posted by Lorenz Quack <qu...@gmail.com>.
Hello Patrick,
the message seems to suggest that the consumer on the master closes
while there are still messages in the pre-fetch queue. Those messages
will be requeued.
It is hard to tell why this is happening without knowing more about how
you are using JMS in your application.
How exactly are the workers reporting their results to the master?
Do they use the same queue or do they have separate queues?
Do you have a single consumer on the master or several consumers?
How, in your application, can the consumer(s) on the master be closed?
Also, may I ask which version of the Qpid client/broker you are using?
Kind regards,
Lorenz
On 08/09/15 16:28, Patrick Westphal wrote:
> Hello Qpid users,
>
> I'm running the Qpid Java broker in a master-workers setup where a
> master process continuously puts tasks into a queue which are then
> processed by the workers. When finished a worker sends back its result
> to the master and looks for new tasks to process. After running a few
> minutes I realized that the master process logs an increasing number
> of lines like this:
>
> Received a message(1681529877)[1246] from queue consumer(341) is
> closed rejecting(requeue)...
>
> Unfortunately I could not find out what this actually means, i.e. if
> this is a severe issue (it is logged as 'info' message), what could
> have caused it and how to prevent it.
> Can you give me some pointers?
>
> Thanks in advance,
> Patrick
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org