You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@qpid.apache.org by Adam Chase <ad...@gmail.com> on 2009/03/03 20:47:03 UTC

batch accept issues?

Have there been any issues fixed recently with regards to batch
accepting of messages?  I'm trying to accept messages 50 or so at a
time, and sometimes they just don't seem to be getting deleted.

Any help here?

Adam

---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:users-subscribe@qpid.apache.org


Re: batch accept issues?

Posted by Gordon Sim <gs...@redhat.com>.
Adam Chase wrote:
> This issue may have been fixed now that I'm running newer code.
> 
> I'll let you know if I find that that is not the case.

Thanks, Adam!

---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:users-subscribe@qpid.apache.org


Re: batch accept issues?

Posted by Adam Chase <ad...@gmail.com>.
This issue may have been fixed now that I'm running newer code.

I'll let you know if I find that that is not the case.

Adam

On Wed, Mar 11, 2009 at 4:27 PM, Gordon Sim <gs...@redhat.com> wrote:
> Adam Chase wrote:
>>
>> I've attached a test that sometimes fails on my system.
>>
>> It may not be the simplest example.
>>
>> It tends to occur when the client is on a different machine than the
>> server.  (Not sure if it is timing related or not).
>>
>> declare_queues.
>> producer puts 1000 messages split among 2 queues.
>> consumer subscribes to both and batches accepts to a third of the
>> messages.
>> Once we've "accepted" 100 we actually do the accepts.
>>
>> The consumer logs how many messages its accepted.
>> When I run qpid-tool, I occasionally don't see many message deletes at
>> all (much less than the consumer reports).
>>
>> Any help is appreciated.
>
> Sorry for the delayed response; there just aren't enough hours in the day
> sometimes! How often is occasionally? Running your example code against the
> latest trunk I wasn't able to reproduce the issue.
>
> Broker was on remote box, I declared the queues, ran the producer, ran the
> consumer several times and verified that the counts matched up with that
> reported by qpid-tool (obviously the stats reported by qpid-tool are
> periodic snapshots, so you do occasionally need to wait a short while then
> recheck the counts).
>
> I'll try and convert this to something that can be run and verified
> automatically.
>
>
> ---------------------------------------------------------------------
> Apache Qpid - AMQP Messaging Implementation
> Project:      http://qpid.apache.org
> Use/Interact: mailto:users-subscribe@qpid.apache.org
>
>

---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:users-subscribe@qpid.apache.org


Re: batch accept issues?

Posted by Gordon Sim <gs...@redhat.com>.
Adam Chase wrote:
> I've attached a test that sometimes fails on my system.
> 
> It may not be the simplest example.
> 
> It tends to occur when the client is on a different machine than the
> server.  (Not sure if it is timing related or not).
> 
> declare_queues.
> producer puts 1000 messages split among 2 queues.
> consumer subscribes to both and batches accepts to a third of the messages.
> Once we've "accepted" 100 we actually do the accepts.
> 
> The consumer logs how many messages its accepted.
> When I run qpid-tool, I occasionally don't see many message deletes at
> all (much less than the consumer reports).
> 
> Any help is appreciated.

Sorry for the delayed response; there just aren't enough hours in the 
day sometimes! How often is occasionally? Running your example code 
against the latest trunk I wasn't able to reproduce the issue.

Broker was on remote box, I declared the queues, ran the producer, ran 
the consumer several times and verified that the counts matched up with 
that reported by qpid-tool (obviously the stats reported by qpid-tool 
are periodic snapshots, so you do occasionally need to wait a short 
while then recheck the counts).

I'll try and convert this to something that can be run and verified 
automatically.


---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:users-subscribe@qpid.apache.org


Re: batch accept issues?

Posted by Adam Chase <ad...@gmail.com>.
I've attached a test that sometimes fails on my system.

It may not be the simplest example.

It tends to occur when the client is on a different machine than the
server.  (Not sure if it is timing related or not).

declare_queues.
producer puts 1000 messages split among 2 queues.
consumer subscribes to both and batches accepts to a third of the messages.
Once we've "accepted" 100 we actually do the accepts.

The consumer logs how many messages its accepted.
When I run qpid-tool, I occasionally don't see many message deletes at
all (much less than the consumer reports).

Any help is appreciated.

Thanks,

Adam


On Wed, Mar 4, 2009 at 4:26 AM, Gordon Sim <gs...@redhat.com> wrote:
> Adam Chase wrote:
>>
>> Have there been any issues fixed recently with regards to batch
>> accepting of messages?  I'm trying to accept messages 50 or so at a
>> time, and sometimes they just don't seem to be getting deleted.
>
> I assume this is with the c++ client? There is nothing I'm aware of. Do you
> have a simple test case that reproduces the issue?
>
> ---------------------------------------------------------------------
> Apache Qpid - AMQP Messaging Implementation
> Project:      http://qpid.apache.org
> Use/Interact: mailto:users-subscribe@qpid.apache.org
>
>

Re: batch accept issues?

Posted by Gordon Sim <gs...@redhat.com>.
Adam Chase wrote:
> Have there been any issues fixed recently with regards to batch
> accepting of messages?  I'm trying to accept messages 50 or so at a
> time, and sometimes they just don't seem to be getting deleted.

I assume this is with the c++ client? There is nothing I'm aware of. Do 
you have a simple test case that reproduces the issue?

---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:users-subscribe@qpid.apache.org