You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@qpid.apache.org by Michael Goulish <mg...@redhat.com> on 2014/05/05 15:30:49 UTC
dispatch router handles one million addresses
I just had a successful test of the dispatch router
handling one million unique addresses.
There were 3 boxes, one for senders, one for receivers,
and one in the middle for a single router.
I had 20 senders, each sending to 50,000 unique addresses.
These were qpid-messaging based. On the other
side I had 2000 receivers, each listening to 500
unique addresses. Only 1 message went to each
address. As each receiver got all 500 of its messages,
it would quit.
The router achieved throughput of 5780 messages per
second, at 330% CPU usage.
This was the first-ever test of the dispatch router
at anything near this scale.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: dispatch router handles one million addresses
Posted by Ken Giusti <kg...@redhat.com>.
Great! Thank you for the good work, Mick - very useful indeed.
----- Original Message -----
> From: "Michael Goulish" <mg...@redhat.com>
> To: users@qpid.apache.org
> Sent: Monday, May 5, 2014 9:30:49 AM
> Subject: dispatch router handles one million addresses
>
>
>
> I just had a successful test of the dispatch router
> handling one million unique addresses.
>
> There were 3 boxes, one for senders, one for receivers,
> and one in the middle for a single router.
>
> I had 20 senders, each sending to 50,000 unique addresses.
> These were qpid-messaging based. On the other
> side I had 2000 receivers, each listening to 500
> unique addresses. Only 1 message went to each
> address. As each receiver got all 500 of its messages,
> it would quit.
>
> The router achieved throughput of 5780 messages per
> second, at 330% CPU usage.
>
> This was the first-ever test of the dispatch router
> at anything near this scale.
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
>
>
--
-K
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: dispatch router handles one million addresses
Posted by Michael Goulish <mg...@redhat.com>.
:-(
I just discovered that I only allowed the router 4 worker-threads
on this test. No wonder it only got to 330% CPU!
I might have seen much better throughput if I had allowed it
one thread for each CPU. ( I had 16 available. )
----- Original Message -----
----- Original Message -----
> On 05/05/2014 02:30 PM, Michael Goulish wrote:
> >
> >
> > I just had a successful test of the dispatch router
> > handling one million unique addresses.
> >
> > There were 3 boxes, one for senders, one for receivers,
> > and one in the middle for a single router.
> >
> > I had 20 senders, each sending to 50,000 unique addresses.
> > These were qpid-messaging based. On the other
> > side I had 2000 receivers, each listening to 500
> > unique addresses. Only 1 message went to each
> > address. As each receiver got all 500 of its messages,
> > it would quit.
> >
> > The router achieved throughput of 5780 messages per
> > second, at 330% CPU usage.
>
> How did you measure/compute the throughput?
>
I had my sender print out time just before it started sending,
and each receiver printed out time just after it received its
last message. I measured number of seconds from sender-start
to last-receiver-end.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: dispatch router handles one million addresses
Posted by Michael Goulish <mg...@redhat.com>.
----- Original Message -----
> On 05/05/2014 02:30 PM, Michael Goulish wrote:
> >
> >
> > I just had a successful test of the dispatch router
> > handling one million unique addresses.
> >
> > There were 3 boxes, one for senders, one for receivers,
> > and one in the middle for a single router.
> >
> > I had 20 senders, each sending to 50,000 unique addresses.
> > These were qpid-messaging based. On the other
> > side I had 2000 receivers, each listening to 500
> > unique addresses. Only 1 message went to each
> > address. As each receiver got all 500 of its messages,
> > it would quit.
> >
> > The router achieved throughput of 5780 messages per
> > second, at 330% CPU usage.
>
> How did you measure/compute the throughput?
>
I had my sender print out time just before it started sending,
and each receiver printed out time just after it received its
last message. I measured number of seconds from sender-start
to last-receiver-end.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: dispatch router handles one million addresses
Posted by Gordon Sim <gs...@redhat.com>.
On 05/05/2014 02:30 PM, Michael Goulish wrote:
>
>
> I just had a successful test of the dispatch router
> handling one million unique addresses.
>
> There were 3 boxes, one for senders, one for receivers,
> and one in the middle for a single router.
>
> I had 20 senders, each sending to 50,000 unique addresses.
> These were qpid-messaging based. On the other
> side I had 2000 receivers, each listening to 500
> unique addresses. Only 1 message went to each
> address. As each receiver got all 500 of its messages,
> it would quit.
>
> The router achieved throughput of 5780 messages per
> second, at 330% CPU usage.
How did you measure/compute the throughput?
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org