You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mina.apache.org by Nguyen Huy Binh <hu...@gmail.com> on 2007/03/23 16:52:13 UTC

MINA performance

Hi,
I am looking for a framework for my server. It has to process many
connections concurrently (about 10,000 client). Can MINA perform that job?
I saw MINA presentation, you showed a performance test with a huge of
messages on 10 clients.
Does MINA have a infrastructure (like thread-pool) to solve that problem?

Is there any live-example using MINA for the same purpose?

Thank you.
-- 
Nguyễn Huy Bình

RE: MINA performance

Posted by Gaston Dombiak <ga...@jivesoftware.com>.
Hey Haviv,

You are exactly right. When rate of incoming packets is faster than
processing rate then incoming queue will fill up and if that keeps
happening for a while then the queue may end up producing an OOM. MINA
provides a throttle filter that you can use to throttle per session.
Besides the per session we also need a global throttling.

The same problem happens with outgoing packets. Outgoing packets are
placed in a queue and then another threads performs the actual sending.
If more packets are placed in the queue than the ones being sent then
the queue may also fill up. I think that the global throttle mechanism
may also consider size of outgoing queue to decide to stop reading and
let the server recover from a heavy load mechanism. Anyway, you may have
the outgoing queue problem even when not reading things from the network
(but that is not the case of Openfire).

Regards,

  -- Gato

-----Original Message-----
From: Haviv [mailto:haviv.rosh@gmail.com] 
Sent: Sunday, March 25, 2007 12:46 AM
To: dev@mina.apache.org
Subject: RE: MINA performance


Hi Gaston,
I was wondering if you ran into memory problems when writes rates>>read
rates -> for example in case
of broadcasting an incoming message to multiple clients\users ?
Did you use some kind of throttling ?  
With the default out of the box Mina behavior - in such cases - you ran
into
Out of memory error problems.
Thanks


Gaston Dombiak wrote:
> 
> Hey Stefano,
> 
> Two weeks ago I ran another load test round and we got to 54K this
time.
> We stopped there not because the server was not able to handle more
but
> because out load generator tool was not able to generate more load.
Also
> note that the test was not about opening sockets but about having all
> those connections sending traffic every second. IIRC, we got peaks of
> 9.5K XML stanzas being sent from the server to the clients in one
> second.
> 
> Regards,
> 
>   -- Gato
> 
>> -----Original Message-----
>> From: Stefano Bagnara [mailto:apache@bago.org]
>> Sent: Friday, March 23, 2007 11:30 AM
>> To: dev@mina.apache.org
>> Subject: Re: MINA performance
>> 
>> Openfire (formerly Wildfire) switched to MINA and they claim to
> support
>> 25K users or even more.
>> 
>> http://www.igniterealtime.org/forum/thread.jspa?threadID=23728
>> 
>> Stefano
>> 
>> Nguyen Huy Binh ha scritto:
>> > Hi,
>> > I am looking for a framework for my server. It has to process many
>> > connections concurrently (about 10,000 client). Can MINA perform
> that
>> job?
>> > I saw MINA presentation, you showed a performance test with a huge
> of
>> > messages on 10 clients.
>> > Does MINA have a infrastructure (like thread-pool) to solve that
>> problem?
>> >
>> > Is there any live-example using MINA for the same purpose?
>> >
>> > Thank you.
>> 
> 
> 
> 

-- 
View this message in context:
http://www.nabble.com/MINA-performance-tf3454944.html#a9657922
Sent from the mina dev mailing list archive at Nabble.com.


RE: MINA performance

Posted by Haviv <ha...@gmail.com>.
Hi Gaston,
I was wondering if you ran into memory problems when writes rates>>read
rates -> for example in case
of broadcasting an incoming message to multiple clients\users ?
Did you use some kind of throttling ?  
With the default out of the box Mina behavior - in such cases - you ran into
Out of memory error problems.
Thanks


Gaston Dombiak wrote:
> 
> Hey Stefano,
> 
> Two weeks ago I ran another load test round and we got to 54K this time.
> We stopped there not because the server was not able to handle more but
> because out load generator tool was not able to generate more load. Also
> note that the test was not about opening sockets but about having all
> those connections sending traffic every second. IIRC, we got peaks of
> 9.5K XML stanzas being sent from the server to the clients in one
> second.
> 
> Regards,
> 
>   -- Gato
> 
>> -----Original Message-----
>> From: Stefano Bagnara [mailto:apache@bago.org]
>> Sent: Friday, March 23, 2007 11:30 AM
>> To: dev@mina.apache.org
>> Subject: Re: MINA performance
>> 
>> Openfire (formerly Wildfire) switched to MINA and they claim to
> support
>> 25K users or even more.
>> 
>> http://www.igniterealtime.org/forum/thread.jspa?threadID=23728
>> 
>> Stefano
>> 
>> Nguyen Huy Binh ha scritto:
>> > Hi,
>> > I am looking for a framework for my server. It has to process many
>> > connections concurrently (about 10,000 client). Can MINA perform
> that
>> job?
>> > I saw MINA presentation, you showed a performance test with a huge
> of
>> > messages on 10 clients.
>> > Does MINA have a infrastructure (like thread-pool) to solve that
>> problem?
>> >
>> > Is there any live-example using MINA for the same purpose?
>> >
>> > Thank you.
>> 
> 
> 
> 

-- 
View this message in context: http://www.nabble.com/MINA-performance-tf3454944.html#a9657922
Sent from the mina dev mailing list archive at Nabble.com.


RE: MINA performance

Posted by Gaston Dombiak <ga...@jivesoftware.com>.
Hey Stefano,

Two weeks ago I ran another load test round and we got to 54K this time.
We stopped there not because the server was not able to handle more but
because out load generator tool was not able to generate more load. Also
note that the test was not about opening sockets but about having all
those connections sending traffic every second. IIRC, we got peaks of
9.5K XML stanzas being sent from the server to the clients in one
second.

Regards,

  -- Gato

> -----Original Message-----
> From: Stefano Bagnara [mailto:apache@bago.org]
> Sent: Friday, March 23, 2007 11:30 AM
> To: dev@mina.apache.org
> Subject: Re: MINA performance
> 
> Openfire (formerly Wildfire) switched to MINA and they claim to
support
> 25K users or even more.
> 
> http://www.igniterealtime.org/forum/thread.jspa?threadID=23728
> 
> Stefano
> 
> Nguyen Huy Binh ha scritto:
> > Hi,
> > I am looking for a framework for my server. It has to process many
> > connections concurrently (about 10,000 client). Can MINA perform
that
> job?
> > I saw MINA presentation, you showed a performance test with a huge
of
> > messages on 10 clients.
> > Does MINA have a infrastructure (like thread-pool) to solve that
> problem?
> >
> > Is there any live-example using MINA for the same purpose?
> >
> > Thank you.
> 


Re: MINA performance

Posted by Stefano Bagnara <ap...@bago.org>.
Openfire (formerly Wildfire) switched to MINA and they claim to support 
25K users or even more.

http://www.igniterealtime.org/forum/thread.jspa?threadID=23728

Stefano

Nguyen Huy Binh ha scritto:
> Hi,
> I am looking for a framework for my server. It has to process many
> connections concurrently (about 10,000 client). Can MINA perform that job?
> I saw MINA presentation, you showed a performance test with a huge of
> messages on 10 clients.
> Does MINA have a infrastructure (like thread-pool) to solve that problem?
> 
> Is there any live-example using MINA for the same purpose?
> 
> Thank you.



Re: MINA performance

Posted by peter royal <pr...@apache.org>.
On Mar 23, 2007, at 8:52 AM, Nguyen Huy Binh wrote:
> I am looking for a framework for my server. It has to process many
> connections concurrently (about 10,000 client). Can MINA perform  
> that job?

yes.

> I saw MINA presentation, you showed a performance test with a huge of
> messages on 10 clients.
> Does MINA have a infrastructure (like thread-pool) to solve that  
> problem?

absolutely

> Is there any live-example using MINA for the same purpose?

as mentioned, Wildfire is using MINA. I know of some other not-yet- 
fully-disclosed projects that are also using it with high load as well.

-pete


-- 
proyal@apache.org - http://fotap.org/~osi