You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Rajalakshmi Ramesh <rr...@gatech.edu> on 2012/02/12 19:59:10 UTC

Round robin load balancer for collectors

Hi,
I wanted some info on whether it is possible to have a set of collectors
for a flow and make them automatically receive events on a round robin
basis. For example, If I have a set of agents and  4 agents, each agent
will start off by sending events to a random collector and then send events
to each collector in the set in round robin.

Agent 1
event 1 - Collector 4
event 2 - Collector 1
event 3 - Collector 2
event 4- Collector 3 and so on.

Thanks in advance for you help.

Thanks & Regards
Rajalakshmi (Raji) Ramesh
-------------------------------------------------------
Graduate Student
Georgia Institute of Technology
Atlanta, GA
-------------------------------------------------------

Re: Round robin load balancer for collectors

Posted by Rajalakshmi Ramesh <rr...@gatech.edu>.
Thanks. Looks like I can use it. Will try to patch my current build and see
if it helps.

Thanks & Regards
Rajalakshmi (Raji) Ramesh
-------------------------------------------------------
Graduate Student
Georgia Institute of Technology
Atlanta, GA
-------------------------------------------------------



On Sun, Feb 12, 2012 at 2:50 PM, Frank Grimes <fr...@yahoo.com>wrote:

> We had to implement our own sink to handle that use-case.
> We provided a patch as part of:
> https://issues.apache.org/jira/browse/FLUME-527
>
> Regards,
>
> Frank Grimes
>
> On 2012-02-12, at 1:59 PM, Rajalakshmi Ramesh wrote:
>
> Hi,
> I wanted some info on whether it is possible to have a set of collectors
> for a flow and make them automatically receive events on a round robin
> basis. For example, If I have a set of agents and  4 agents, each agent
> will start off by sending events to a random collector and then send events
> to each collector in the set in round robin.
>
> Agent 1
> event 1 - Collector 4
> event 2 - Collector 1
> event 3 - Collector 2
> event 4- Collector 3 and so on.
>
> Thanks in advance for you help.
>
> Thanks & Regards
> Rajalakshmi (Raji) Ramesh
> -------------------------------------------------------
> Graduate Student
> Georgia Institute of Technology
> Atlanta, GA
> -------------------------------------------------------
>
>
>

Re: Round robin load balancer for collectors

Posted by Frank Grimes <fr...@yahoo.com>.
We had to implement our own sink to handle that use-case.
We provided a patch as part of: https://issues.apache.org/jira/browse/FLUME-527

Regards,

Frank Grimes

On 2012-02-12, at 1:59 PM, Rajalakshmi Ramesh wrote:

> Hi,
> I wanted some info on whether it is possible to have a set of collectors for a flow and make them automatically receive events on a round robin basis. For example, If I have a set of agents and  4 agents, each agent will start off by sending events to a random collector and then send events to each collector in the set in round robin.
> 
> Agent 1
> event 1 - Collector 4
> event 2 - Collector 1
> event 3 - Collector 2
> event 4- Collector 3 and so on.
> 
> Thanks in advance for you help.
> 
> Thanks & Regards
> Rajalakshmi (Raji) Ramesh
> -------------------------------------------------------
> Graduate Student
> Georgia Institute of Technology
> Atlanta, GA
> -------------------------------------------------------
>