You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flume.apache.org by Hans Uhlig <hu...@uhlisys.com> on 2012/06/24 19:03:52 UTC

What is the best way to horizontally distribute file consumers in flume-ng?

I am looking into establishing an ETL for various NAS/S3 endpoints but
attempting to figure out the best way to scale horizontally. Is there any
form of monitor or locking architecture currently or do you simply embed a
monitor in each and every flume agent and then push it into zookeeper.