You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flume.apache.org by Andrew Sammut <as...@kixeye.com> on 2014/04/30 08:54:26 UTC

Replay Flume File Channel Data

Hi there,

I've recently had an issue where a client repeatedly sent 1.6M sized events
to our load balanced avro sources and in doing so filled the heap (4GB) of
all of our instances.

Is there a way to replay log files and extract only the required data?
Also, is there a way to limit the size of message that an avro source can
accept?

Regards,
Andrew S

-- 
Andrew Sammut
Lead Reliability Engineer (AUS)

Mobile: +61 (0)435 072 784
Google Voice: +1 (415) 548 1927
Email: asammut@kixeye.com
Skype: kix.asammut