You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flume.apache.org by "zhenzhao wang (JIRA)" <ji...@apache.org> on 2018/08/13 19:44:00 UTC
[jira] [Created] (FLUME-3268) Introduce micro batch processing to
HDFSEventSink
zhenzhao wang created FLUME-3268:
------------------------------------
Summary: Introduce micro batch processing to HDFSEventSink
Key: FLUME-3268
URL: https://issues.apache.org/jira/browse/FLUME-3268
Project: Flume
Issue Type: New Feature
Reporter: zhenzhao wang
In our test with HDFSEvent sink, we found that we could increase the draining speed of HDFSSink up to 4x by introducing micro batch processing. With the micro batch processing feature, we will batch the events written to HDFS instead of one by one.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@flume.apache.org
For additional commands, e-mail: issues-help@flume.apache.org