You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Hari Shreedharan (JIRA)" <ji...@apache.org> on 2014/05/01 09:07:15 UTC

[jira] [Updated] (FLUME-2181) Optionally disable File Channel fsyncs

     [ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hari Shreedharan updated FLUME-2181:
------------------------------------

    Attachment: FLUME-2181-3.patch

Here is an updated patch which fixes the issues Brock mentioned above and also adds a test to verify that the channel dies if corrupt events are detected with fsync per transaction enabled, and does not fail if fsync per transaction is false.

> Optionally disable File Channel fsyncs 
> ---------------------------------------
>
>                 Key: FLUME-2181
>                 URL: https://issues.apache.org/jira/browse/FLUME-2181
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: Hari Shreedharan
>            Assignee: Hari Shreedharan
>         Attachments: FLUME-2181-1.patch, FLUME-2181-2.patch, FLUME-2181-3.patch, FLUME-2181.patch
>
>
> This will give File Channel performance a big boost, at the cost of possible data loss if a crash happens between checkpoints. 
> Also we should make it configurable, with default to false. If the user does not mind slight inconsistencies, this feature can be explicitly enabled through configuration. So if it is not configured, then the behavior will be exactly as it is now.



--
This message was sent by Atlassian JIRA
(v6.2#6252)