[jira] [Updated] (FLUME-2181) Optionally disable File Channel fsyncs

["Brock Noland (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLUME-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brock Noland updated FLUME-2181:
--------------------------------

    Attachment: FLUME-2181-2.patch

[~hshreedharan] I had some spare time so I rebased the patch on trunk. The tests pass as well.

{noformat}
[INFO] Apache Flume ...................................... SUCCESS [1.074s]
[INFO] Flume NG SDK ...................................... SUCCESS [1:15.330s]
[INFO] Flume NG Configuration ............................ SUCCESS [1.417s]
[INFO] Flume NG Core ..................................... SUCCESS [6:45.411s]
[INFO] Flume NG Sinks .................................... SUCCESS [0.060s]
[INFO] Flume NG HDFS Sink ................................ SUCCESS [1:20.956s]
[INFO] Flume NG IRC Sink ................................. SUCCESS [1.247s]
[INFO] Flume NG Channels ................................. SUCCESS [0.067s]
[INFO] Flume NG JDBC channel ............................. SUCCESS [2:07.739s]
[INFO] Flume NG file-based channel ....................... SUCCESS [11:07.351s]
[INFO] Flume NG Spillable Memory channel ................. SUCCESS [3:44.141s]
[INFO] Flume NG Node ..................................... SUCCESS [27.442s]
[INFO] Flume NG Embedded Agent ........................... SUCCESS [11.879s]
[INFO] Flume NG HBase Sink ............................... SUCCESS [3:18.274s]
[INFO] Flume NG ElasticSearch Sink ....................... SUCCESS [42.384s]
[INFO] Flume NG Morphline Solr Sink ...................... SUCCESS [13.304s]
[INFO] Flume Sources ..................................... SUCCESS [0.030s]
[INFO] Flume Scribe Source ............................... SUCCESS [0.601s]
[INFO] Flume JMS Source .................................. SUCCESS [13.362s]
[INFO] Flume Twitter Source .............................. SUCCESS [0.906s]
[INFO] Flume legacy Sources .............................. SUCCESS [0.028s]
[INFO] Flume legacy Avro source .......................... SUCCESS [1.510s]
[INFO] Flume legacy Thrift Source ........................ SUCCESS [2.302s]
[INFO] Flume NG Clients .................................. SUCCESS [0.026s]
[INFO] Flume NG Log4j Appender ........................... SUCCESS [23.146s]
[INFO] Flume NG Tools .................................... SUCCESS [6.739s]
[INFO] Flume NG distribution ............................. SUCCESS [7.759s]
[INFO] Flume NG Integration Tests ........................ SUCCESS [53.966s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 33:08.887s
[INFO] Finished at: Thu Apr 10 18:19:13 CDT 2014
[INFO] Final Memory: 267M/973M
[INFO] ------------------------------------------------------------------------
{noformat}

> Optionally disable File Channel fsyncs 
> ---------------------------------------
>
>                 Key: FLUME-2181
>                 URL: https://issues.apache.org/jira/browse/FLUME-2181
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: Hari Shreedharan
>            Assignee: Hari Shreedharan
>         Attachments: FLUME-2181-1.patch, FLUME-2181-2.patch, FLUME-2181.patch
>
>
> This will give File Channel performance a big boost, at the cost of possible data loss if a crash happens between checkpoints. 
> Also we should make it configurable, with default to false. If the user does not mind slight inconsistencies, this feature can be explicitly enabled through configuration. So if it is not configured, then the behavior will be exactly as it is now.



--
This message was sent by Atlassian JIRA
(v6.2#6252)