[jira] [Commented] (FLUME-2595) Add option to checkpoint on file channel shutdown

["Hari Shreedharan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLUME-2595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288009#comment-14288009 ] 

Hari Shreedharan commented on FLUME-2595:
-----------------------------------------

To be fair, I have not seen replay speed of more than a few minutes after FLUME-2155 (which removed a specific edge case that cause the hours-long replay in some cases), but did cause the normal case to become worse - which was fixed by FLUME-2450. So the current replay speed should be in the seconds-range. 

Of course, doing a checkpoint would definitely improve performance on startup.

[~roshan_naik] - Are you planning to work on this one?

> Add option to checkpoint on file channel shutdown
> -------------------------------------------------
>
>                 Key: FLUME-2595
>                 URL: https://issues.apache.org/jira/browse/FLUME-2595
>             Project: Flume
>          Issue Type: Bug
>          Components: File Channel
>    Affects Versions: v1.5.1
>            Reporter: Roshan Naik
>              Labels: channel
>
> Restarting a File channel based agent can take very long, a few hours to evens days in some cases. The reason being the slow replay performance.
> By having the file channel checkpoint on shutdown, this long replay can avoided as there will be nothing to replay on startup.
> A small hit (a few seconds perhaps) will be observed on shutdown to perform the checkpoint.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)