You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Thomas Rega (Issue Comment Edited) (JIRA)" <ji...@apache.org> on 2012/02/07 06:56:59 UTC
[jira] [Issue Comment Edited] (FLUME-457) Persist some tails state
to allow nodes to "continue" from previous positions.
[ https://issues.apache.org/jira/browse/FLUME-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202101#comment-13202101 ]
Thomas Rega edited comment on FLUME-457 at 2/7/12 5:55 AM:
-----------------------------------------------------------
I have written a crude implementation of this feature by modifying the taildirsource and cursor objects so they store positional data of what is being read in XML files in the logdir. Basically, the position of the cursor on the RAF, the last modified DT (stored as a long), and the file size are being stored so one can recover after the flume agent restarts.
Does anyone have any suggestions on how I could change this implementation? I am almost certian that in it's current form, my crude implementation would be rejected.
was (Author: trega):
I have written a crude implementation of this feature by modifying the taildirsource and cursor objects so they store positional data of what is being read in XML files in the logdir.
Does anyone have any suggestions on how I could change this implementation? I am almost certian that in it's current form, my crude implementation would be rejected.
> Persist some tails state to allow nodes to "continue" from previous positions.
> ------------------------------------------------------------------------------
>
> Key: FLUME-457
> URL: https://issues.apache.org/jira/browse/FLUME-457
> Project: Flume
> Issue Type: New Feature
> Components: Sinks+Sources
> Affects Versions: v0.9.4
> Reporter: Jonathan Hsieh
>
> This is likely not something that will be completely robust it is an oft requested feature.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira