You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org> on 2012/12/10 23:57:21 UTC
[jira] [Updated] (FLUME-1754) augment Spooling Directory Source
with a filemask property
[ https://issues.apache.org/jira/browse/FLUME-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jarek Jarcec Cecho updated FLUME-1754:
--------------------------------------
Labels: newbie (was: )
> augment Spooling Directory Source with a filemask property
> ----------------------------------------------------------
>
> Key: FLUME-1754
> URL: https://issues.apache.org/jira/browse/FLUME-1754
> Project: Flume
> Issue Type: Improvement
> Reporter: Roman Shaposhnik
> Labels: newbie
>
> Since the contract with Spooling Directory Source is that the files that are given to it are NOT supposed to be appended to, the only reliable way to satisfy it right now is to have a spooling subdirectory into which real files get symlinked or renamed (copying doesn't cut it since there's a race condition between flume seeing the file and cp actually closing it).
> The above works, but is clunky. It would be much nicer if I can point flume to a subdirectory AND also tell it to only pay attention to the files that match a particular mask. This would enable me to configure my log rolling system to roll to filenames that would match the mask and thus feed them to flume (while still appending to the active logs)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira