You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flume.apache.org by Guillermo, "Pragsis. (JIRA)" <ji...@apache.org> on 2014/03/10 13:52:44 UTC

[jira] [Created] (FLUME-2344) New source for tailing files

Guillermo Ortiz Fernández, Pragsis. created FLUME-2344:
----------------------------------------------------------

             Summary: New source for tailing files
                 Key: FLUME-2344
                 URL: https://issues.apache.org/jira/browse/FLUME-2344
             Project: Flume
          Issue Type: Improvement
          Components: Sinks+Sources
    Affects Versions: v1.4.0
         Environment: Centos 6.4, Java 1.6.0_34
            Reporter: Guillermo Ortiz Fernández, Pragsis.
             Fix For: v1.4.0


New source to be able to tail a file. There's a extra file when it saves the last offset until it has been read. So, it Flume is down, it could read the data it lost. It has been implemented control about rotated files. 

The possible variables to configure this source are:
-BufferSize gives us the possibility to send little to little.
-Separator to cut the lines wherever we want  to to generate our events.
-WatchedFile to indicate what file we want to watch.
-RotatedFile to indicate where the wacthed file is going to rotate.
-Type of events to indicate if we generate one event per line or we want to group many lines and just emit one event.



--
This message was sent by Atlassian JIRA
(v6.2#6252)