You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Prajakta Bavikar <Pr...@persistent.co.in> on 2012/09/13 16:30:06 UTC

how to read file which gets continuously updated

Is it possible in flume to read file which gets continuously updated ?
Can it be done using in built sources
Or I will have to write custom source?
-Prajakta

DISCLAIMER
==========
This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.

Re: how to read file which gets continuously updated

Posted by Arvind Prabhakar <ar...@apache.org>.
Hi Prajakta,

You could possibly use the Exec source with the "tail -F /path/to/file"
command. One limitation of this approach is that it does not maintain any
state so you won't be able to resume/restart from a location within the
file. To address those cases, it may be necessary for you to write your own
scripts etc.

Regards,
Arvind

On Thu, Sep 13, 2012 at 7:30 AM, Prajakta Bavikar <
Prajakta_Bavikar@persistent.co.in> wrote:

>  Is it possible in flume to read file which gets continuously updated ?***
> *
>
> Can it be done using in built sources****
>
> Or I will have to write custom source?****
>
> -Prajakta****
>
> DISCLAIMER ========== This e-mail may contain privileged and confidential
> information which is the property of Persistent Systems Ltd. It is intended
> only for the use of the individual or entity to which it is addressed. If
> you are not the intended recipient, you are not authorized to read, retain,
> copy, print, distribute or use this message. If you have received this
> communication in error, please notify the sender and delete all copies of
> this message. Persistent Systems Ltd. does not accept any liability for
> virus infected mails.
>