Re: move file as they are with flume

[Jeff Lord <jl...@cloudera.com>]

Are you using the spooling directory source?
We added the ability to just set the basename of a file (without
absolute path) in FLUME-2056. Allow SpoolDir to pass just the filename
that is the source of an event.

On Fri, Feb 28, 2014 at 7:01 AM, Iván Fernández Perea
<iv...@gmail.com> wrote:
> Hi,
>
> I'm a newbie and I'm just wondering if it's possible to move a file from a
> source to a sink as it is (exact file name and the same content). Basically
> a cp or a put operation with hadoop.
>
> I was trying to use fileHeader property in the sink side, but it seems that
> flume creates those files within the absolute folder path (not only the file
> name).
>
>

Re: move file as they are with flume

[Iván Fernández Perea <iv...@gmail.com>]

Hi Jeff,

we are using spooling directory source. Finally we have coded our own
interceptor to add the basename to our events. In the next flume release,
we'll use the basename key as you suggested.

Many thanks,
Iván.


2014-03-03 18:15 GMT+01:00 Jeff Lord <jl...@cloudera.com>:

> Are you using the spooling directory source?
> We added the ability to just set the basename of a file (without
> absolute path) in FLUME-2056. Allow SpoolDir to pass just the filename
> that is the source of an event.
>
> On Fri, Feb 28, 2014 at 7:01 AM, Iván Fernández Perea
> <iv...@gmail.com> wrote:
> > Hi,
> >
> > I'm a newbie and I'm just wondering if it's possible to move a file from
> a
> > source to a sink as it is (exact file name and the same content).
> Basically
> > a cp or a put operation with hadoop.
> >
> > I was trying to use fileHeader property in the sink side, but it seems
> that
> > flume creates those files within the absolute folder path (not only the
> file
> > name).
> >
> >
>



-- 
Visit my blog:
http://java4developers.com/