Flume exec tail -f date on apache log

[Guyle Taber <gt...@ebates.com>]

I'm trying to setup a flume source using the exec type and using tail -F on a log file that will be date stamped. The docs indicate typical unix commands would work, but this is not working at all.

agent.sources.apache.command = tail -F /usr/local/apache/localhost/logs/access_log.`date +%Y%m%d`

If I use "tail -F /usr/local/apache/localhost/logs/access_log.`date +%Y%m%d`" at the shell it works perfectly, but used inside the flume.conf for this source, I get nothing.

Is there a way to use the unix date formatting in the source definition in flume.conf?

-- Guyle

Re: Flume exec tail -f date on apache log

[Roshan Naik <ro...@hortonworks.com>]

for advanced commands like that. you will need to additionally use the
'shell' option in the exec source. see the user guide for an example.
-roshan


On Mon, Sep 22, 2014 at 9:29 AM, Guyle Taber <gt...@ebates.com> wrote:

>  I'm trying to setup a flume source using the exec type and using tail -F
> on a log file that will be date stamped. The docs indicate typical unix
> commands would work, but this is not working at all.
>
>
>
> agent.sources.apache.command = tail -F
> /usr/local/apache/localhost/logs/access_log.`date +%Y%m%d`
>
>
>
> If I use "tail -F /usr/local/apache/localhost/logs/access_log.`date
> +%Y%m%d`" at the shell it works perfectly, but used inside the flume.conf
> for this source, I get nothing.
>
>
>
> Is there a way to use the unix date formatting in the source definition in
> flume.conf?
>
>
>
> -- Guyle
>
>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.