[jira] [Commented] (FLUME-2829) Taildir Source doesn't populate Filename

["Andre (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLUME-2829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14975591#comment-14975591 ] 

Andre commented on FLUME-2829:
------------------------------

[~iijima_satoshi], what do you reckon?


> Taildir Source doesn't populate Filename 
> -----------------------------------------
>
>                 Key: FLUME-2829
>                 URL: https://issues.apache.org/jira/browse/FLUME-2829
>             Project: Flume
>          Issue Type: Improvement
>          Components: Sinks+Sources
>    Affects Versions: v1.7.0
>            Reporter: Andre
>
> JIRA issue FLUME-2498 mentions taildir source should be able to populate Filename key in the header, however, this doesn't seem to be available yet.
> Moreover, given the near certainty of taildir sources being used to tail dynamic filenames such as {{$hostname-$year-$month-$day.log}} it would be great to expose the regex groups to the generated headers in a fashion similar to the Regex Extractor Interceptor:
> {code}
> a1.sources.r1.filegroups.f1 = /path/to/my/logfile/([^-]+)-([^-]+)-([^-]+)-([^-]+).log
> a1.sources.r1.filegroups.f1.regexgroups = s1 s2 s3 s4
> a1.sources.r1.filegroups.f1.regexgroups.s1.header = hostname
> a1.sources.r1.filegroups.f1.regexgroups.s2.header = year
> a1.sources.r1.filegroups.f1.regexgroups.s3.header = month
> a1.sources.r1.filegroups.f1.regexgroups.s4.header = day
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)