[jira] [Created] (NIFI-1170) TailFile "File to Tail" property should support Wildcards

["Andre (JIRA)" <ji...@apache.org>]

Andre created NIFI-1170:
---------------------------

             Summary: TailFile "File to Tail" property should support Wildcards
                 Key: NIFI-1170
                 URL: https://issues.apache.org/jira/browse/NIFI-1170
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Core Framework
    Affects Versions: 0.4.0
            Reporter: Andre


Because of challenges around log rotation of high volume syslog and app producers, it is customary to logging platform developers to promote file variables based file names such as DynaFiles (rsyslog), Macros(syslog-ng) in order to prevent SIGHUPs being sent to the syslog daemon.

(To certain extent, used even NiFi's has similar patterns, like for example, when one uses Expression Language to set PutHDFS destination file).

The current TailFile strategy suggests rotation patterns like:
{code}
log_folder/app.log
log_folder/app.log.1
log_folder/app.log.2
log_folder/app.log.3
{code}

It is possible to fool the system to accept wildcards by simply using a strategy like:

{code}
log_folder/test1
log_folder/server1
log_folder/server2
log_folder/server3
{code}

And configure

*File To Tail* to * but it feels like a hack, rather than catering for an ever increasingly prevalent use case (DynaFile/macros/etc).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)