[jira] [Commented] (MINIFICPP-2507) TailFile "tail-base-directory" property should support Wildcards

["Ferenc Gerlits (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MINIFICPP-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17909578#comment-17909578 ] 

Ferenc Gerlits commented on MINIFICPP-2507:
-------------------------------------------

{{tail-base-directory}} supports expression language, and wildcards and expression language don't play well together. If we remove expression language support, that may break existing flows.

Instead, I think what we should do is what NiFi does [1], which is to match the {{File to Tail}} regex against the full subdirectory path in "Multiple files" mode when {{tailfile-recursive-lookup}} is {{{}true{}}}. This may also break existing flows, so we'll need to figure out some way to avoid that.

[1] [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/2.1.0/org.apache.nifi.processors.standard.TailFile/index.html]
"... In case recursivity is set to true, the regular expression will be used to match the path starting from the base directory ..."

> TailFile "tail-base-directory" property should support Wildcards
> ----------------------------------------------------------------
>
>                 Key: MINIFICPP-2507
>                 URL: https://issues.apache.org/jira/browse/MINIFICPP-2507
>             Project: Apache NiFi MiNiFi C++
>          Issue Type: Improvement
>            Reporter: Shivani
>            Priority: Major
>
> Currently, the _File to Tail_ property supports wildcards but is limited to a specific directory. Requesting an enhancement that allows specifying a regex pattern in the parent directory of the _tail-base-directory_ property.
> While it is possible to use multiple TailFile processors as a workaround to achieve this, it is often not feasible due to the potentially exhaustive and indeterministic list of files that need to be monitored. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)