You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Christoph Langheld (Jira)" <ji...@apache.org> on 2022/01/17 13:12:00 UTC
[jira] [Updated] (NIFI-9577) GetFile and ListFile list no files if Path Filter is not empty
[ https://issues.apache.org/jira/browse/NIFI-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christoph Langheld updated NIFI-9577:
-------------------------------------
Description:
Hello,
under special circumstances GetFile and ListFile do not process files.
To reproduce the problem I attached a template: [^GetFile-ListFile-Problem.xml]
The template generates every minute (0 0/1 * ? * MON-SAT) a flow file of 10B and stores it locally in a *new* ( ! ) folder: tmp/prod/cltest/${*}{now():format('yyyyMMdd-HHmm')}{*}/gaz/artikel.
GetFile and ListFile run about 30 seconds after GenerateFlowFile processor(35 0/1 * ? * MON-SAT). For both processors the input directory is: tmp/prod/cltest/${now():format('yyyyMMdd-HHmm')}/.
Path Filter is set to: ((anzg)|(gaz))\/artikel
The first time when the processors are running the result set of each processor contains 1 file.
After the first run the result will always be empty. There occurs no error. It's only empty.
!workflow.png|width=813,height=449!
We use NiFi versions 1.11.4 and 1.15.2. Both have the same problem.
Could you please have a look on it.
Thank you and regards
Christoph
was:
Hello,
the Input Directory parameter of GetFile and ListFile contains ${now():format('yyyyMMdd-HHmm')}.
GetFile and ListFile are scheduled every minute (via CRON).
If Path Filter of GetFile or ListFile contains a value (e.g.: ((anzg)|(gaz)\/artikel) then both processors only return files the first time they are running. After that they return nothing.
To reproduce I attached a template: [^GetFile-ListFile-Problem.xml]
The template generates every minute (0 0/1 * ? * MON-SAT) a flow file of 10B. This file will be stored under tmp/prod/cltest/${now():format('yyyyMMdd-HHmm')}/gaz/artikel.
GetFile and ListFile run about 30 seconds after GenerateFlowFile processor(35 0/1 * ? * MON-SAT). The first time they are running the result set of each processor contains 1 file.
After that it will be always empty.
!workflow.png|width=813,height=449!
We use NiFi versions 1.11.4 and 1.15.2. Both have the same problem.
Could you please have a look on it.
Thank you and regards
Christoph
> GetFile and ListFile list no files if Path Filter is not empty
> --------------------------------------------------------------
>
> Key: NIFI-9577
> URL: https://issues.apache.org/jira/browse/NIFI-9577
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.15.2
> Reporter: Christoph Langheld
> Priority: Major
> Attachments: GetFile-ListFile-Problem.xml, workflow.png
>
>
> Hello,
> under special circumstances GetFile and ListFile do not process files.
> To reproduce the problem I attached a template: [^GetFile-ListFile-Problem.xml]
> The template generates every minute (0 0/1 * ? * MON-SAT) a flow file of 10B and stores it locally in a *new* ( ! ) folder: tmp/prod/cltest/${*}{now():format('yyyyMMdd-HHmm')}{*}/gaz/artikel.
> GetFile and ListFile run about 30 seconds after GenerateFlowFile processor(35 0/1 * ? * MON-SAT). For both processors the input directory is: tmp/prod/cltest/${now():format('yyyyMMdd-HHmm')}/.
> Path Filter is set to: ((anzg)|(gaz))\/artikel
> The first time when the processors are running the result set of each processor contains 1 file.
> After the first run the result will always be empty. There occurs no error. It's only empty.
> !workflow.png|width=813,height=449!
> We use NiFi versions 1.11.4 and 1.15.2. Both have the same problem.
> Could you please have a look on it.
> Thank you and regards
> Christoph
--
This message was sent by Atlassian Jira
(v8.20.1#820001)