You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Koji Kawamura (JIRA)" <ji...@apache.org> on 2016/12/16 03:36:58 UTC

[jira] [Created] (NIFI-3213) ListFile always skips files with the latest timestamp in an iteration even if the files have existed a while ago

Koji Kawamura created NIFI-3213:
-----------------------------------

             Summary: ListFile always skips files with the latest timestamp in an iteration even if the files have existed a while ago
                 Key: NIFI-3213
                 URL: https://issues.apache.org/jira/browse/NIFI-3213
             Project: Apache NiFi
          Issue Type: Bug
          Components: Extensions
    Affects Versions: 0.7.1, 1.1.0, 0.6.1, 0.7.0, 0.5.1, 0.6.0, 0.5.0, 1.0.0
            Reporter: Koji Kawamura


NIFI-1484 add few lines of code to avoid files to be emitted if those have the latest timestamp within an iteration of listing, because it may still be written at the same time.

While it doesn't affect much if ListFiles processor is scheduled with a short period of time, such as few ms, but it does affect negatively if an user scheduled it with longer run schedule such as "1 day" or with cron scheduler. 

For example, user would expect to process list of files per daily basis. Even if a file is saved few hours ago, the processor will skip this, because the file has the latest timestamp within the iteration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)