[jira] [Created] (NIFI-7346) Provenance Repository can stop producing data and become empty

["Mark Payne (Jira)" <ji...@apache.org>]

Mark Payne created NIFI-7346:
--------------------------------

             Summary: Provenance Repository can stop producing data and become empty
                 Key: NIFI-7346
                 URL: https://issues.apache.org/jira/browse/NIFI-7346
             Project: Apache NiFi
          Issue Type: Bug
          Components: Core Framework
            Reporter: Mark Payne
            Assignee: Mark Payne


The Provenance Repository is designed to periodically age off old data. This is done by looking at the Last Modified Time for all event files, and then removing any file whose Last Modified Time is longer than the configured "nifi.provenance.repository.max.storage.time" time.

However, it does this without first checking if the event file is the "active" event file. As a result, it can delete the event file while it is being written to. If this happens, on Linux and OSX, the delete will succeed and any further writes to the underlying file handle will simply disappear. And checking the size of the file will always return 0.

As a result, the Event File will never roll over because it never reaches the max size. And it doesn't roll over based on time due to NIFI-7339. As a result, all data will be aged off from the Provenance Repository and no new data will be added until restart.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)