You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Mark Payne (Jira)" <ji...@apache.org> on 2020/04/08 15:17:00 UTC

[jira] [Created] (NIFI-7339) WriteAheadProvenanceRepository ignores "nifi.provenance.repository.rollover.time" property

Mark Payne created NIFI-7339:
--------------------------------

             Summary: WriteAheadProvenanceRepository ignores "nifi.provenance.repository.rollover.time" property
                 Key: NIFI-7339
                 URL: https://issues.apache.org/jira/browse/NIFI-7339
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Core Framework
            Reporter: Mark Payne


The Persistent Provenance Repository allows users to have the Event File roll over periodically based on the value of the "nifi.provenance.repository.rollover.time" property. However, this property is ignored in the WriteAheadProvenanceRepository.

As a result, the repository may write to the same event file for months. This can be problematic for two reasons:

1) the Event Time Offset could eventually overflow after Integer.MAX_VALUE milliseconds have elapsed.

2) Events that are expected to be aged off after, say 24 hours, may be kept around much longer if not much data is written to the Provenance repository.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)