You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Mark Payne (Jira)" <ji...@apache.org> on 2020/04/08 15:17:00 UTC
[jira] [Created] (NIFI-7339) WriteAheadProvenanceRepository ignores
"nifi.provenance.repository.rollover.time" property
Mark Payne created NIFI-7339:
--------------------------------
Summary: WriteAheadProvenanceRepository ignores "nifi.provenance.repository.rollover.time" property
Key: NIFI-7339
URL: https://issues.apache.org/jira/browse/NIFI-7339
Project: Apache NiFi
Issue Type: Improvement
Components: Core Framework
Reporter: Mark Payne
The Persistent Provenance Repository allows users to have the Event File roll over periodically based on the value of the "nifi.provenance.repository.rollover.time" property. However, this property is ignored in the WriteAheadProvenanceRepository.
As a result, the repository may write to the same event file for months. This can be problematic for two reasons:
1) the Event Time Offset could eventually overflow after Integer.MAX_VALUE milliseconds have elapsed.
2) Events that are expected to be aged off after, say 24 hours, may be kept around much longer if not much data is written to the Provenance repository.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)