[jira] [Updated] (NIFI-3039) Provenance Repository - Fix PurgeOldEvent and Rollover Size Limits

["Joe Skora (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NIFI-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joe Skora updated NIFI-3039:
----------------------------
    Status: Patch Available  (was: Open)

> Provenance Repository - Fix PurgeOldEvent and Rollover Size Limits
> ------------------------------------------------------------------
>
>                 Key: NIFI-3039
>                 URL: https://issues.apache.org/jira/browse/NIFI-3039
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>    Affects Versions: 0.7.1, 1.0.0, 1.1.0, 0.8.0
>            Reporter: Joe Skora
>            Assignee: Joe Skora
>
> Current {purgeOldEvents} logic triggers cleanup when 90% of space is used, but it only removes one file if usage is under 100%, causing thrashing around 100% usage.  In testing, cleanup up to 70% after hitting 90% makes the system run more smoothly.
> Also, {rollover} will not trigger cleanup unless 110% of the allowed space is in use, changing this to 100% also make a difference in testing.
> Before these changes, a test system that generates huge amounts of provenance would become unstable and stop processing provenance until restarted.  With these changes, the system consistently recovers even under heavy load.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)