[jira] [Updated] (NIFI-2087) Provenance Repository still removing events from Lucene Index

["Joseph Percivall (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NIFI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joseph Percivall updated NIFI-2087:
-----------------------------------
    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

> Provenance Repository still removing events from Lucene Index
> -------------------------------------------------------------
>
>                 Key: NIFI-2087
>                 URL: https://issues.apache.org/jira/browse/NIFI-2087
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>             Fix For: 1.0.0
>
>
> NIFI-756 was implemented in NiFi 0.3.0 to change the way in which we remove events from the Lucene Indexes. It appears, though, that we still are using the DeleteIndexAction to remove events from the Lucene Index, in addition to the code that was added. As a result, we are removing events from the lucene index, in addition to the newer mechanism of just deleting the index files when they are no longer relevant.
> We should be able to simply stop using the DeleteIndexAction in PersistentProvenanceRepository and then test by starting NiFi with a small index shard size (say 25 MB), create a lot of data, such that some of the data ages off. We should  then be able to verify that queries no longer show the data and be able to look in the provenance repository directory to verify that the old index-* directories are getting deleted.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)