[jira] [Created] (NIFI-11669) Allow expired entries in distributed cache to be pruned

["Mark Bean (Jira)" <ji...@apache.org>]

Mark Bean created NIFI-11669:
--------------------------------

             Summary: Allow expired entries in distributed cache to be pruned
                 Key: NIFI-11669
                 URL: https://issues.apache.org/jira/browse/NIFI-11669
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
    Affects Versions: 1.21.0
            Reporter: Mark Bean


DetectDuplicate processor adds entries to a DistributedMapCacheClient service. The processor also has an Age Off Duration property. The cached value is removed from the cache only if a subsequent duplicate is detected and the (optional) Age Off Duration has expired. The result is that entries which are beyond their age off duration remain in the cache needlessly and continue to consume memory.

There should be a proactive pruning process to eliminate the expired entries. 

Two thoughts come to mind: using a DistributedMapCache implementation which expires entries. This is the most flexible as other users of the cache would benefit as well. Alternatively, the DetectDuplicate processor could periodically prune the cache.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)