[jira] [Created] (NIFI-125) Persistent Prov Repo: When Indexing and Expiring log files, should queue up the tasks with bounded queue

["Matt Gilman (JIRA)" <ji...@apache.org>]

Matt Gilman created NIFI-125:
--------------------------------

             Summary: Persistent Prov Repo: When Indexing and Expiring log files, should queue up the tasks with bounded queue
                 Key: NIFI-125
                 URL: https://issues.apache.org/jira/browse/NIFI-125
             Project: Apache NiFi
          Issue Type: Bug
          Components: Extensions
            Reporter: Matt Gilman


Currently, we generate a new thread for each of these, which can result in many threads being created and still failing behind.

Switching to a bounded queue will allow us to also use a thread pool to do the work and allows us to wait until the queue falls below some threshold before adding more work to it, resulting in processing back pressure if prov repo is unable to keep up.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)