[jira] [Created] (OAK-10225) Utility to rate limit writes in case async indexing is delayed

["Thomas Mueller (Jira)" <ji...@apache.org>]

Thomas Mueller created OAK-10225:
------------------------------------

             Summary: Utility to rate limit writes in case async indexing is delayed
                 Key: OAK-10225
                 URL: https://issues.apache.org/jira/browse/OAK-10225
             Project: Jackrabbit Oak
          Issue Type: Improvement
          Components: indexing
            Reporter: Thomas Mueller
            Assignee: Thomas Mueller


An application might writes too much stuff too quickly to the repository. In the extreme case, it might even write so much that the application might need to be stopped.

To avoid this, rate-limiting the writes would be good. For this, we can add a utility class with a method rateLimitWrites(), which can be called in order to limit the writes, in case the async indexes are lagging behind badly.

The method should return immediately if all async indexes are up-to-date (updated in the last 30 seconds).

If indexing lanes are lagging behind, however, the method should wait (using Thread.sleep) for at most 1 minute. If the method is called more than once per minute, it should sleep for at most the time that passed until the last call; that is, an application that is calling it a lot will be paused for up to 50%. This assumes indexes will be able to catch up in this situation.




--
This message was sent by Atlassian Jira
(v8.20.10#820010)