[jira] [Created] (SLING-9009) Avoid committing for each skipped package

["Christian Schneider (Jira)" <ji...@apache.org>]

Christian Schneider created SLING-9009:
------------------------------------------

             Summary: Avoid committing for each skipped package
                 Key: SLING-9009
                 URL: https://issues.apache.org/jira/browse/SLING-9009
             Project: Sling
          Issue Type: Improvement
          Components: Content Distribution
    Affects Versions: Content Distribution Journal Core 0.1.6
            Reporter: Christian Schneider
            Assignee: Christian Schneider
             Fix For: Content Distribution Journal Core 0.1.8


We recently added committing offsets for skipped packages too. This improves the behaviour when a new instance starts or restarts that does not yet have recent distribution packages on the topic but has to chew through a lot of packages that are meant for other instances.

Unfortunately this new behaviour creates a lot of stress on the repository as each such commit means a complete transaction. 

So this issues is about going some middle road. Committing the offset for a subset of the packages. This subset can be either defined by waiting a certain time until the next commit or waiting for a certain number of skipped packages until the next commit.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)