You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@lucene.apache.org by "Atri Sharma (Jira)" <ji...@apache.org> on 2022/08/11 18:52:00 UTC

[jira] [Created] (LUCENE-10679) FairDistributionMergePolicy

Atri Sharma created LUCENE-10679:
------------------------------------

             Summary: FairDistributionMergePolicy
                 Key: LUCENE-10679
                 URL: https://issues.apache.org/jira/browse/LUCENE-10679
             Project: Lucene - Core
          Issue Type: Improvement
            Reporter: Atri Sharma
            Assignee: Atri Sharma


TieredMergePolicy and LogMergePolicy can define merge specifications which have a skew in the distribution of overall "work" (i.e. number of documents to process) amongst threads. This is especially true when the underlying segment distribution is highly skewed.

 

A more optimal distribution can be achieved by performing a variation of the integer partitioning algorithm. Initial tests show a more optimal distribution on a simulated set of skewed segment distributions.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org