[jira] [Created] (LUCENE-8321) Allow composite readers to have more than 2B documents

["Adrien Grand (JIRA)" <ji...@apache.org>]

Adrien Grand created LUCENE-8321:
------------------------------------

             Summary: Allow composite readers to have more than 2B documents
                 Key: LUCENE-8321
                 URL: https://issues.apache.org/jira/browse/LUCENE-8321
             Project: Lucene - Core
          Issue Type: Improvement
            Reporter: Adrien Grand


I would like to start discussing removing the limit of ~2B documents that we have for indices, while still enforcing it at the segment level for practical reasons.

Postings, stored fields, and all other codec APIs would keep working on integers to represent doc ids. Only top-level doc ids and numbers of documents would need to move to a long. I say "only" because we now mostly consume indices per-segment, but there is still a number of places where we identify documents by their top-level doc ID like {{IndexReader#document}}, top-docs collectors, etc.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org