[GitHub] [lucene] rmuir opened a new pull request #493: LUCENE-10272: cross-check norms with postings in checkindex

[GitBox <gi...@apache.org>]

rmuir opened a new pull request #493:
URL: https://github.com/apache/lucene/pull/493


   Previously, CheckIndex would iterate norms and validate each one. But if norms that should be there were missing, nothing would fail. Now it computes an expected count of norms and ensures it saw them all.
   
   For now, we just intersect `visitedDocs` with `liveDocs` to get the expected count. 
   
   If we later improve IndexWriter's logic on non-aborting exceptions, we can remove all this livedocs mess and simplify the checks. I'd like to defer that to another issue as my goal is just to improve norms checks here.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org

[GitHub] [lucene] rmuir merged pull request #493: LUCENE-10272: cross-check norms with postings in checkindex

[GitBox <gi...@apache.org>]

rmuir merged pull request #493:
URL: https://github.com/apache/lucene/pull/493


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org