[GitHub] [incubator-pinot] siddharthteotia opened a new pull request #6194: Compute absolute docId in lucene collector

[GitBox <gi...@apache.org>]

siddharthteotia opened a new pull request #6194:
URL: https://github.com/apache/incubator-pinot/pull/6194


   The lookup table of lucene docId to pinot docId is built on absolute docIDs. We merge multiple sub-indexes into a single index (to also restrict the number of files) but the internal merge process ignores already pending/running merges. In any case, there could still be few sub-indexes. On the query path, we should compute the absolute docId across sub-indexes to get the correct corresponding pinot docId. 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org

[GitHub] [incubator-pinot] siddharthteotia merged pull request #6194: Compute absolute docId in lucene collector

[GitBox <gi...@apache.org>]

siddharthteotia merged pull request #6194:
URL: https://github.com/apache/incubator-pinot/pull/6194


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org