You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "vsop-479 (via GitHub)" <gi...@apache.org> on 2023/10/13 09:38:18 UTC
[I] Make OrdinalMap maps docID to global ordinal directly？ [lucene]
vsop-479 opened a new issue, #12669:
URL: https://github.com/apache/lucene/issues/12669
### Description
OrdinalMap maps segment ordinal to global ordinal. When collecting, we need read segment ordinal by docID, and get global ordinal by segment ordinal.
If OrdinalMap maps docID to global ordinal, we can get global ordinal by docID directly without reading segment ordinal.
It may good to performance, but the global ordinals can not keep monotonic, which may harm to memory.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [I] Make OrdinalMap maps docID to global ordinal directly？ [lucene]
Posted by "vsop-479 (via GitHub)" <gi...@apache.org>.
vsop-479 commented on issue #12669:
URL: https://github.com/apache/lucene/issues/12669#issuecomment-1763633876
> need to store maxDoc global ordinals (one per doc) instead of valueCount global ordinals.
@jpountz Thanks for remind that. I will close this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [I] Make OrdinalMap maps docID to global ordinal directly？ [lucene]
Posted by "jpountz (via GitHub)" <gi...@apache.org>.
jpountz commented on issue #12669:
URL: https://github.com/apache/lucene/issues/12669#issuecomment-1761462109
> the global ordinals can not keep monotonic, which may harm to memory.
The other downside is that you then need to store `maxDoc` global ordinals (one per doc) instead of `valueCount` global ordinals. Combined with the fact that we cannot take advantage of the fact that global ords are monotonic for compression, this would be extremely memory-inefficient.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [I] Make OrdinalMap maps docID to global ordinal directly？ [lucene]
Posted by "vsop-479 (via GitHub)" <gi...@apache.org>.
vsop-479 closed issue #12669: Make OrdinalMap maps docID to global ordinal directly？
URL: https://github.com/apache/lucene/issues/12669
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org