You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Robert Muir (JIRA)" <ji...@apache.org> on 2013/01/11 16:36:12 UTC
[jira] [Reopened] (LUCENE-4540) Allow packed ints norms
[ https://issues.apache.org/jira/browse/LUCENE-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir reopened LUCENE-4540:
---------------------------------
Assignee: Robert Muir
I plan to revert this for 4.1 to contain the amount of backwards compatibility code we need to implement for LUCENE-4547.
If someone uses this functionality in its current form, they will easily hit the LUCENE-4547 bug.
I implemented this more efficiently with the new APIs in the lucene4547 branch anyway: when it would save RAM, and the # of values is small, it dereferences the unique values and packs ords. This is typically the case with our smallfloat encoding.
> Allow packed ints norms
> -----------------------
>
> Key: LUCENE-4540
> URL: https://issues.apache.org/jira/browse/LUCENE-4540
> Project: Lucene - Core
> Issue Type: Task
> Components: core/index
> Reporter: Robert Muir
> Assignee: Robert Muir
> Fix For: 4.1, 5.0
>
> Attachments: LUCENE-4540.patch
>
>
> I was curious what the performance would be, because it might be useful option to use packedints for norms if you have lots of fields and still want good scoring:
> Today the smallest norm per-field-per-doc you can use is a single byte, and if you have _f_ fields with norms enabled and _n_ docs, it uses _f_ * _n_ bytes of space in RAM.
> Especially if you aren't using index-time boosting (or even if you are, but not with ridiculous values), this could be wasting a ton of RAM.
> But then I noticed there was no clean way to allow you to do this in your Similarity: its a trivial patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org