You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2016/10/03 07:35:20 UTC

[jira] [Commented] (LUCENE-7457) Default doc values format should optimize for iterator access

    [ https://issues.apache.org/jira/browse/LUCENE-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15541777#comment-15541777 ] 

ASF subversion and git services commented on LUCENE-7457:
---------------------------------------------------------

Commit 2f88bc80c2c1afed975199adb3f340fcec8179aa in lucene-solr's branch refs/heads/master from [~jpountz]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=2f88bc8 ]

LUCENE-7457: Make Lucene54DocValuesFormat's sparse case actually implement an iterator.


> Default doc values format should optimize for iterator access
> -------------------------------------------------------------
>
>                 Key: LUCENE-7457
>                 URL: https://issues.apache.org/jira/browse/LUCENE-7457
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Michael McCandless
>            Assignee: Adrien Grand
>            Priority: Blocker
>             Fix For: master (7.0)
>
>         Attachments: LUCENE-7457.patch
>
>
> In LUCENE-7407 we switched doc values consumption from random access API to an iterator API, but nothing was done there to improve the codec.  We should do that here.
> At a bare minimum we should fix the existing very-sparse case to be a true iterator, and not wrapped with the silly legacy wrappers.
> I think we should also increase the threshold (currently 1%?) when we switch from dense to sparse encoding.  This should fix LUCENE-7253, making merging of sparse doc values efficient ("pay for what you use").
> I'm sure there are many other things to explore to let codecs "take advantage" of the fact that they no longer need to offer random access to doc values.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org