You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@solr.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/09/26 14:35:00 UTC

[jira] [Commented] (SOLR-16989) Optimize and consolidate reuse of DocValues iterators for value retrieval

    [ https://issues.apache.org/jira/browse/SOLR-16989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769220#comment-17769220 ] 

ASF subversion and git services commented on SOLR-16989:
--------------------------------------------------------

Commit dafbe800c2f74086b53269f5b5a62988abadb717 in solr's branch refs/heads/main from Michael Gibney
[ https://gitbox.apache.org/repos/asf?p=solr.git;h=dafbe800c2f ]

SOLR-16989: Optimize and consolidate reuse of DocValues iterators for value retrieval (#1938)



> Optimize and consolidate reuse of DocValues iterators for value retrieval
> -------------------------------------------------------------------------
>
>                 Key: SOLR-16989
>                 URL: https://issues.apache.org/jira/browse/SOLR-16989
>             Project: Solr
>          Issue Type: Improvement
>    Affects Versions: main (10.0)
>            Reporter: Michael Gibney
>            Assignee: Michael Gibney
>            Priority: Major
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> DocValues are used for the purpose of arbitrary-order value retrieval mainly in two places:
> # {{ExportWriter}} (for the export handler)
> # {{SolrDocumentFetcher}} (for {{useDocValuesAsStored}})
> {{ExportWriter}} holds a simple optimization to reuse docValues iterators where possible (i.e., where docId doesn't decrease), but there is no such optimization for {{SolrDocumentFetcher}}: for every possible docValues return field, for every doc, a new docValues iterator is pulled (and GC'd). This is especially pathological in the case of many sparse fields, because the hit is incurred regardless of whether the return fields are actually present in any returned docs.
> This issue proposes unifying the docValues iterator caching for both these contexts, with the most immediate practical effect being improved latency of field retrieval for {{useDocValuesAsStored}}.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org