You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Amrit Sarkar (JIRA)" <ji...@apache.org> on 2018/07/24 20:07:00 UTC
[jira] [Comment Edited] (SOLR-12572) Reuse fieldvalues computed
while sorting at writing in ExportWriter
[ https://issues.apache.org/jira/browse/SOLR-12572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554736#comment-16554736 ]
Amrit Sarkar edited comment on SOLR-12572 at 7/24/18 8:06 PM:
--------------------------------------------------------------
Thanks Varun; great insights. I am able to put up a patch, with respect to your comments, which optimise for all field types at export writing, except {{MultiFieldWriter}} for now.
was (Author: sarkaramrit2@gmail.com):
Thanks Varun; great insights. I am able to put up a patch which optimise for all field types at export writing, except {{MultiFieldWriter}} for now.
> Reuse fieldvalues computed while sorting at writing in ExportWriter
> -------------------------------------------------------------------
>
> Key: SOLR-12572
> URL: https://issues.apache.org/jira/browse/SOLR-12572
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Components: streaming expressions
> Reporter: Amrit Sarkar
> Assignee: Varun Thacker
> Priority: Minor
> Attachments: S-12572.patch, SOLR-12572.patch, SOLR-12572.patch
>
>
> While exporting result through "/export" handler,
> {code:java}
> http://localhost:8983/solr/core_name/export?q=my-query&sort=severity+desc,timestamp+desc&fl=severity,timestamp,msg
> {code}
> Doc-values are sought for all the {{sort}} fields defined (in this example 'severity, 'timestamp'). When we stream out docs we again make doc-value seeks against the {{fl}} fields ('severity','timestamp','msg') .
> In most common use-cases we have {{fl = sort}} fields, or atleast the sort fields are subset of {{fl}} fields, so if we can *pre-collect* the values while sorting it, we can reduce the doc-value seeks potentially bringing *speed improvement*.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org