You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Simon Willnauer (JIRA)" <ji...@apache.org> on 2018/12/09 18:29:00 UTC

[jira] [Comment Edited] (LUCENE-8598) Improve field updates packed values

    [ https://issues.apache.org/jira/browse/LUCENE-8598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16714051#comment-16714051 ] 

Simon Willnauer edited comment on LUCENE-8598 at 12/9/18 6:28 PM:
------------------------------------------------------------------

I ran a benchmark to update 10000 values on a single segment 100 times:

||setup||patch time in ms||master time in ms||
|shared single value|10131|38430|
|random values|30985|69600|

the reason I looked into it is that I wrote the benchmark to test another change that I made and saw the sorting showing up in a profiler spending 99% in the finish method. I also tested other acceptable overhead rations but they didn't show any speedups ie. FAST and FASTEST. 



was (Author: simonw):
I ran a benchmark to update 10000 values on a single segment 100 times:

||setup||patch time in ms||master time in ms||
|shared single value|10131|38430|
|random values|30985|69600|


> Improve field updates packed values
> -----------------------------------
>
>                 Key: LUCENE-8598
>                 URL: https://issues.apache.org/jira/browse/LUCENE-8598
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Simon Willnauer
>            Priority: Major
>             Fix For: master (8.0), 7.7
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
>  DocValuesFieldUpdats are using compact settings for packet ints that causes
>     dramatic slowdowns when the updates are finished and sorted. Moving to the default
>     accepted overhead ratio yields up to 4x improvements in applying updates. This change
>     also improves the packing of numeric values since we know the value range in advance and
>     can choose a different packing scheme in such a case.
>     Overall this change yields a good performance improvement since 99% of the times of applying
>     DV field updates are spend in the sort method which essentially makes applying the updates
>     4x faster.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org