You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@lucene.apache.org by "Adrien Grand (JIRA)" <ji...@apache.org> on 2016/07/29 16:25:20 UTC

[jira] [Updated] (LUCENE-7399) Speed up flush of points v2

     [ https://issues.apache.org/jira/browse/LUCENE-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Adrien Grand updated LUCENE-7399:
---------------------------------
    Attachment: LUCENE-7399.patch

Here is a patch, it contains two main improvements:
 - MutablePointsWriter gets packed values from the ByteBlockPool through a BytesRef rather than copying, this saves a lot of memcpy which seems to improve flush time by about 14% on the IndexTaxis benchmark
 - Radix sort/select gets the ability to detect prefixes that are longer than one byte in a single pass, which seems to help by another 11%, probably by being more cache efficient.

Overall the flush time of IndexTaxis with a 1GB buffer went down from 19.1 secs to 14.6 secs on my machine (-24%).

> Speed up flush of points v2
> ---------------------------
>
>                 Key: LUCENE-7399
>                 URL: https://issues.apache.org/jira/browse/LUCENE-7399
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Adrien Grand
>            Assignee: Adrien Grand
>            Priority: Minor
>         Attachments: LUCENE-7399.patch
>
>
> There are improvements we can make on top of LUCENE-7396 to get ever better flush performance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org