You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Michael McCandless (JIRA)" <ji...@apache.org> on 2015/06/26 18:27:05 UTC

[jira] [Updated] (LUCENE-6617) Reduce FST's ram usage

     [ https://issues.apache.org/jira/browse/LUCENE-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless updated LUCENE-6617:
---------------------------------------
    Attachment: LUCENE-6617.patch

Initial patch, pulled out from LUCENE-6199, but javadocs aren't passing ...

> Reduce FST's ram usage
> ----------------------
>
>                 Key: LUCENE-6617
>                 URL: https://issues.apache.org/jira/browse/LUCENE-6617
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>             Fix For: 5.3, Trunk
>
>         Attachments: LUCENE-6617.patch
>
>
> Spinoff from LUCENE-6199, pulling out just the FST RAM reduction changes.
> The FST data structure tries to be a RAM efficient representation of a sorted map, but there are a few things I think we can do to trim it even more:
>   * Don't store arc and node count: this is available from the Builder if you really want to do something with it.
>   * Don't use the "paged" byte store unless the FST is huge; just use a single byte[]
>   * Some members like lastFrozenNode, reusedBytesPerArc, allowArrayArcs are only used during building, so we should move them to the Builder
>   * We don't need to cache NO_OUTPUT: we can ask the Outputs impl for it



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org