[jira] [Updated] (SOLR-3443) Optimize hunspell dictionary loading with multiple cores

["Gus Heck (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SOLR-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gus Heck updated SOLR-3443:
---------------------------
    Attachment: SOLR-3443.patch

patch requiring SOLR-8349

> Optimize hunspell dictionary loading with multiple cores
> --------------------------------------------------------
>
>                 Key: SOLR-3443
>                 URL: https://issues.apache.org/jira/browse/SOLR-3443
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Luca Cavanna
>         Attachments: SOLR-3443.patch
>
>
> The Hunspell dictionary is actually loaded into memory. Each core using hunspell loads its own dictionary, no matter if all the cores are using the same dictionary files. As a result, the same dictionary is loaded into memory multiple times, once for each core. I think we should share those dictionaries between all cores in order to optimize the memory usage. In fact, let's say a dictionary takes 20MB into memory (this is what I detected), if you have 20 cores you are going to use 400MB only for dictionaries, which doesn't seem a good idea to me.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org