Large synonyms file in zookeeper

[Elie Francis <e....@everteam.com.INVALID>]

Hello,

I need to configure 5 analyzers for 5 different languages. For each one a
Synonyms Graph Filter will be configured with a large synonyms file (about
6 Mb). Since it is not recommended to store large amount of data in
zookeeper, is there a way to store the synonyms outside zookeeper ? Maybe
in ".system" collection (blob store) ?
If yes, how to reference these files in the "synonyms" attribute ?

Thanks.

Elie Francis.

Re: Large synonyms file in zookeeper

[Jan Høydahl <ja...@cominvent.com>]

A trick is to put that file in /var/solr/data/my-Collection/conf/myBigDictionary.txt and remove it from zookeeper
Then the ResourceLoader will/should fallback to local file system.

Would be a nice feature to be able to upload a configSet with "bin/solr upconfig" and that large files would automatically be placed in filestore instead of in zookeeper, and that ResourceLoader could fallback to filestore if a resource is not found in zookeeper, but I don't think there is anything yet.

Jan

> 1. feb. 2022 kl. 09:51 skrev Elie Francis <e....@everteam.com.INVALID>:
> 
> Hello,
> 
> I need to configure 5 analyzers for 5 different languages. For each one a
> Synonyms Graph Filter will be configured with a large synonyms file (about
> 6 Mb). Since it is not recommended to store large amount of data in
> zookeeper, is there a way to store the synonyms outside zookeeper ? Maybe
> in ".system" collection (blob store) ?
> If yes, how to reference these files in the "synonyms" attribute ?
> 
> Thanks.
> 
> Elie Francis.