AW: Build suggester in different directory (not /tmp).

[Clemens Wyss DEV <cl...@mysign.ch>]

> I almost guarantee that buildOnCommit will be unsatisfactory
if not "on commit" when should suggestions/spellcheckings be updated? And how? 

Spellchecking/suggestions@solr:  
what are the best (up-to-date) sources/links for spellchecking and suggestions?

-----Ursprüngliche Nachricht-----
Von: Erick Erickson [mailto:erickerickson@gmail.com] 
Gesendet: Mittwoch, 20. Dezember 2017 19:09
An: solr-user <so...@lucene.apache.org>
Betreff: Re: Build suggester in different directory (not /tmp).

bq: this means I will need to set buildOnCommit and buildOnStartup to false.

Be _very_ careful with these settings. Building your suggester can read the stored field(s) from _every_ document in your index to build which can take a very long time (perhaps hours). You'd pay that penalty every time you started Solr or committed docs. I almost guarantee that buildOnCommit will be unsatisfactory.

This is one of those things that works fine for testing a small corpus but can fall over when you scale up.

As for why the suggester gets built in /tmp, perhaps Mike McCandless has magic to control that, nice find and thanks for sharing it!

Best,
Erick

On Wed, Dec 20, 2017 at 9:27 AM, Matthew Roth <mg...@gmail.com> wrote:
> I have an incomplete solution. I was trying to build three suggester's 
> at once. If I added the ?suggest.dictionary=<dict> parameter and built 
> one at a time it worked out fine. However, this means I will need to 
> set buildOnCommit and buildOnStartup to false. This is less than ideal.
> Building in a different directory would still be preferable.
>
>
> Best,
> Matt
>
> On Wed, Dec 20, 2017 at 12:05 PM, Matthew Roth <mg...@gmail.com> wrote:
>
>> Hi List,
>>
>> I am building a few suggester's and I am receiving the error that I 
>> have no space left on device.
>>
>>
>> <lst name="error">
>> <str name="msg">No space left on device</str> <str name="trace">
>> java.io.IOException: No space left on device at 
>> sun.nio.ch.FileDispatcherImpl.write0(Native Method) at ...
>>
>>
>>
>> At first this threw me. df showed I had over 100 G free. the /data 
>> dir the suggester is being constructed from is only 4G. On a 
>> subsequent run I notice that the suggester is first being built in 
>> /tmp. When setting up the LVM I only allotted 2g's to that directory 
>> and I prefer to keep it that way. Is there a way to build the 
>> suggester's in an alternative dir? I am not seeing anything in the 
>> documentation (https://lucene.apache.org/
>> solr/guide/6_6/suggester.html)
>>
>> I should note that I am using solr 6.6.0
>>
>> Best,
>> Matt
>>