FileNotFoundException on slave after replication - script bug?

[Jim Murphy <ji...@pobox.com>]

We're seeing strange behavior on one of our slave nodes after replication. 
When the new searcher is created we see FileNotFoundExceptions in the log
and the index is strangely invalid/corrupted.

We may have identified the root cause but wanted to run it by the community. 
We figure there is a bug in the snappuller shell script, line 181:

snap_name=`ssh -o StrictHostKeyChecking=no ${master_host} "ls
${master_data_dir}|grep 'snapshot\.'|grep -v wip|sort -r|head -1"` 

This line determines the directory name of the latest snapshot to download
to the slave from the master.  Problem with this line is that it grab the
temporary work directory of a snapshot in progress.  Those temporary
directories are prefixed with  "temp" and as far as I can tell should never
get pulled from the master so its easy to disambiguate.  It seems that this
temp directory, if it exists will be the newest one so if present it will be
the one replicated: FAIL.

We've tweaked the line to exclude any directories starting with "temp":
snap_name=`ssh -o StrictHostKeyChecking=no ${master_host} "ls
${master_data_dir}|grep 'snapshot\.'|grep -v wip|grep -v temp|sort -r|head
-1"` 

This has fixed our local issue, we can submit a patch but wanted a quick
sanity check because I'm surprised its not much more commonly seen.

Jim

-- 
View this message in context: http://www.nabble.com/FileNotFoundException-on-slave-after-replication---script-bug--tp20111313p20111313.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: FileNotFoundException on slave after replication - script bug?

[Chris Hostetter <ho...@fucit.org>]

I think you may be right .... i've opened SOLR-830

: We may have identified the root cause but wanted to run it by the community. 
: We figure there is a bug in the snappuller shell script, line 181:



-Hoss

Boosting Question

["Manepalli, Kalyan" <Ka...@orbitz.com>]

Hi,
	I am working on a usecase where I want to boost a document if
there are certain group of words near the keywords searched by the user.

For eg: if the user is searching for keyword "pool", I want to boost the
documents which have words like "excellent pool", "nice pool", "awesome
pool", etc.

The list of words can be very large. 
Can anyone suggest an optimal solution to do this.

Thanks
Kalyan