small rsync index question

[Brian Whitman <br...@variogr.am>]

I'm not using snap* scripts but i quickly need to sync up two indexes  
on two machines. I am rsyncing the data dirs from A to B, which work  
fine. But how can I see the new index on B? For some reason sending a  
<commit/> is not refreshing the index, and I have to restart resin to  
see it. Is there something else I have to do?

Re: small rsync index question

[Chris Hostetter <ho...@fucit.org>]

: To completely remove the window of inconsistency, comment out the
: post-commit hook in solrconfig.xml that takes a snapshot, then send a
: commit to get a new snapshot and rsync from that.

i think yonik ment "UN-comment" the postCommit hook in the example 
solrconfig.xml.


-Hoss

Re: small rsync index question

[Yonik Seeley <yo...@apache.org>]

On 9/28/07, Brian Whitman <br...@variogr.am> wrote:
> I regularly see
>
> file has vanished: "/dir/solr/data/index/segments_3aut"
>
> when rsyncing, and when that happens i get an error on the rsync'd
> copy. The index I am rsyncing is large (50GB) and very active, is
> constantly getting new docs and searched on. What can I do to
> preserve the index state while syncing?

To greatly reduce this window, take a "snapshot" of the index (do it
like snapshooter, or actually use that script) and rsync from that
snapshot instead.

To completely remove the window of inconsistency, comment out the
post-commit hook in solrconfig.xml that takes a snapshot, then send a
commit to get a new snapshot and rsync from that.

-Yonik

Re: small rsync index question

[Brian Whitman <br...@variogr.am>]

  Sep 28, 2007, at 5:41 PM, Yonik Seeley wrote:
>
> It should... are there any errors in the logs?  do you see the commit
> in the logs?
> Check the stats page to see info about when the current searcher was
> last opened too.
>

ugh, nevermind.. was committing the wrong solr index... but Thanks  
yonik for the response

But luckily I can try save face with a followon question :)

I regularly see

file has vanished: "/dir/solr/data/index/segments_3aut"

when rsyncing, and when that happens i get an error on the rsync'd  
copy. The index I am rsyncing is large (50GB) and very active, is  
constantly getting new docs and searched on. What can I do to  
preserve the index state while syncing?

Re: small rsync index question

[Yonik Seeley <yo...@apache.org>]

On 9/28/07, Brian Whitman <br...@variogr.am> wrote:
> For some reason sending a
> <commit/> is not refreshing the index

It should... are there any errors in the logs?  do you see the commit
in the logs?
Check the stats page to see info about when the current searcher was
last opened too.

-Yonik