Solr on Windows / Linux

[Eswar K <kj...@gmail.com>]

All,

Is there any difference in the way any of the Solr's features work on
Windows/Linux. Ideally it should not as its a java implementation. I was
looking at CollectionsDistribution and its documentation (
http://wiki.apache.org/solr/CollectionDistribution). It appeared that it
uses rsync which is specific to Linux systems.

Does it mean that Collections in Solr are not available on Windows or that
it uses a different mechanism for achieving the same funtionality?

Apart from this are there any other features in solr which are platform
dependent? If so, is it listed anywhere?

Regards,
Eswar

Re: Solr on Windows / Linux

[Norberto Meijome <fr...@meijome.net>]

On Fri, 23 Nov 2007 21:37:14 -0800 (PST)
Chris Hostetter <ho...@fucit.org> wrote:

> 2) the issue with replication/distribution and windows isn't rsync (that 
> is available as part of cygwin) the issue relates to the fact that even 
> though windows has hardlinks, you can't move a hard link to a file while 
> it's open (which is fairly crucial to the way the 
> snapshooter/snapinstaller scripts work)

hmm i hadn't thought of this.

> 
> 3) the scripts provided (and refered to on that wiki page) are only one 
> possible way to do collection distribution that relies on rsync and 
> (movable) hard links.  the "hooks" available in Solr for doing replication 
> are extremely flexible and give you the ability to have arbitrary java 
> code (or arbitrary shell commands) executed on the master when the index 
> is in a stable state to be replicated, and allow you to notify the slave 
> when it should re-open the index using a simple HTTP POST.  If anyone 
> is interested in providing new replication utilities specific to windows, 
> i'm sure we could include them with future Solr releases as well.


I'll need to set this up v. soon... i'll see what problems I come up with and how I work it out. I'll post the outcome back :)
B

_________________________
{Beto|Norberto|Numard} Meijome

"Life is just what happens to you,
While your busy making other plans..."
  John Lennon

I speak for myself, not my employer. Contents may be hot. Slippery when wet. Reading disclaimers makes you go blind. Writing them is worse. You have been Warned.

Re: Solr on Windows / Linux

[Chris Hostetter <ho...@fucit.org>]

: looking at CollectionsDistribution and its documentation (
: http://wiki.apache.org/solr/CollectionDistribution). It appeared that it
: uses rsync which is specific to Linux systems.
: 
: Does it mean that Collections in Solr are not available on Windows or that
: it uses a different mechanism for achieving the same funtionality?

1) "collection" as defined on the page you linked to is just refering to 
the lucene index itself.  you can certianly have a Solr index on windows.

2) the issue with replication/distribution and windows isn't rsync (that 
is available as part of cygwin) the issue relates to the fact that even 
though windows has hardlinks, you can't move a hard link to a file while 
it's open (which is fairly crucial to the way the 
snapshooter/snapinstaller scripts work)

3) the scripts provided (and refered to on that wiki page) are only one 
possible way to do collection distribution that relies on rsync and 
(movable) hard links.  the "hooks" available in Solr for doing replication 
are extremely flexible and give you the ability to have arbitrary java 
code (or arbitrary shell commands) executed on the master when the index 
is in a stable state to be replicated, and allow you to notify the slave 
when it should re-open the index using a simple HTTP POST.  If anyone 
is interested in providing new replication utilities specific to windows, 
i'm sure we could include them with future Solr releases as well.




-Hoss

Re: Solr on Windows / Linux

[Norberto Meijome <fr...@meijome.net>]

On Tue, 20 Nov 2007 10:55:04 +0530
"Eswar K" <kj...@gmail.com> wrote:

> Is there any difference in the way any of the Solr's features work on
> Windows/Linux. 


Hi Eswar,
I am developing on FreeBSD 6.2 and 7, testing on a VM with Windows 2003 Server, and deploying for now, on Win32 too. We will very possibly deploy to *nix servers at a later stage (when we start to have dedicated servers for the SOLR component).

I haven't found any issues across platforms, other than the new line - for some reason, SOLR didnt seem to like the new line as read from the system environment under Win32 - defaulting to unix's \n was enough to fix it.

> Ideally it should not as its a java implementation. I was
> looking at CollectionsDistribution and its documentation (
> http://wiki.apache.org/solr/CollectionDistribution). It appeared that it
> uses rsync which is specific to Linux systems.

use cygwin for this. I haven't used it for solr, but i've used it extensively elsewhere when I have to endure win32.

cheers,
B

_________________________
{Beto|Norberto|Numard} Meijome

Exhilaration is that feeling you get just after a great idea hits you,
and just before you realize what is wrong with it.

I speak for myself, not my employer. Contents may be hot. Slippery when wet. Reading disclaimers makes you go blind. Writing them is worse. You have been Warned.