You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Yura Smolsky <in...@altervision.biz> on 2005/01/07 09:32:48 UTC
Re[2]: RemoteSearcher
Hello, Otis.
Interesting. Nutch doesnt use RemoteSearchable b/b RemoteSearchable is not
very useful? I mean does it suitable for distibuting index process in
parallel on many services or not? Will it give us good performance.
We have RemoteSearchable in the sources, but anyone does not use it. :)
I ask this question, b/c I use PyLucene (very good port in
Python) and I need to realize a lot of things about implementation of
RemoteSearchable in omniORBpy (CORBA). I have big index (3,000,000 docs) and
many fields. I have noticed, that search becomes slower. I want to
distribute index on many servers. Does RemoteSearchable worse of it?
BTW, Is there working demo of nutch with big index?
OG> Nutch (nutch.org) has a pretty sophisticated infrastructure for
OG> distributed searching, but it doesn't use RemoteSearcher.
>>
>> Does anyone know application which based on RemoteSearcher to
>> distribute index on many servers?
>>
Yura Smolsky,
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-dev-help@jakarta.apache.org
RE: Re[2]: RemoteSearcher
Posted by Jean-Francois Halleux <ha...@skynet.be>.
Hi there,
FYI, I've implemented a ParallelMultiSearcher back in January. It is
available in the base package, together with unit tests. Should be easy
enough to build your distributed app from there.
If I'm not mistaking, it could be improved from its threading perspective
(one thread is created per searchable for each search now).
KR,
Jean-Francois Halleux
-----Original Message-----
From: Yura Smolsky [mailto:info@altervision.biz]
Sent: vendredi 7 janvier 2005 9:33
To: Lucene List
Subject: Re[2]: RemoteSearcher
Hello, Otis.
Interesting. Nutch doesnt use RemoteSearchable b/b RemoteSearchable is not
very useful? I mean does it suitable for distibuting index process in
parallel on many services or not? Will it give us good performance.
We have RemoteSearchable in the sources, but anyone does not use it. :)
I ask this question, b/c I use PyLucene (very good port in
Python) and I need to realize a lot of things about implementation of
RemoteSearchable in omniORBpy (CORBA). I have big index (3,000,000 docs)
and
many fields. I have noticed, that search becomes slower. I want to
distribute index on many servers. Does RemoteSearchable worse of it?
BTW, Is there working demo of nutch with big index?
OG> Nutch (nutch.org) has a pretty sophisticated infrastructure for
OG> distributed searching, but it doesn't use RemoteSearcher.
>>
>> Does anyone know application which based on RemoteSearcher to
>> distribute index on many servers?
>>
Yura Smolsky,
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-dev-help@jakarta.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-dev-help@jakarta.apache.org