You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@lucenenet.apache.org by Foo JH <jh...@extracktor.com> on 2008/04/07 07:17:42 UTC

scability issues

Hello all,

Just want to poll the community if they have any issues running 
lucene.net on index files of 1GB or greater? If so, what are the 
recommended work-arounds?

Re: scability issues +

Posted by Foo JH <jh...@extracktor.com>.
Hello Dean,

That's very encouraging, thanks.


Dean Harding wrote:
> Foo JH wrote:
>> Just want to poll the community if they have any issues running 
>> lucene.net on index files of 1GB or greater? If so, what are the 
>> recommended work-arounds?
>
> One of the indexes we use with Lucene.Net is 66GB. About the only 
> problem we have is that with so many documents (around 7.5 million) is 
> that lots of common search terms are in *lots* of documents. So we 
> basically just set a hard limit on the number of documents we'll 
> return from the lucene index.
>
> That's not a limitation of Lucene, though, that's a limitation of the 
> processing we do with the resultant documents...
>
> Dean.
>


Re: scability issues

Posted by Dean Harding <de...@dload.com.au>.
Foo JH wrote:
> Just want to poll the community if they have any issues running 
> lucene.net on index files of 1GB or greater? If so, what are the 
> recommended work-arounds?

One of the indexes we use with Lucene.Net is 66GB. About the only 
problem we have is that with so many documents (around 7.5 million) is 
that lots of common search terms are in *lots* of documents. So we 
basically just set a hard limit on the number of documents we'll return 
from the lucene index.

That's not a limitation of Lucene, though, that's a limitation of the 
processing we do with the resultant documents...

Dean.