You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by "Kevin A. Burton" <bu...@newsmonster.org> on 2004/11/23 00:06:11 UTC

JDBCDirectory to prevent optimize()?

It seems that when compared to other datastores that Lucene starts to 
fall down.  For example lucene doesn't perform online index 
optimizations so if you add 10 documents you have to run optimize() 
again and this isn't exactly a fast operation.

I'm wondering about the potential for a generic JDBCDirectory for 
keeping the lucene index within a database. 

It sounds somewhat unconventional would allow you to perform live 
addDirectory updates without performing an optimize() again.

Has anyone looked at this?  How practical would it be.

Kevin

-- 

Use Rojo (RSS/Atom aggregator).  Visit http://rojo.com. Ask me for an 
invite!  Also see irc.freenode.net #rojo if you want to chat.

Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html

If you're interested in RSS, Weblogs, Social Networking, etc... then you 
should work for Rojo!  If you recommend someone and we hire them you'll 
get a free iPod!
    
Kevin A. Burton, Location - San Francisco, CA
       AIM/YIM - sfburtonator,  Web - http://peerfear.org/
GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: JDBCDirectory to prevent optimize()?

Posted by Daniel Naber <da...@t-online.de>.
On Tuesday 23 November 2004 00:06, Kevin A. Burton wrote:

> I'm wondering about the potential for a generic JDBCDirectory for
> keeping the lucene index within a database.

Such a thing already exists: http://ppinew.mnis.com/jdbcdirectory/, but I 
don't know about its scalability.

Regards
 Daniel

-- 
http://www.danielnaber.de

---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: JDBCDirectory to prevent optimize()?

Posted by Erik Hatcher <er...@ehatchersolutions.com>.
On Nov 23, 2004, at 6:02 PM, Kevin A. Burton wrote:
> Erik Hatcher wrote:
>
>> Also, there is a DBDirectory in the sandbox to store a Lucene index 
>> inside Berkeley DB.
>
> I assume this would prevent prefix queries from working...

Huh?  Why would you assume that?  As far as I know, and I've tested 
this some, a Lucene index inside Berkeley DB works the same as if it 
had been in RAM or on the filesystem.

	Erik


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: JDBCDirectory to prevent optimize()?

Posted by "Kevin A. Burton" <bu...@newsmonster.org>.
Erik Hatcher wrote:

> Also, there is a DBDirectory in the sandbox to store a Lucene index 
> inside Berkeley DB.

I assume this would prevent prefix queries from working...

Kevin

-- 

Use Rojo (RSS/Atom aggregator).  Visit http://rojo.com. Ask me for an 
invite!  Also see irc.freenode.net #rojo if you want to chat.

Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html

If you're interested in RSS, Weblogs, Social Networking, etc... then you 
should work for Rojo!  If you recommend someone and we hire them you'll 
get a free iPod!
    
Kevin A. Burton, Location - San Francisco, CA
       AIM/YIM - sfburtonator,  Web - http://peerfear.org/
GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: JDBCDirectory to prevent optimize()?

Posted by Erik Hatcher <er...@ehatchersolutions.com>.
Also, there is a DBDirectory in the sandbox to store a Lucene index 
inside Berkeley DB.

	Erik

On Nov 22, 2004, at 6:06 PM, Kevin A. Burton wrote:

> It seems that when compared to other datastores that Lucene starts to 
> fall down.  For example lucene doesn't perform online index 
> optimizations so if you add 10 documents you have to run optimize() 
> again and this isn't exactly a fast operation.
>
> I'm wondering about the potential for a generic JDBCDirectory for 
> keeping the lucene index within a database.
> It sounds somewhat unconventional would allow you to perform live 
> addDirectory updates without performing an optimize() again.
>
> Has anyone looked at this?  How practical would it be.
>
> Kevin
>
> -- 
>
> Use Rojo (RSS/Atom aggregator).  Visit http://rojo.com. Ask me for an 
> invite!  Also see irc.freenode.net #rojo if you want to chat.
>
> Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html
>
> If you're interested in RSS, Weblogs, Social Networking, etc... then 
> you should work for Rojo!  If you recommend someone and we hire them 
> you'll get a free iPod!
>    Kevin A. Burton, Location - San Francisco, CA
>       AIM/YIM - sfburtonator,  Web - http://peerfear.org/
> GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org