You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@couchdb.apache.org by Patrick Barnes <mr...@gmail.com> on 2009/12/22 07:52:37 UTC
Couchdb-lucene and pre-generating indexes?
Hi,
I want to use couchdb-lucene to search approx 350k records - is there a
way to have it build the indexes before starting a search?
I don't seem to be able to get results. So far, I've gotten:
* couchdb-lucene built and installed
* bin/run running (as root for now)
* couchdb configured to talk to couchdb-lucene as per the
rnewson/couchdb page
* a simple index function that just outputs display_name for any
documents with that field.
When I visit http://url:5984/mydb/_fti/couchapp/by_name?q=john - I just
get a timed out message.
Am I doing something wrong, or is the dataset just overwhelming the 60
second time limit?
-Patrick
Re: Couchdb-lucene and pre-generating indexes?
Posted by Robert Newson <ro...@gmail.com>.
Could you specify which version of couchdb-lucene you are using?
In either case, indexing should continue asynchronously from
searching. the 60 second timeout shouldn't matter.
If you are using 0.5, I suggest you "git pull" as I've spent today and
yesterday fixes an awful lot of bugs. :)
B.
On Tue, Dec 22, 2009 at 10:10 PM, Patrick Barnes <mr...@gmail.com> wrote:
> How long would you expect it to typically taken to build a view or a search
> index for 350k docs, if the functions are simple? (Reasonable server
> hardware, 0.10.0 & 0.5)
>
> I'm not sure if something is misconfigured, but its definitely taking longer
> than 60 seconds.
>
> -Patrick
>
> On 23/12/2009 12:02 AM, "Robert Newson" <ro...@gmail.com> wrote:
>
> for 0.4 - indexing should start when you start couchdb, assuming you
> added the update_notification settings.
>
> for 0.5 (not released) - indexing starts on the first query, just like
> view indexing does in couchdb. So just trigger the build by running a
> query (any query) just like the same rule for trigger view building.
>
> I should note that both versions take ?stale=ok will not block for
> updates, returning search results based on what's currently indexed.
>
> On Tue, Dec 22, 2009 at 6:52 AM, Patrick Barnes <mr...@gmail.com> wrote: >
> Hi, > > I want to use ...
>
Re: Couchdb-lucene and pre-generating indexes?
Posted by Patrick Barnes <mr...@gmail.com>.
How long would you expect it to typically taken to build a view or a search
index for 350k docs, if the functions are simple? (Reasonable server
hardware, 0.10.0 & 0.5)
I'm not sure if something is misconfigured, but its definitely taking longer
than 60 seconds.
-Patrick
On 23/12/2009 12:02 AM, "Robert Newson" <ro...@gmail.com> wrote:
for 0.4 - indexing should start when you start couchdb, assuming you
added the update_notification settings.
for 0.5 (not released) - indexing starts on the first query, just like
view indexing does in couchdb. So just trigger the build by running a
query (any query) just like the same rule for trigger view building.
I should note that both versions take ?stale=ok will not block for
updates, returning search results based on what's currently indexed.
On Tue, Dec 22, 2009 at 6:52 AM, Patrick Barnes <mr...@gmail.com> wrote: >
Hi, > > I want to use ...
Re: Couchdb-lucene and pre-generating indexes?
Posted by Robert Newson <ro...@gmail.com>.
for 0.4 - indexing should start when you start couchdb, assuming you
added the update_notification settings.
for 0.5 (not released) - indexing starts on the first query, just like
view indexing does in couchdb. So just trigger the build by running a
query (any query) just like the same rule for trigger view building.
I should note that both versions take ?stale=ok will not block for
updates, returning search results based on what's currently indexed.
On Tue, Dec 22, 2009 at 6:52 AM, Patrick Barnes <mr...@gmail.com> wrote:
> Hi,
>
> I want to use couchdb-lucene to search approx 350k records - is there a way
> to have it build the indexes before starting a search?
>
>
> I don't seem to be able to get results. So far, I've gotten:
> * couchdb-lucene built and installed
> * bin/run running (as root for now)
> * couchdb configured to talk to couchdb-lucene as per the rnewson/couchdb
> page
> * a simple index function that just outputs display_name for any documents
> with that field.
>
> When I visit http://url:5984/mydb/_fti/couchapp/by_name?q=john - I just get
> a timed out message.
>
>
> Am I doing something wrong, or is the dataset just overwhelming the 60
> second time limit?
>
> -Patrick
>