lucene scalability query

[sreedevi s <sr...@gmail.com>]

Hi,
   I am doing a scalability analysis for lucene search in my application.I
was running my junits with different sets of data which are like
1K,10K,100K and 1000K. I kept my indexes in memory and then tried accessing
the same test multiple times.ie, I built my index when my test ran first
time and for next consecutive test executions,it reused my available index.
It showed a considerable diminishing search time required.Does lucene cache
the search somehow?
But the confusion arrived when the folowing result was observed

Data

Test case accessed attempt

Index Time(ms)

Search time(ms)

10 K

1

2051

152ms



2



32



3



20









100K

1

4820

136



2



28



3



27

Ideally, it search time should have been higher with 100K data.Why is it
that I get lesser searcher time with 100K data.
Thanks in advance

Best Regards,
Sreedevi S

Re: lucene scalability query

[Toke Eskildsen <te...@statsbiblioteket.dk>]

On Thu, 2015-01-08 at 12:03 +0100, sreedevi s wrote:
>    I am doing a scalability analysis for lucene search in my application.I
> was running my junits with different sets of data which are like
> 1K,10K,100K and 1000K.

[...]

Your table copy-paste did not work. I tried extracting the key data:

10K, attempt 1: 152ms
10K, attempt 2: 32ms
10K, attempt 3: 20ms

100K, attempt 1: 136ms
100K, attempt 2: 28ms
100K, attempt 3: 27ms

> Ideally, it search time should have been higher with 100K data.Why is it
> that I get lesser searcher time with 100K data.

Based on your reported index time, your indexes are tiny. What you are
seeing is probably just statistical flukes. Try re-running your tests a
few times and you will see the numbers change.

- Toke Eskildsen



---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org