Lucene Speed

[Ehson Umrani <em...@live.com>]

Hello,

My name is Ehson Umrani and I am currently running some experiments using Lucene. FOr the expiraments I am running I need Lucene to run as fast as possible. Do you have any suggestions on how to achieve speeds listed on the nightly benchmark page. I am also using 1kb Wikipedia files and the same 2048 MB RAM buffer but the speeds I am getting are not close to the speeds achieved by you guys
Any help would be awesome!!!

Thanks,
Ehson Umrani

Re: Lucene Speed

[Adrien Grand <jp...@gmail.com>]

Have you already checked
https://wiki.apache.org/lucene-java/ImproveIndexingSpeed? Often when
running such benchmarks, the bottleneck is not indexing but opening or
parsing input files, so you should review that part as well.

Le mer. 18 juil. 2018 à 16:12, Ehson Umrani <em...@live.com> a écrit :

> Hello,
>
> My name is Ehson Umrani and I am currently running some experiments using
> Lucene. FOr the expiraments I am running I need Lucene to run as fast as
> possible. Do you have any suggestions on how to achieve speeds listed on
> the nightly benchmark page. I am also using 1kb Wikipedia files and the
> same 2048 MB RAM buffer but the speeds I am getting are not close to the
> speeds achieved by you guys
> Any help would be awesome!!!
>
> Thanks,
> Ehson Umrani
>

Re: Lucene Speed

[Michael McCandless <lu...@mikemccandless.com>]

Hi Ehson,

Have you looked at the luceneutil source code that runs the benchmarks?
https://github.com/mikemccand/luceneutil

The sources are not super clean, but that's what's running the nightly
benchmarks, starting from src/main/perf/Indexer.java.

Mike McCandless

http://blog.mikemccandless.com

On Wed, Jul 18, 2018 at 10:11 AM, Ehson Umrani <em...@live.com> wrote:

> Hello,
>
> My name is Ehson Umrani and I am currently running some experiments using
> Lucene. FOr the expiraments I am running I need Lucene to run as fast as
> possible. Do you have any suggestions on how to achieve speeds listed on
> the nightly benchmark page. I am also using 1kb Wikipedia files and the
> same 2048 MB RAM buffer but the speeds I am getting are not close to the
> speeds achieved by you guys
> Any help would be awesome!!!
>
> Thanks,
> Ehson Umrani
>