How can we reduce page faults?

[Orit Alul <or...@gmail.com>]

Hi,

We're new to Lucene .net.
We're running queries on a pretty small data size ~500K.
We're running on windows 7 machine with 8GB RAM.
We're using the RAMDirectory.
When we're running queries on the data we notice that there are a lot of
page faults and CPU usage is only ~20%.

Can you please advice ho can we reduce page faults on the expanse of using
more RAM?
We'd like to improve each query's latency.

Please advice,
Thanks,
Orit

RE: How can we reduce page faults?

["Granroth, Neal V." <ne...@thermofisher.com>]

You could try adjusting the Windows, MinWorkingSet property, of the process that executes the queries.
Refer to the Microsoft documentation for System.Diagnostics, Process.MinWorkingSet
- Neal

-----Original Message-----
From: Orit Alul [mailto:oritalul@gmail.com] 
Sent: Tuesday, March 13, 2012 12:17 PM
To: lucene-net-user@lucene.apache.org
Cc: nir.zamir@mediamind.com
Subject: How can we reduce page faults?

Hi,

We're new to Lucene .net.
We're running queries on a pretty small data size ~500K.
We're running on windows 7 machine with 8GB RAM.
We're using the RAMDirectory.
When we're running queries on the data we notice that there are a lot of
page faults and CPU usage is only ~20%.

Can you please advice ho can we reduce page faults on the expanse of using
more RAM?
We'd like to improve each query's latency.

Please advice,
Thanks,
Orit

RE: How can we reduce page faults?

["Miller, Bill (QuickWire)" <bm...@quickwire.com>]

Here's a good link about page faults. Basically you first need to determine whether the faults are 'hard' or 'soft'.
Hard faults means the memory manager is accessing the page file, soft means the page is resident -- big difference.
Typically you would throw ram at your machine to solve hard faults.

http://blogs.technet.com/b/askperf/archive/2008/06/10/the-basics-of-page-faults.aspx

Bill  

-----Original Message-----
From: Orit Alul [mailto:oritalul@gmail.com] 
Sent: Tuesday, March 13, 2012 1:17 PM
To: lucene-net-user@lucene.apache.org
Cc: nir.zamir@mediamind.com
Subject: How can we reduce page faults?

Hi,

We're new to Lucene .net.
We're running queries on a pretty small data size ~500K.
We're running on windows 7 machine with 8GB RAM.
We're using the RAMDirectory.
When we're running queries on the data we notice that there are a lot of page faults and CPU usage is only ~20%.

Can you please advice ho can we reduce page faults on the expanse of using more RAM?
We'd like to improve each query's latency.

Please advice,
Thanks,
Orit