You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Ben Gollmer <be...@jatosoft.com> on 2005/09/01 20:51:15 UTC

Re: IO bandwidth throttling

Chris Lamprecht wrote:
> I've wanted something similar, for the same purpose -- to keep lucene
> from consuming disk I/O resources when another process is running on
> the same machine.

Sorry for jumping in (I'm a Lucene newb) but isn't this better handled
by the OS? On a Unix box I would just renice the process or set some
ulimits. Adding code to each application that might possibly need
bandwidth or memory restrictions seems redundant, not to mention a chore :)


Cheers,
-- 
Ben

Re: IO bandwidth throttling

Posted by Chris Lamprecht <cl...@gmail.com>.
Hi Ben,

Yes -- I would prefer to let the OS handle his, especially if it can
save me some coding.  Is there is a way (under linux) to limit a
certain process's disk utilization?  It seems like nice(1) just
modifies the scheduling priority, I'm assuming this means CPU
scheduling.  In my case, I'm trying to prevent a cron task that
updates the lucene search index from consuming the disk, causing the
search to slow down.

-chris

On 9/1/05, Ben Gollmer <be...@jatosoft.com> wrote:
> Chris Lamprecht wrote:
> > I've wanted something similar, for the same purpose -- to keep lucene
> > from consuming disk I/O resources when another process is running on
> > the same machine.
> 
> Sorry for jumping in (I'm a Lucene newb) but isn't this better handled
> by the OS? On a Unix box I would just renice the process or set some
> ulimits. Adding code to each application that might possibly need
> bandwidth or memory restrictions seems redundant, not to mention a chore :)
> 
> 
> Cheers,
> --
> Ben
> 
> 
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: IO bandwidth throttling

Posted by Dan Armbrust <da...@gmail.com>.
Ben Gollmer wrote:

 >Chris Lamprecht wrote:
 > 
 >
 >>I've wanted something similar, for the same purpose -- to keep lucene
 >>from consuming disk I/O resources when another process is running on
 >>the same machine.
 >>   
 >>
 >
 >Sorry for jumping in (I'm a Lucene newb) but isn't this better handled
 >by the OS? On a Unix box I would just renice the process or set some
 >ulimits. Adding code to each application that might possibly need
 >bandwidth or memory restrictions seems redundant, not to mention a 
chore :)
 >
 >
 >Cheers,
 > 
 >
 As far as I know, 'nice' only controls CPU usage, not disk IO usage.  
Since lucene doesn't do a lot of CPU intensive work, renicing a lucene 
process does little to allow other processes to get access to your disks.

 On Windows, things are similar.  A single process, even with the 
priority forced down, can still kill the performance of the entire 
machine if it is doing large amounts of disk io (on the system disk).

 Dan

-- 
****************************
Daniel Armbrust
Biomedical Informatics
Mayo Clinic Rochester
daniel.armbrust(at)mayo.edu
http://informatics.mayo.edu/
 




---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org