You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucy.apache.org by Peter Karman <pe...@peknet.com> on 2010/02/04 04:35:01 UTC

Re: [Lucy] Index-time RAM consumption settings (was Invalid UTF-8)

Marvin Humphrey wrote on 2/1/10 1:52 PM:

> FWIW, once we fix SortWriter's RAM consumption problem, we'll go back to being
> relatively parsimonious with process RAM.

if that proves true, I think it's a non-issue.

I only raise the flag because in Xapian there's such a dial, an env var setting
a flush threshold, that is often mentioned as a way to control indexing speed
vs. memory use. From what I've seen of KS the indexing speed is much faster and
mem use much lower anyway, so I'm not worrying about it.

Thanks for the detailed reply re: the issues involved.


-- 
Peter Karman  .  http://peknet.com/  .  peter@peknet.com