You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Michael McCandless (JIRA)" <ji...@apache.org> on 2014/12/17 12:06:13 UTC

[jira] [Created] (LUCENE-6119) Add IndexWriter.getTotalNewBytesWritten

Michael McCandless created LUCENE-6119:
------------------------------------------

             Summary: Add IndexWriter.getTotalNewBytesWritten
                 Key: LUCENE-6119
                 URL: https://issues.apache.org/jira/browse/LUCENE-6119
             Project: Lucene - Core
          Issue Type: Improvement
            Reporter: Michael McCandless
            Assignee: Michael McCandless
             Fix For: 5.0, Trunk


This method returns number of "incoming" bytes IW has written since it
was opened, excluding merging.

It tracks flushed segments, new commits (segments_N), incoming
files/segments by addIndexes, newly written live docs / doc values
updates files.

It's an easy statistic for IW to track and should be useful to help
applications more intelligently set defaults for IO throttling
(RateLimiter).

For example, an application that does hardly any indexing but finally
triggered a large merge can afford to heavily throttle that large
merge so it won't interfere with ongoing searches.

But an application that's causing IW to write new bytes at 50 MB/sec
must set a correspondingly higher IO throttling otherwise merges will
clearly fall behind.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org