You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "David Smiley (JIRA)" <ji...@apache.org> on 2016/03/24 17:09:25 UTC
[jira] [Commented] (SOLR-6359) Allow customization of the number of
records and logs kept by UpdateLog
[ https://issues.apache.org/jira/browse/SOLR-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15210469#comment-15210469 ]
David Smiley commented on SOLR-6359:
------------------------------------
Maybe I misunderstand the impacts of these configuration options, but why even have a maxNumLogsToKeep? i.e. why isn't it effectively unlimited? I don't care how many internal log files the updateLog would like to do its implementation-detail business, so long as I can specify that it has docs added within the last X minutes, and maybe a minimum number of docs. Sounds reasonable? Because X minutes allows me to specify a server restart worth of time. That 'X' minutes is basically the hard auto commit interval, since that's what truncates the current log to a new file. [~andyetitmoves] in your "heavy indexing setup" couldn't you have just set the auto commit window large enough to your liking?
The current "numRecordsToKeep" (defaulting to 100) doesn't say if it's a min or max; it seems to be implemented as a soft maximum -- the oldest log files will be removed to stay under, but we'll always have at least one log file, however big or small it may be. In my scenario where I basically don't care how many records it actually is (I care about time), I think I can basically ignore this (leave at 100).
> Allow customization of the number of records and logs kept by UpdateLog
> -----------------------------------------------------------------------
>
> Key: SOLR-6359
> URL: https://issues.apache.org/jira/browse/SOLR-6359
> Project: Solr
> Issue Type: Improvement
> Reporter: Ramkumar Aiyengar
> Assignee: Ramkumar Aiyengar
> Priority: Minor
> Fix For: 5.1, master
>
> Attachments: SOLR-6359.patch
>
>
> Currently {{UpdateLog}} hardcodes the number of logs and records it keeps, and the hardcoded numbers (100 records, 10 logs) can be quite low (esp. the records) in an heavily indexing setup, leading to full recovery even if Solr was just stopped and restarted.
> These values should be customizable (even if only present as expert options).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org