You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Uwe Schindler (JIRA)" <ji...@apache.org> on 2018/04/23 08:08:00 UTC
[jira] [Comment Edited] (LUCENE-8264) Allow an option to rewrite
all segments
[ https://issues.apache.org/jira/browse/LUCENE-8264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16447703#comment-16447703 ]
Uwe Schindler edited comment on LUCENE-8264 at 4/23/18 8:07 AM:
----------------------------------------------------------------
IndexUpgrader and UpgradeIndexMergePolicy should do the job, but it merges all segments - but won't work cross 7.x/8.x with corrupt offsets. One thing that works: Open old index and merge segment by segment using addIndexes(Leaf/CodecReader) to a completely new one. Important: Do it step by step, so the segments don't get merged. Not sure how this behaves with corrupt offsets.
was (Author: thetaphi):
IndexUpgrader and UpgradeIndexMergePolicy should do the job, but it merges all segments. One thing that works: Open old index and merge segment by segment using addIndexes(Leaf/CodecReader) to a completely new one. Important: Do it step by step, so the segments don't get merged. Not sure how this behaves with corrupt offsets.
> Allow an option to rewrite all segments
> ---------------------------------------
>
> Key: LUCENE-8264
> URL: https://issues.apache.org/jira/browse/LUCENE-8264
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Erick Erickson
> Assignee: Erick Erickson
> Priority: Major
>
> For the background, see SOLR-12259.
> There are several use-cases that would be much easier, especially during upgrades, if we could specify that all segments get rewritten.
> One example: Upgrading 5x->6x->7x. When segments are merged, they're rewritten into the current format. However, there's no guarantee that a particular segment _ever_ gets merged so the 6x-7x upgrade won't necessarily be successful.
> How many merge policies support this is an open question. I propose to start with TMP and raise other JIRAs as necessary for other merge policies.
> So far the usual response has been "re-index from scratch", but that's increasingly difficult as systems get larger.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org