You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by "sandesh.yapuram" <sa...@seclore.com> on 2018/04/17 11:36:34 UTC
A broad question - What could go wrong if I copy paste a live index
and use as backup
I'm sorry for a vague question like this, but lemme narrow it down-
I am trying to take back up of my live lucene index(Max size is 1-3 GBs). I
am completely aware of the cleaner 'replicator' module, but I figured out it
is too much code change for me.
So here's what I am planning - I will copy paste my live index into a backup
folder(without closing index writer/reader or taxonomy reader/writer). I
have found a few issues in this approach:
1. Sometimes filesystem throws error file 'xxx.xx' does not exist
2. Index and Taxonomy may not be in synchronized states
3. When readers are open they may hold files and these files are cleaned
after some time , but if I copy them, they'll stay in the backup too.
4. IndexNotFound Exception 'no segments* file found.'
I have no problems with these types of errors, I can fix it and go ahead.
*What other problems can I run into if I copy paste and later use the
backup?.*
--
Sent from: http://lucene.472066.n3.nabble.com/Lucene-Java-Users-f532864.html
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: A broad question - What could go wrong if I copy paste a live
index and use as backup
Posted by Adrien Grand <jp...@gmail.com>.
Good question, I'm not familiar with the facet module. It doesn't seem like
there is an easy way to take snapshots. Shai or Mike, do you know?
Le mer. 18 avr. 2018 à 14:42, sandesh.yapuram <sa...@seclore.com>
a écrit :
> Thanks Adrien for pointing that out... I am going ahead with
> SnapshotDeletionPolicy.
> I will take backup of my index with this class, but I have run into a
> problem, I can't seem to understand how to take backup of my facets using
> the same deletion policy.
>
>
>
> --
> Sent from:
> http://lucene.472066.n3.nabble.com/Lucene-Java-Users-f532864.html
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
Re: A broad question - What could go wrong if I copy paste a live
index and use as backup
Posted by "sandesh.yapuram" <sa...@seclore.com>.
Thanks Adrien for pointing that out... I am going ahead with
SnapshotDeletionPolicy.
I will take backup of my index with this class, but I have run into a
problem, I can't seem to understand how to take backup of my facets using
the same deletion policy.
--
Sent from: http://lucene.472066.n3.nabble.com/Lucene-Java-Users-f532864.html
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: A broad question - What could go wrong if I copy paste a live
index and use as backup
Posted by Adrien Grand <jp...@gmail.com>.
I'm surprised that you say that you do not have problems with these types
of errors, in some cases you could miss some files that are part of the
last commit point, making the backup impossible to restore?
Have you looked at PersistentSnapshotDeletionPolicy?
Le mar. 17 avr. 2018 à 13:36, sandesh.yapuram <sa...@seclore.com>
a écrit :
> I'm sorry for a vague question like this, but lemme narrow it down-
>
> I am trying to take back up of my live lucene index(Max size is 1-3 GBs). I
> am completely aware of the cleaner 'replicator' module, but I figured out
> it
> is too much code change for me.
>
> So here's what I am planning - I will copy paste my live index into a
> backup
> folder(without closing index writer/reader or taxonomy reader/writer). I
> have found a few issues in this approach:
> 1. Sometimes filesystem throws error file 'xxx.xx' does not exist
> 2. Index and Taxonomy may not be in synchronized states
> 3. When readers are open they may hold files and these files are cleaned
> after some time , but if I copy them, they'll stay in the backup too.
> 4. IndexNotFound Exception 'no segments* file found.'
> I have no problems with these types of errors, I can fix it and go ahead.
>
> *What other problems can I run into if I copy paste and later use the
> backup?.*
>
>
>
> --
> Sent from:
> http://lucene.472066.n3.nabble.com/Lucene-Java-Users-f532864.html
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>