You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Georg Bottenhofer <ge...@x75.net> on 2016/09/14 02:12:58 UTC
Issues with Solr 6.2 Backup/Restore feature
Hi.
We have two Systems running in different Datacenters. The second system is a failover system with about one hour difference in Data what is OK for us.
Until Solr 5.5.3 we used a hack with the „replication/snapshot“-Tool to copy the indizes over and it worked quite well. A few days ago we upgraded our staging-system to Solr 6.2.0 and wanted to try the new collections backup/restore tool.
First I tried to backup an index with about 50MByte and restored it multiple times to another solr-system with success. Now I took a copy of the Live-System (about 350MB) and failed.
I run the Backup with:
curl 'http://localhost:8983/solr/admin/collections?action=BACKUP&name=mybackup&collection=collection1&location=/backup/'
and wanted to restore it the other system after copying the files via tgz to the same directory structure with:
curl 'http://localhost:8983/solr/admin/collections?action=RESTORE&name=mybackup&location=/tmp/backup/&collection=collection1'
I pasted a copy of the Error here:
http://pastebin.com/T1C2BxcC
I already tried to get help in the IRC-Channel, but elyograg mentioned I have to post this at the mailing list, hoping you could give me a clue what I am doing wrong.
All systems are running with:
- Solr 6.2.0
- Zookeeper 3.4.9
- java version „1.8.0_101"
- 16 GB RAM
Thanks for your help in advance.
Mit freundlichem Gruß
Georg Bottenhofer
--------------------------------------------------------------------------
Kennst du schon WerStreamt.es<http://werstreamt.es>?
Prüfe die Verfügbarkeit von Filmen und Serien
bei iTunes, Watchever, Maxdome u.v.m.
Im Web und als App: https://www.werstreamt.es/
--------------------------------------------------------------------------
x75 GmbH
Onlinelösungen | Werbekonzeption | Designleistungen
Orleansstraße 45a
81667 München
T. 089 6244 759-63
F. 089 6244 759-860
Georg.Bottenhofer@x75.net<ma...@x75.net>
--------------------------------------------------------------------------
x75 GmbH
Sitz: Orleansstraße 45a, 81667 München Amtsgericht München HRB 178409
Geschäftsführer: Johannes Hammersen
Ust-Id: DE264251090
Re: Issues with Solr 6.2 Backup/Restore feature
Posted by Georg Bottenhofer <ge...@x75.net>.
Hi Hrishikesh,
unfortunately there’s no output with Level Warning or higher at the Live-System :(
I checked solr.log, solr-8983-console.log and solr_gc.log.
Mit freundlichem Gruß
Georg Bottenhofer
--------------------------------------------------------------------------
Kennst du schon WerStreamt.es<http://werstreamt.es>?
Prüfe die Verfügbarkeit von Filmen und Serien
bei iTunes, Watchever, Maxdome u.v.m.
Im Web und als App: https://www.werstreamt.es/
--------------------------------------------------------------------------
x75 GmbH
Onlinelösungen | Werbekonzeption | Designleistungen
Orleansstraße 45a
81667 München
T. 089 6244 759-63
F. 089 6244 759-860
Georg.Bottenhofer@x75.net<ma...@x75.net>
--------------------------------------------------------------------------
x75 GmbH
Sitz: Orleansstraße 45a, 81667 München Amtsgericht München HRB 178409
Geschäftsführer: Johannes Hammersen
Ust-Id: DE264251090
Am 14.09.2016 um 06:01 schrieb Hrishikesh Gadre <ga...@gmail.com>>:
Hi Georg,
It looks like "_2ag9.si<http://2ag9.si>" file is missing in the snapshot.shard1 folder of
the backup. Can you try running Lucene CheckIndex tool on the
snapshot.shard1 folder ?
Also can you post the logs during the backup creation as well?
Thanks
Hrishikesh
On Tue, Sep 13, 2016 at 7:12 PM, Georg Bottenhofer <
georg.bottenhofer@x75.net<ma...@x75.net>> wrote:
Hi.
We have two Systems running in different Datacenters. The second system is
a failover system with about one hour difference in Data what is OK for us.
Until Solr 5.5.3 we used a hack with the „replication/snapshot“-Tool to
copy the indizes over and it worked quite well. A few days ago we upgraded
our staging-system to Solr 6.2.0 and wanted to try the new collections
backup/restore tool.
First I tried to backup an index with about 50MByte and restored it
multiple times to another solr-system with success. Now I took a copy of
the Live-System (about 350MB) and failed.
I run the Backup with:
curl 'http://localhost:8983/solr/admin/collections?action=
BACKUP&name=mybackup&collection=collection1&location=/backup/'
and wanted to restore it the other system after copying the files via tgz
to the same directory structure with:
curl 'http://localhost:8983/solr/admin/collections?action=
RESTORE&name=mybackup&location=/tmp/backup/&collection=collection1'
I pasted a copy of the Error here:
http://pastebin.com/T1C2BxcC
I already tried to get help in the IRC-Channel, but elyograg mentioned I
have to post this at the mailing list, hoping you could give me a clue what
I am doing wrong.
All systems are running with:
- Solr 6.2.0
- Zookeeper 3.4.9
- java version „1.8.0_101"
- 16 GB RAM
Thanks for your help in advance.
Mit freundlichem Gruß
Georg Bottenhofer
--------------------------------------------------------------------------
Kennst du schon WerStreamt.es<http://werstreamt.es>?
Prüfe die Verfügbarkeit von Filmen und Serien
bei iTunes, Watchever, Maxdome u.v.m.
Im Web und als App: https://www.werstreamt.es/
--------------------------------------------------------------------------
x75 GmbH
Onlinelösungen | Werbekonzeption | Designleistungen
Orleansstraße 45a
81667 München
T. 089 6244 759-63
F. 089 6244 759-860
Georg.Bottenhofer@x75.net<ma...@x75.net>
--------------------------------------------------------------------------
x75 GmbH
Sitz: Orleansstraße 45a, 81667 München Amtsgericht München HRB 178409
Geschäftsführer: Johannes Hammersen
Ust-Id: DE264251090
Re: Issues with Solr 6.2 Backup/Restore feature
Posted by Hrishikesh Gadre <ga...@gmail.com>.
Hi Georg,
It looks like "_2ag9.si" file is missing in the snapshot.shard1 folder of
the backup. Can you try running Lucene CheckIndex tool on the
snapshot.shard1 folder ?
Also can you post the logs during the backup creation as well?
Thanks
Hrishikesh
On Tue, Sep 13, 2016 at 7:12 PM, Georg Bottenhofer <
georg.bottenhofer@x75.net> wrote:
> Hi.
>
> We have two Systems running in different Datacenters. The second system is
> a failover system with about one hour difference in Data what is OK for us.
>
> Until Solr 5.5.3 we used a hack with the „replication/snapshot“-Tool to
> copy the indizes over and it worked quite well. A few days ago we upgraded
> our staging-system to Solr 6.2.0 and wanted to try the new collections
> backup/restore tool.
>
> First I tried to backup an index with about 50MByte and restored it
> multiple times to another solr-system with success. Now I took a copy of
> the Live-System (about 350MB) and failed.
>
> I run the Backup with:
>
> curl 'http://localhost:8983/solr/admin/collections?action=
> BACKUP&name=mybackup&collection=collection1&location=/backup/'
>
> and wanted to restore it the other system after copying the files via tgz
> to the same directory structure with:
>
> curl 'http://localhost:8983/solr/admin/collections?action=
> RESTORE&name=mybackup&location=/tmp/backup/&collection=collection1'
>
> I pasted a copy of the Error here:
> http://pastebin.com/T1C2BxcC
>
> I already tried to get help in the IRC-Channel, but elyograg mentioned I
> have to post this at the mailing list, hoping you could give me a clue what
> I am doing wrong.
>
> All systems are running with:
> - Solr 6.2.0
> - Zookeeper 3.4.9
> - java version „1.8.0_101"
> - 16 GB RAM
>
> Thanks for your help in advance.
>
> Mit freundlichem Gruß
> Georg Bottenhofer
>
> --------------------------------------------------------------------------
> Kennst du schon WerStreamt.es<http://werstreamt.es>?
>
> Prüfe die Verfügbarkeit von Filmen und Serien
> bei iTunes, Watchever, Maxdome u.v.m.
>
> Im Web und als App: https://www.werstreamt.es/
> --------------------------------------------------------------------------
>
>
> x75 GmbH
> Onlinelösungen | Werbekonzeption | Designleistungen
>
> Orleansstraße 45a
> 81667 München
>
> T. 089 6244 759-63
> F. 089 6244 759-860
>
> Georg.Bottenhofer@x75.net<ma...@x75.net>
>
>
> --------------------------------------------------------------------------
> x75 GmbH
> Sitz: Orleansstraße 45a, 81667 München Amtsgericht München HRB 178409
> Geschäftsführer: Johannes Hammersen
> Ust-Id: DE264251090
>
>