You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Philipp Trulson <p....@rebuy.com> on 2020/10/16 17:39:18 UTC
Backup fails despite allowPaths=* being set
Hello everyone,
we are having problems with our backup script since we upgraded to Solr
8.6.2 on kubernetes. To be more precise the message is
*Path /data/backup/2020-10-16/collection must be relative to SOLR_HOME,
SOLR_DATA_HOME coreRootDirectory. Set system property 'solr.allowPaths' to
add other allowed paths.*
I executed the script by calling this endpoint
*curl
'http://solr.default.svc.cluster.local/solr/admin/collections?action=BACKUP&name=collection&collection=
<http://solr.default.svc.cluster.local/solr/admin/collections?action=BACKUP&name=collection&collection=>*
collection*&location=/data/backup/2020-10-16&async=1114'*
The strange thing is that all 5 nodes are started with *-Dsolr.allowPaths=**,
so in theory it should work. The folder is an AWS EFS share, that's the
only reason I can imagine. Or can I check any other options?
Thank you for your help!
Philipp
--
<https://www.rebuy.de/>
reBuy reCommerce GmbH* · *Potsdamer Str. 188* ·
*10783 Berlin* · *Geschäftsführer: Dr. Philipp GattnerSitz und
Registergericht: Berlin, Amtsgericht Charlottenburg, HRB 109344 B,
*USt-ID-Nr.:* DE237458635
Re: Backup fails despite allowPaths=* being set
Posted by Philipp Trulson <p....@rebuy.com>.
Thanks for the answer! We added the line and now everything is working as
expected. Sorry for not reading the manual properly :)
Philipp
Am Mo., 26. Okt. 2020 um 09:27 Uhr schrieb Jan Høydahl <
jan.asf@cominvent.com>:
> According to the source code here
>
>
> https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.6.2/solr/core/src/java/org/apache/solr/core/SolrPaths.java#L134
>
> your allowPaths value is NOT equal to «*» (which is stored as _ALL_)
> (parsed here
> https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.6.2/solr/core/src/java/org/apache/solr/core/SolrXmlConfig.java#L311
> )
>
>
> Please check your solr.xml file, it needs to contain this line
>
> https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.6.2/solr/server/solr/solr.xml#L33
>
> Jan
>
> > 22. okt. 2020 kl. 15:57 skrev Philipp Trulson <p....@rebuy.com>:
> >
> > I'm sure that this is not the case. On the Java Properties page it says
> > "solr.allowPaths *", on the dashboard I can verify that the
> > "-Dsolr.allowPaths=*" option is present.
> >
> > Am Mi., 21. Okt. 2020 um 19:10 Uhr schrieb Jan Høydahl <
> > jan.asf@cominvent.com>:
> >
> >> Are you sure the * is not eaten by the shell since it’s a special char?
> >> You can view the sys props in admin UI to check.
> >>
> >> Jan Høydahl
> >>
> >>> 16. okt. 2020 kl. 19:39 skrev Philipp Trulson <p....@rebuy.com>:
> >>>
> >>> Hello everyone,
> >>>
> >>> we are having problems with our backup script since we upgraded to Solr
> >>> 8.6.2 on kubernetes. To be more precise the message is
> >>> *Path /data/backup/2020-10-16/collection must be relative to SOLR_HOME,
> >>> SOLR_DATA_HOME coreRootDirectory. Set system property 'solr.allowPaths'
> >> to
> >>> add other allowed paths.*
> >>>
> >>> I executed the script by calling this endpoint
> >>> *curl
> >>> '
> >>
> http://solr.default.svc.cluster.local/solr/admin/collections?action=BACKUP&name=collection&collection=
> >>> <
> >>
> http://solr.default.svc.cluster.local/solr/admin/collections?action=BACKUP&name=collection&collection=
> >>> *
> >>> collection*&location=/data/backup/2020-10-16&async=1114'*
> >>>
> >>> The strange thing is that all 5 nodes are started with
> >> *-Dsolr.allowPaths=**,
> >>> so in theory it should work. The folder is an AWS EFS share, that's the
> >>> only reason I can imagine. Or can I check any other options?
> >>>
> >>> Thank you for your help!
> >>> Philipp
> >>>
> >>> --
> >>>
> >>>
> >>> <https://www.rebuy.de/>
> >>>
> >>> reBuy reCommerce GmbH* · *Potsdamer Str. 188* ·
> >>> *10783 Berlin* · *Geschäftsführer: Dr. Philipp GattnerSitz und
> >>> Registergericht: Berlin, Amtsgericht Charlottenburg, HRB 109344 B,
> >>> *USt-ID-Nr.:* DE237458635
> >>
> >
> >
> > --
> >
> > Philipp Trulson
> >
> > Platform Engineer
> > mail: p.trulson@reBuy.com · web: www.reBuy.de <http://www.rebuy.de/>
> >
> > --
> >
> >
> > <https://www.rebuy.de/>
> >
> > reBuy reCommerce GmbH* · *Potsdamer Str. 188* ·
> > *10783 Berlin* · *Geschäftsführer: Dr. Philipp GattnerSitz und
> > Registergericht: Berlin, Amtsgericht Charlottenburg, HRB 109344 B,
> > *USt-ID-Nr.:* DE237458635
>
>
--
Philipp Trulson
Platform Engineer
mail: p.trulson@reBuy.com · web: www.reBuy.de <http://www.rebuy.de/>
--
<https://www.rebuy.de/>
reBuy reCommerce GmbH* · *Potsdamer Str. 188* ·
*10783 Berlin* · *Geschäftsführer: Dr. Philipp GattnerSitz und
Registergericht: Berlin, Amtsgericht Charlottenburg, HRB 109344 B,
*USt-ID-Nr.:* DE237458635
Re: Backup fails despite allowPaths=* being set
Posted by Jan Høydahl <ja...@cominvent.com>.
According to the source code here
https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.6.2/solr/core/src/java/org/apache/solr/core/SolrPaths.java#L134
your allowPaths value is NOT equal to «*» (which is stored as _ALL_) (parsed here https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.6.2/solr/core/src/java/org/apache/solr/core/SolrXmlConfig.java#L311)
Please check your solr.xml file, it needs to contain this line
https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.6.2/solr/server/solr/solr.xml#L33
Jan
> 22. okt. 2020 kl. 15:57 skrev Philipp Trulson <p....@rebuy.com>:
>
> I'm sure that this is not the case. On the Java Properties page it says
> "solr.allowPaths *", on the dashboard I can verify that the
> "-Dsolr.allowPaths=*" option is present.
>
> Am Mi., 21. Okt. 2020 um 19:10 Uhr schrieb Jan Høydahl <
> jan.asf@cominvent.com>:
>
>> Are you sure the * is not eaten by the shell since it’s a special char?
>> You can view the sys props in admin UI to check.
>>
>> Jan Høydahl
>>
>>> 16. okt. 2020 kl. 19:39 skrev Philipp Trulson <p....@rebuy.com>:
>>>
>>> Hello everyone,
>>>
>>> we are having problems with our backup script since we upgraded to Solr
>>> 8.6.2 on kubernetes. To be more precise the message is
>>> *Path /data/backup/2020-10-16/collection must be relative to SOLR_HOME,
>>> SOLR_DATA_HOME coreRootDirectory. Set system property 'solr.allowPaths'
>> to
>>> add other allowed paths.*
>>>
>>> I executed the script by calling this endpoint
>>> *curl
>>> '
>> http://solr.default.svc.cluster.local/solr/admin/collections?action=BACKUP&name=collection&collection=
>>> <
>> http://solr.default.svc.cluster.local/solr/admin/collections?action=BACKUP&name=collection&collection=
>>> *
>>> collection*&location=/data/backup/2020-10-16&async=1114'*
>>>
>>> The strange thing is that all 5 nodes are started with
>> *-Dsolr.allowPaths=**,
>>> so in theory it should work. The folder is an AWS EFS share, that's the
>>> only reason I can imagine. Or can I check any other options?
>>>
>>> Thank you for your help!
>>> Philipp
>>>
>>> --
>>>
>>>
>>> <https://www.rebuy.de/>
>>>
>>> reBuy reCommerce GmbH* · *Potsdamer Str. 188* ·
>>> *10783 Berlin* · *Geschäftsführer: Dr. Philipp GattnerSitz und
>>> Registergericht: Berlin, Amtsgericht Charlottenburg, HRB 109344 B,
>>> *USt-ID-Nr.:* DE237458635
>>
>
>
> --
>
> Philipp Trulson
>
> Platform Engineer
> mail: p.trulson@reBuy.com · web: www.reBuy.de <http://www.rebuy.de/>
>
> --
>
>
> <https://www.rebuy.de/>
>
> reBuy reCommerce GmbH* · *Potsdamer Str. 188* ·
> *10783 Berlin* · *Geschäftsführer: Dr. Philipp GattnerSitz und
> Registergericht: Berlin, Amtsgericht Charlottenburg, HRB 109344 B,
> *USt-ID-Nr.:* DE237458635
Re: Backup fails despite allowPaths=* being set
Posted by Philipp Trulson <p....@rebuy.com>.
I'm sure that this is not the case. On the Java Properties page it says
"solr.allowPaths *", on the dashboard I can verify that the
"-Dsolr.allowPaths=*" option is present.
Am Mi., 21. Okt. 2020 um 19:10 Uhr schrieb Jan Høydahl <
jan.asf@cominvent.com>:
> Are you sure the * is not eaten by the shell since it’s a special char?
> You can view the sys props in admin UI to check.
>
> Jan Høydahl
>
> > 16. okt. 2020 kl. 19:39 skrev Philipp Trulson <p....@rebuy.com>:
> >
> > Hello everyone,
> >
> > we are having problems with our backup script since we upgraded to Solr
> > 8.6.2 on kubernetes. To be more precise the message is
> > *Path /data/backup/2020-10-16/collection must be relative to SOLR_HOME,
> > SOLR_DATA_HOME coreRootDirectory. Set system property 'solr.allowPaths'
> to
> > add other allowed paths.*
> >
> > I executed the script by calling this endpoint
> > *curl
> > '
> http://solr.default.svc.cluster.local/solr/admin/collections?action=BACKUP&name=collection&collection=
> > <
> http://solr.default.svc.cluster.local/solr/admin/collections?action=BACKUP&name=collection&collection=
> >*
> > collection*&location=/data/backup/2020-10-16&async=1114'*
> >
> > The strange thing is that all 5 nodes are started with
> *-Dsolr.allowPaths=**,
> > so in theory it should work. The folder is an AWS EFS share, that's the
> > only reason I can imagine. Or can I check any other options?
> >
> > Thank you for your help!
> > Philipp
> >
> > --
> >
> >
> > <https://www.rebuy.de/>
> >
> > reBuy reCommerce GmbH* · *Potsdamer Str. 188* ·
> > *10783 Berlin* · *Geschäftsführer: Dr. Philipp GattnerSitz und
> > Registergericht: Berlin, Amtsgericht Charlottenburg, HRB 109344 B,
> > *USt-ID-Nr.:* DE237458635
>
--
Philipp Trulson
Platform Engineer
mail: p.trulson@reBuy.com · web: www.reBuy.de <http://www.rebuy.de/>
--
<https://www.rebuy.de/>
reBuy reCommerce GmbH* · *Potsdamer Str. 188* ·
*10783 Berlin* · *Geschäftsführer: Dr. Philipp GattnerSitz und
Registergericht: Berlin, Amtsgericht Charlottenburg, HRB 109344 B,
*USt-ID-Nr.:* DE237458635
Re: Backup fails despite allowPaths=* being set
Posted by Jan Høydahl <ja...@cominvent.com>.
Are you sure the * is not eaten by the shell since it’s a special char? You can view the sys props in admin UI to check.
Jan Høydahl
> 16. okt. 2020 kl. 19:39 skrev Philipp Trulson <p....@rebuy.com>:
>
> Hello everyone,
>
> we are having problems with our backup script since we upgraded to Solr
> 8.6.2 on kubernetes. To be more precise the message is
> *Path /data/backup/2020-10-16/collection must be relative to SOLR_HOME,
> SOLR_DATA_HOME coreRootDirectory. Set system property 'solr.allowPaths' to
> add other allowed paths.*
>
> I executed the script by calling this endpoint
> *curl
> 'http://solr.default.svc.cluster.local/solr/admin/collections?action=BACKUP&name=collection&collection=
> <http://solr.default.svc.cluster.local/solr/admin/collections?action=BACKUP&name=collection&collection=>*
> collection*&location=/data/backup/2020-10-16&async=1114'*
>
> The strange thing is that all 5 nodes are started with *-Dsolr.allowPaths=**,
> so in theory it should work. The folder is an AWS EFS share, that's the
> only reason I can imagine. Or can I check any other options?
>
> Thank you for your help!
> Philipp
>
> --
>
>
> <https://www.rebuy.de/>
>
> reBuy reCommerce GmbH* · *Potsdamer Str. 188* ·
> *10783 Berlin* · *Geschäftsführer: Dr. Philipp GattnerSitz und
> Registergericht: Berlin, Amtsgericht Charlottenburg, HRB 109344 B,
> *USt-ID-Nr.:* DE237458635