You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by "Carroll, Michael (ELS-PHI)" <m....@elsevier.com> on 2020/09/11 14:25:58 UTC
Updating configset
Hello,
I am running SolrCloud in Kubernetes with Solr version 8.5.2.
Is it possible to update a configset being used by a collection using a SolrCloud API directly? I know that this is possible using the zkcli and a collection RELOAD. We essentially want to be able to checkout our configset from source control, and then replace everything in the active configset in SolrCloud (other than the schema.xml).
We have a couple of custom plugins that use config files that reside in the configset, and we don’t want to have to rebuild the collection or access zookeeper directly if we don’t have to. If we can’t modify the configset wholesale this way, is it possible to create a new configset and swap the old collection to it?
Best,
Michael Carroll
Re: Updating configset
Posted by Tomás Fernández Löbbe <to...@gmail.com>.
Right, the problem is that both, bin/solr zk and ZkConfigManager require
"direct access" to ZooKeeper (you have to have ZooKeeper exposed). I
believe the original question was about how to achieve this without
exposing ZooKeeper.
On Fri, Sep 11, 2020 at 11:00 AM Andy C <an...@gmail.com> wrote:
> Don't know if this is an option for you but the SolrJ Java Client library
> has support for uploading a config set. If the config set already exists it
> will overwrite it, and automatically RELOAD the dependent collection.
>
> See
>
> https://lucene.apache.org/solr/8_5_0/solr-solrj/org/apache/solr/common/cloud/ZkConfigManager.html
>
> On Fri, Sep 11, 2020 at 1:45 PM Jörn Franke <jo...@gmail.com> wrote:
>
> > I would go for the Solr rest api ... especially if you have a secured zk
> > (eg with Kerberos). Then you need to manage access for humans only in
> Solr
> > and not also in ZK.
> >
> > > Am 11.09.2020 um 19:41 schrieb Erick Erickson <erickerickson@gmail.com
> >:
> > >
> > > Bin/solr zk upconfig...
> > > Bin/solr zk cp... For individual files.
> > >
> > > Not as convenient as a nice API, but might let you get by...
> > >
> > >> On Fri, Sep 11, 2020, 13:26 Houston Putman <ho...@gmail.com>
> > wrote:
> > >>
> > >> I completely agree, there should be a way to overwrite an existing
> > >> configSet.
> > >>
> > >> Looks like https://issues.apache.org/jira/browse/SOLR-10391 already
> > >> exists,
> > >> so the work could be tracked there.
> > >>
> > >> On Fri, Sep 11, 2020 at 12:36 PM Tomás Fernández Löbbe <
> > >> tomasflobbe@gmail.com> wrote:
> > >>
> > >>> I was in the same situation recently. I think it would be nice to
> have
> > >> the
> > >>> configset UPLOAD command be able to override the existing configset
> > >> instead
> > >>> of just fail (with a parameter such as override=true or something).
> We
> > >> need
> > >>> to be careful with the trusted/unstrusted flag there, but that should
> > be
> > >>> possible.
> > >>>
> > >>>> If we can’t modify the configset wholesale this way, is it possible
> to
> > >>> create a new configset and swap the old collection to it?
> > >>> You can create a new one and then call MODIFYCOLLECTION on the
> > collection
> > >>> that uses it:
> > >>>
> > >>>
> > >>
> >
> https://lucene.apache.org/solr/guide/8_6/collection-management.html#modifycollection-parameters
> > >>> .
> > >>> I've never used that though.
> > >>>
> > >>> On Fri, Sep 11, 2020 at 7:26 AM Carroll, Michael (ELS-PHI) <
> > >>> m.carroll@elsevier.com> wrote:
> > >>>
> > >>>> Hello,
> > >>>>
> > >>>> I am running SolrCloud in Kubernetes with Solr version 8.5.2.
> > >>>>
> > >>>> Is it possible to update a configset being used by a collection
> using
> > a
> > >>>> SolrCloud API directly? I know that this is possible using the zkcli
> > >> and
> > >>> a
> > >>>> collection RELOAD. We essentially want to be able to checkout our
> > >>> configset
> > >>>> from source control, and then replace everything in the active
> > >> configset
> > >>> in
> > >>>> SolrCloud (other than the schema.xml).
> > >>>>
> > >>>> We have a couple of custom plugins that use config files that reside
> > in
> > >>>> the configset, and we don’t want to have to rebuild the collection
> or
> > >>>> access zookeeper directly if we don’t have to. If we can’t modify
> the
> > >>>> configset wholesale this way, is it possible to create a new
> configset
> > >>> and
> > >>>> swap the old collection to it?
> > >>>>
> > >>>> Best,
> > >>>> Michael Carroll
> > >>>>
> > >>>
> > >>
> >
>
Re: Updating configset
Posted by Andy C <an...@gmail.com>.
Don't know if this is an option for you but the SolrJ Java Client library
has support for uploading a config set. If the config set already exists it
will overwrite it, and automatically RELOAD the dependent collection.
See
https://lucene.apache.org/solr/8_5_0/solr-solrj/org/apache/solr/common/cloud/ZkConfigManager.html
On Fri, Sep 11, 2020 at 1:45 PM Jörn Franke <jo...@gmail.com> wrote:
> I would go for the Solr rest api ... especially if you have a secured zk
> (eg with Kerberos). Then you need to manage access for humans only in Solr
> and not also in ZK.
>
> > Am 11.09.2020 um 19:41 schrieb Erick Erickson <er...@gmail.com>:
> >
> > Bin/solr zk upconfig...
> > Bin/solr zk cp... For individual files.
> >
> > Not as convenient as a nice API, but might let you get by...
> >
> >> On Fri, Sep 11, 2020, 13:26 Houston Putman <ho...@gmail.com>
> wrote:
> >>
> >> I completely agree, there should be a way to overwrite an existing
> >> configSet.
> >>
> >> Looks like https://issues.apache.org/jira/browse/SOLR-10391 already
> >> exists,
> >> so the work could be tracked there.
> >>
> >> On Fri, Sep 11, 2020 at 12:36 PM Tomás Fernández Löbbe <
> >> tomasflobbe@gmail.com> wrote:
> >>
> >>> I was in the same situation recently. I think it would be nice to have
> >> the
> >>> configset UPLOAD command be able to override the existing configset
> >> instead
> >>> of just fail (with a parameter such as override=true or something). We
> >> need
> >>> to be careful with the trusted/unstrusted flag there, but that should
> be
> >>> possible.
> >>>
> >>>> If we can’t modify the configset wholesale this way, is it possible to
> >>> create a new configset and swap the old collection to it?
> >>> You can create a new one and then call MODIFYCOLLECTION on the
> collection
> >>> that uses it:
> >>>
> >>>
> >>
> https://lucene.apache.org/solr/guide/8_6/collection-management.html#modifycollection-parameters
> >>> .
> >>> I've never used that though.
> >>>
> >>> On Fri, Sep 11, 2020 at 7:26 AM Carroll, Michael (ELS-PHI) <
> >>> m.carroll@elsevier.com> wrote:
> >>>
> >>>> Hello,
> >>>>
> >>>> I am running SolrCloud in Kubernetes with Solr version 8.5.2.
> >>>>
> >>>> Is it possible to update a configset being used by a collection using
> a
> >>>> SolrCloud API directly? I know that this is possible using the zkcli
> >> and
> >>> a
> >>>> collection RELOAD. We essentially want to be able to checkout our
> >>> configset
> >>>> from source control, and then replace everything in the active
> >> configset
> >>> in
> >>>> SolrCloud (other than the schema.xml).
> >>>>
> >>>> We have a couple of custom plugins that use config files that reside
> in
> >>>> the configset, and we don’t want to have to rebuild the collection or
> >>>> access zookeeper directly if we don’t have to. If we can’t modify the
> >>>> configset wholesale this way, is it possible to create a new configset
> >>> and
> >>>> swap the old collection to it?
> >>>>
> >>>> Best,
> >>>> Michael Carroll
> >>>>
> >>>
> >>
>
Re: Updating configset
Posted by Jörn Franke <jo...@gmail.com>.
I would go for the Solr rest api ... especially if you have a secured zk (eg with Kerberos). Then you need to manage access for humans only in Solr and not also in ZK.
> Am 11.09.2020 um 19:41 schrieb Erick Erickson <er...@gmail.com>:
>
> Bin/solr zk upconfig...
> Bin/solr zk cp... For individual files.
>
> Not as convenient as a nice API, but might let you get by...
>
>> On Fri, Sep 11, 2020, 13:26 Houston Putman <ho...@gmail.com> wrote:
>>
>> I completely agree, there should be a way to overwrite an existing
>> configSet.
>>
>> Looks like https://issues.apache.org/jira/browse/SOLR-10391 already
>> exists,
>> so the work could be tracked there.
>>
>> On Fri, Sep 11, 2020 at 12:36 PM Tomás Fernández Löbbe <
>> tomasflobbe@gmail.com> wrote:
>>
>>> I was in the same situation recently. I think it would be nice to have
>> the
>>> configset UPLOAD command be able to override the existing configset
>> instead
>>> of just fail (with a parameter such as override=true or something). We
>> need
>>> to be careful with the trusted/unstrusted flag there, but that should be
>>> possible.
>>>
>>>> If we can’t modify the configset wholesale this way, is it possible to
>>> create a new configset and swap the old collection to it?
>>> You can create a new one and then call MODIFYCOLLECTION on the collection
>>> that uses it:
>>>
>>>
>> https://lucene.apache.org/solr/guide/8_6/collection-management.html#modifycollection-parameters
>>> .
>>> I've never used that though.
>>>
>>> On Fri, Sep 11, 2020 at 7:26 AM Carroll, Michael (ELS-PHI) <
>>> m.carroll@elsevier.com> wrote:
>>>
>>>> Hello,
>>>>
>>>> I am running SolrCloud in Kubernetes with Solr version 8.5.2.
>>>>
>>>> Is it possible to update a configset being used by a collection using a
>>>> SolrCloud API directly? I know that this is possible using the zkcli
>> and
>>> a
>>>> collection RELOAD. We essentially want to be able to checkout our
>>> configset
>>>> from source control, and then replace everything in the active
>> configset
>>> in
>>>> SolrCloud (other than the schema.xml).
>>>>
>>>> We have a couple of custom plugins that use config files that reside in
>>>> the configset, and we don’t want to have to rebuild the collection or
>>>> access zookeeper directly if we don’t have to. If we can’t modify the
>>>> configset wholesale this way, is it possible to create a new configset
>>> and
>>>> swap the old collection to it?
>>>>
>>>> Best,
>>>> Michael Carroll
>>>>
>>>
>>
Re: Updating configset
Posted by Erick Erickson <er...@gmail.com>.
Bin/solr zk upconfig...
Bin/solr zk cp... For individual files.
Not as convenient as a nice API, but might let you get by...
On Fri, Sep 11, 2020, 13:26 Houston Putman <ho...@gmail.com> wrote:
> I completely agree, there should be a way to overwrite an existing
> configSet.
>
> Looks like https://issues.apache.org/jira/browse/SOLR-10391 already
> exists,
> so the work could be tracked there.
>
> On Fri, Sep 11, 2020 at 12:36 PM Tomás Fernández Löbbe <
> tomasflobbe@gmail.com> wrote:
>
> > I was in the same situation recently. I think it would be nice to have
> the
> > configset UPLOAD command be able to override the existing configset
> instead
> > of just fail (with a parameter such as override=true or something). We
> need
> > to be careful with the trusted/unstrusted flag there, but that should be
> > possible.
> >
> > > If we can’t modify the configset wholesale this way, is it possible to
> > create a new configset and swap the old collection to it?
> > You can create a new one and then call MODIFYCOLLECTION on the collection
> > that uses it:
> >
> >
> https://lucene.apache.org/solr/guide/8_6/collection-management.html#modifycollection-parameters
> > .
> > I've never used that though.
> >
> > On Fri, Sep 11, 2020 at 7:26 AM Carroll, Michael (ELS-PHI) <
> > m.carroll@elsevier.com> wrote:
> >
> > > Hello,
> > >
> > > I am running SolrCloud in Kubernetes with Solr version 8.5.2.
> > >
> > > Is it possible to update a configset being used by a collection using a
> > > SolrCloud API directly? I know that this is possible using the zkcli
> and
> > a
> > > collection RELOAD. We essentially want to be able to checkout our
> > configset
> > > from source control, and then replace everything in the active
> configset
> > in
> > > SolrCloud (other than the schema.xml).
> > >
> > > We have a couple of custom plugins that use config files that reside in
> > > the configset, and we don’t want to have to rebuild the collection or
> > > access zookeeper directly if we don’t have to. If we can’t modify the
> > > configset wholesale this way, is it possible to create a new configset
> > and
> > > swap the old collection to it?
> > >
> > > Best,
> > > Michael Carroll
> > >
> >
>
Re: Updating configset
Posted by Houston Putman <ho...@gmail.com>.
I completely agree, there should be a way to overwrite an existing
configSet.
Looks like https://issues.apache.org/jira/browse/SOLR-10391 already exists,
so the work could be tracked there.
On Fri, Sep 11, 2020 at 12:36 PM Tomás Fernández Löbbe <
tomasflobbe@gmail.com> wrote:
> I was in the same situation recently. I think it would be nice to have the
> configset UPLOAD command be able to override the existing configset instead
> of just fail (with a parameter such as override=true or something). We need
> to be careful with the trusted/unstrusted flag there, but that should be
> possible.
>
> > If we can’t modify the configset wholesale this way, is it possible to
> create a new configset and swap the old collection to it?
> You can create a new one and then call MODIFYCOLLECTION on the collection
> that uses it:
>
> https://lucene.apache.org/solr/guide/8_6/collection-management.html#modifycollection-parameters
> .
> I've never used that though.
>
> On Fri, Sep 11, 2020 at 7:26 AM Carroll, Michael (ELS-PHI) <
> m.carroll@elsevier.com> wrote:
>
> > Hello,
> >
> > I am running SolrCloud in Kubernetes with Solr version 8.5.2.
> >
> > Is it possible to update a configset being used by a collection using a
> > SolrCloud API directly? I know that this is possible using the zkcli and
> a
> > collection RELOAD. We essentially want to be able to checkout our
> configset
> > from source control, and then replace everything in the active configset
> in
> > SolrCloud (other than the schema.xml).
> >
> > We have a couple of custom plugins that use config files that reside in
> > the configset, and we don’t want to have to rebuild the collection or
> > access zookeeper directly if we don’t have to. If we can’t modify the
> > configset wholesale this way, is it possible to create a new configset
> and
> > swap the old collection to it?
> >
> > Best,
> > Michael Carroll
> >
>
Re: Updating configset
Posted by Robert Vernon Phillips <ro...@gmail.com>.
unsubscribe
On 9/11/20, Carroll, Michael (ELS-PHI) <m....@elsevier.com> wrote:
> Thanks for the help everyone. I'm hopeful for the PR, Tomás. That looks to
> be exactly what I was looking for!
>
> Best,
> Michael Carroll
>
> On 9/11/20, 8:44 PM, "Tomás Fernández Löbbe" <to...@gmail.com>
> wrote:
>
> *** External email: use caution ***
>
>
>
> I created
> https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Flucene-solr%2Fpull%2F1861&data=02%7C01%7Cm.carroll%40elsevier.com%7C10d16615d6484b13f82008d856b4f94e%7C9274ee3f94254109a27f9fb15c10675d%7C0%7C0%7C637354682569763217&sdata=%2BEfYbYVY94NTlRNJBxjhONpz4fcPkXOh1YgsGK4RF0A%3D&reserved=0
>
> On Fri, Sep 11, 2020 at 11:43 AM Walter Underwood
> <wu...@wunderwood.org>
> wrote:
>
> > I wrote some Python to get the Zookeeper address from CLUSTERSTATUS,
> then
> > use the Kazoo library to upload a configset. Then it goes back to the
> > cluster and
> > runs an async command to RELOAD.
> >
> > I really should open source that thing (in my copious free time).
> >
> > wunder
> > Walter Underwood
> > wunder@wunderwood.org
> >
> https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fobserver.wunderwood.org%2F&data=02%7C01%7Cm.carroll%40elsevier.com%7C10d16615d6484b13f82008d856b4f94e%7C9274ee3f94254109a27f9fb15c10675d%7C0%7C0%7C637354682569763217&sdata=qrnj0iratKmlu8hOosZ%2FC0Ji2P8k7CGE0AAHY9txTJ0%3D&reserved=0
> (my blog)
> >
> > > On Sep 11, 2020, at 9:35 AM, Tomás Fernández Löbbe <
> > tomasflobbe@gmail.com> wrote:
> > >
> > > I was in the same situation recently. I think it would be nice to
> have
> > the
> > > configset UPLOAD command be able to override the existing configset
> > instead
> > > of just fail (with a parameter such as override=true or something).
> We
> > need
> > > to be careful with the trusted/unstrusted flag there, but that
> should be
> > > possible.
> > >
> > >> If we can’t modify the configset wholesale this way, is it possible
> to
> > > create a new configset and swap the old collection to it?
> > > You can create a new one and then call MODIFYCOLLECTION on the
> collection
> > > that uses it:
> > >
> >
> https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Flucene.apache.org%2Fsolr%2Fguide%2F8_6%2Fcollection-management.html%23modifycollection-parameters&data=02%7C01%7Cm.carroll%40elsevier.com%7C10d16615d6484b13f82008d856b4f94e%7C9274ee3f94254109a27f9fb15c10675d%7C0%7C0%7C637354682569763217&sdata=RyW%2BE9wbnWVKDjmABk1N82fVIqu10R6mxggsZ%2F7Lxdw%3D&reserved=0
> > .
> > > I've never used that though.
> > >
> > > On Fri, Sep 11, 2020 at 7:26 AM Carroll, Michael (ELS-PHI) <
> > > m.carroll@elsevier.com> wrote:
> > >
> > >> Hello,
> > >>
> > >> I am running SolrCloud in Kubernetes with Solr version 8.5.2.
> > >>
> > >> Is it possible to update a configset being used by a collection
> using a
> > >> SolrCloud API directly? I know that this is possible using the
> zkcli
> > and a
> > >> collection RELOAD. We essentially want to be able to checkout our
> > configset
> > >> from source control, and then replace everything in the active
> > configset in
> > >> SolrCloud (other than the schema.xml).
> > >>
> > >> We have a couple of custom plugins that use config files that
> reside in
> > >> the configset, and we don’t want to have to rebuild the collection
> or
> > >> access zookeeper directly if we don’t have to. If we can’t modify
> the
> > >> configset wholesale this way, is it possible to create a new
> configset
> > and
> > >> swap the old collection to it?
> > >>
> > >> Best,
> > >> Michael Carroll
> > >>
> >
> >
>
>
>
--
Best regards,
Robert V Phillips
Re: Updating configset
Posted by "Carroll, Michael (ELS-PHI)" <m....@elsevier.com>.
Thanks for the help everyone. I'm hopeful for the PR, Tomás. That looks to be exactly what I was looking for!
Best,
Michael Carroll
On 9/11/20, 8:44 PM, "Tomás Fernández Löbbe" <to...@gmail.com> wrote:
*** External email: use caution ***
I created https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Flucene-solr%2Fpull%2F1861&data=02%7C01%7Cm.carroll%40elsevier.com%7C10d16615d6484b13f82008d856b4f94e%7C9274ee3f94254109a27f9fb15c10675d%7C0%7C0%7C637354682569763217&sdata=%2BEfYbYVY94NTlRNJBxjhONpz4fcPkXOh1YgsGK4RF0A%3D&reserved=0
On Fri, Sep 11, 2020 at 11:43 AM Walter Underwood <wu...@wunderwood.org>
wrote:
> I wrote some Python to get the Zookeeper address from CLUSTERSTATUS, then
> use the Kazoo library to upload a configset. Then it goes back to the
> cluster and
> runs an async command to RELOAD.
>
> I really should open source that thing (in my copious free time).
>
> wunder
> Walter Underwood
> wunder@wunderwood.org
> https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fobserver.wunderwood.org%2F&data=02%7C01%7Cm.carroll%40elsevier.com%7C10d16615d6484b13f82008d856b4f94e%7C9274ee3f94254109a27f9fb15c10675d%7C0%7C0%7C637354682569763217&sdata=qrnj0iratKmlu8hOosZ%2FC0Ji2P8k7CGE0AAHY9txTJ0%3D&reserved=0 (my blog)
>
> > On Sep 11, 2020, at 9:35 AM, Tomás Fernández Löbbe <
> tomasflobbe@gmail.com> wrote:
> >
> > I was in the same situation recently. I think it would be nice to have
> the
> > configset UPLOAD command be able to override the existing configset
> instead
> > of just fail (with a parameter such as override=true or something). We
> need
> > to be careful with the trusted/unstrusted flag there, but that should be
> > possible.
> >
> >> If we can’t modify the configset wholesale this way, is it possible to
> > create a new configset and swap the old collection to it?
> > You can create a new one and then call MODIFYCOLLECTION on the collection
> > that uses it:
> >
> https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Flucene.apache.org%2Fsolr%2Fguide%2F8_6%2Fcollection-management.html%23modifycollection-parameters&data=02%7C01%7Cm.carroll%40elsevier.com%7C10d16615d6484b13f82008d856b4f94e%7C9274ee3f94254109a27f9fb15c10675d%7C0%7C0%7C637354682569763217&sdata=RyW%2BE9wbnWVKDjmABk1N82fVIqu10R6mxggsZ%2F7Lxdw%3D&reserved=0
> .
> > I've never used that though.
> >
> > On Fri, Sep 11, 2020 at 7:26 AM Carroll, Michael (ELS-PHI) <
> > m.carroll@elsevier.com> wrote:
> >
> >> Hello,
> >>
> >> I am running SolrCloud in Kubernetes with Solr version 8.5.2.
> >>
> >> Is it possible to update a configset being used by a collection using a
> >> SolrCloud API directly? I know that this is possible using the zkcli
> and a
> >> collection RELOAD. We essentially want to be able to checkout our
> configset
> >> from source control, and then replace everything in the active
> configset in
> >> SolrCloud (other than the schema.xml).
> >>
> >> We have a couple of custom plugins that use config files that reside in
> >> the configset, and we don’t want to have to rebuild the collection or
> >> access zookeeper directly if we don’t have to. If we can’t modify the
> >> configset wholesale this way, is it possible to create a new configset
> and
> >> swap the old collection to it?
> >>
> >> Best,
> >> Michael Carroll
> >>
>
>
Re: Updating configset
Posted by Tomás Fernández Löbbe <to...@gmail.com>.
I created https://github.com/apache/lucene-solr/pull/1861
On Fri, Sep 11, 2020 at 11:43 AM Walter Underwood <wu...@wunderwood.org>
wrote:
> I wrote some Python to get the Zookeeper address from CLUSTERSTATUS, then
> use the Kazoo library to upload a configset. Then it goes back to the
> cluster and
> runs an async command to RELOAD.
>
> I really should open source that thing (in my copious free time).
>
> wunder
> Walter Underwood
> wunder@wunderwood.org
> http://observer.wunderwood.org/ (my blog)
>
> > On Sep 11, 2020, at 9:35 AM, Tomás Fernández Löbbe <
> tomasflobbe@gmail.com> wrote:
> >
> > I was in the same situation recently. I think it would be nice to have
> the
> > configset UPLOAD command be able to override the existing configset
> instead
> > of just fail (with a parameter such as override=true or something). We
> need
> > to be careful with the trusted/unstrusted flag there, but that should be
> > possible.
> >
> >> If we can’t modify the configset wholesale this way, is it possible to
> > create a new configset and swap the old collection to it?
> > You can create a new one and then call MODIFYCOLLECTION on the collection
> > that uses it:
> >
> https://lucene.apache.org/solr/guide/8_6/collection-management.html#modifycollection-parameters
> .
> > I've never used that though.
> >
> > On Fri, Sep 11, 2020 at 7:26 AM Carroll, Michael (ELS-PHI) <
> > m.carroll@elsevier.com> wrote:
> >
> >> Hello,
> >>
> >> I am running SolrCloud in Kubernetes with Solr version 8.5.2.
> >>
> >> Is it possible to update a configset being used by a collection using a
> >> SolrCloud API directly? I know that this is possible using the zkcli
> and a
> >> collection RELOAD. We essentially want to be able to checkout our
> configset
> >> from source control, and then replace everything in the active
> configset in
> >> SolrCloud (other than the schema.xml).
> >>
> >> We have a couple of custom plugins that use config files that reside in
> >> the configset, and we don’t want to have to rebuild the collection or
> >> access zookeeper directly if we don’t have to. If we can’t modify the
> >> configset wholesale this way, is it possible to create a new configset
> and
> >> swap the old collection to it?
> >>
> >> Best,
> >> Michael Carroll
> >>
>
>
Re: Updating configset
Posted by Walter Underwood <wu...@wunderwood.org>.
I wrote some Python to get the Zookeeper address from CLUSTERSTATUS, then
use the Kazoo library to upload a configset. Then it goes back to the cluster and
runs an async command to RELOAD.
I really should open source that thing (in my copious free time).
wunder
Walter Underwood
wunder@wunderwood.org
http://observer.wunderwood.org/ (my blog)
> On Sep 11, 2020, at 9:35 AM, Tomás Fernández Löbbe <to...@gmail.com> wrote:
>
> I was in the same situation recently. I think it would be nice to have the
> configset UPLOAD command be able to override the existing configset instead
> of just fail (with a parameter such as override=true or something). We need
> to be careful with the trusted/unstrusted flag there, but that should be
> possible.
>
>> If we can’t modify the configset wholesale this way, is it possible to
> create a new configset and swap the old collection to it?
> You can create a new one and then call MODIFYCOLLECTION on the collection
> that uses it:
> https://lucene.apache.org/solr/guide/8_6/collection-management.html#modifycollection-parameters.
> I've never used that though.
>
> On Fri, Sep 11, 2020 at 7:26 AM Carroll, Michael (ELS-PHI) <
> m.carroll@elsevier.com> wrote:
>
>> Hello,
>>
>> I am running SolrCloud in Kubernetes with Solr version 8.5.2.
>>
>> Is it possible to update a configset being used by a collection using a
>> SolrCloud API directly? I know that this is possible using the zkcli and a
>> collection RELOAD. We essentially want to be able to checkout our configset
>> from source control, and then replace everything in the active configset in
>> SolrCloud (other than the schema.xml).
>>
>> We have a couple of custom plugins that use config files that reside in
>> the configset, and we don’t want to have to rebuild the collection or
>> access zookeeper directly if we don’t have to. If we can’t modify the
>> configset wholesale this way, is it possible to create a new configset and
>> swap the old collection to it?
>>
>> Best,
>> Michael Carroll
>>
Re: Updating configset
Posted by Tomás Fernández Löbbe <to...@gmail.com>.
I was in the same situation recently. I think it would be nice to have the
configset UPLOAD command be able to override the existing configset instead
of just fail (with a parameter such as override=true or something). We need
to be careful with the trusted/unstrusted flag there, but that should be
possible.
> If we can’t modify the configset wholesale this way, is it possible to
create a new configset and swap the old collection to it?
You can create a new one and then call MODIFYCOLLECTION on the collection
that uses it:
https://lucene.apache.org/solr/guide/8_6/collection-management.html#modifycollection-parameters.
I've never used that though.
On Fri, Sep 11, 2020 at 7:26 AM Carroll, Michael (ELS-PHI) <
m.carroll@elsevier.com> wrote:
> Hello,
>
> I am running SolrCloud in Kubernetes with Solr version 8.5.2.
>
> Is it possible to update a configset being used by a collection using a
> SolrCloud API directly? I know that this is possible using the zkcli and a
> collection RELOAD. We essentially want to be able to checkout our configset
> from source control, and then replace everything in the active configset in
> SolrCloud (other than the schema.xml).
>
> We have a couple of custom plugins that use config files that reside in
> the configset, and we don’t want to have to rebuild the collection or
> access zookeeper directly if we don’t have to. If we can’t modify the
> configset wholesale this way, is it possible to create a new configset and
> swap the old collection to it?
>
> Best,
> Michael Carroll
>