You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@solr.apache.org by Jonathan Tan <jt...@gmail.com> on 2022/10/12 14:05:42 UTC
Solr 9 and the Affinity placement plugin
Hi!
In Solr 8.6, I used the autoscaling configuration to set it up so that we
had 2 `nodeTypes`, one for indexing, the other for querying.
And our collections were set up to be TLOG + PULL replicas only, and we'd
use the autoscaling to place the TLOG on the indexing nodeTypes, and the
PULL on the querying nodeTypes. (Essentially replicating the older
master/slave setup of pre-SolrCloud)
Now we've come to Solr 9, and I can't really find a clear way to do the
same thing.
https://solr.apache.org/guide/solr/latest/configuration-guide/replica-placement-plugins.html#affinityplacementfactory
I've looked through this, and it seems to imply that the
`collectionNodeType` configuration will allow me to place specific
collections on specific nodeTypes. But I can't find a way to place specific
replica types on specific nodeTypes...
Is this mechanism no longer existing?
Thank you
Jonathan
Re: Solr 9 and the Affinity placement plugin
Posted by Maxbone <in...@maxbone.com>.
Hi there,
Thank you for shopping with us and reaching out!
Unfortunately, it seems we have been included in this communication thread as an error. As this is affecting our customer's ticket inquiries in our queue, we would like to request to be removed from all communications effective immediately.
Please provide confirmation.
All the best,
JOSH
Director of Customer Experience & Retail Stores
[cid:fc6728bd-824a-4629-ab8a-814f23dca428]
Los Angeles | New York City
maxbone.com<http://www.maxbone.com/>
@themaxbone<http://www.instagram.com/themaxbone>
________________________________
From: Jonathan Tan <jt...@gmail.com>
Sent: Monday, October 24, 2022 3:24 PM
To: users@solr.apache.org <us...@solr.apache.org>
Subject: Re: Solr 9 and the Affinity placement plugin
For anybody else who comes across this, for easy access, here's the wiki
page where this was first discussed:
https://cwiki.apache.org/confluence/display/SOLR/SIP-8+Autoscaling+policy+engine+V2
And here's the issue where the implementations were discussed:
https://issues.apache.org/jira/browse/SOLR-14613
On Fri, Oct 21, 2022 at 4:03 AM Houston Putman <ho...@apache.org> wrote:
> I agree with Jan. Though I have seen this exact usage multiple times, so it
> will likely be beneficial to the community.
>
> - Houston
>
> On Thu, Oct 13, 2022 at 3:34 AM Jan Høydahl <ja...@cominvent.com> wrote:
>
> > Hi,
> >
> > In Solr 9 the focus is on a rich Java API that will allow you to create
> > your own placement plugin that can do pretty much anything.
> > The affinity plugin tries to give a good OOTB experience for most use
> > cases, but does not aim to be the one everyone uses.
> > You may want to fork the affinity plugin and extend it with your needs.
> If
> > you believe your extension is useful to a larger audience you may
> consider
> > opening a PR with your changes.
> >
> > Jan
> >
> > > 12. okt. 2022 kl. 16:05 skrev Jonathan Tan <jt...@gmail.com>:
> > >
> > > Hi!
> > >
> > > In Solr 8.6, I used the autoscaling configuration to set it up so that
> we
> > > had 2 `nodeTypes`, one for indexing, the other for querying.
> > > And our collections were set up to be TLOG + PULL replicas only, and
> we'd
> > > use the autoscaling to place the TLOG on the indexing nodeTypes, and
> the
> > > PULL on the querying nodeTypes. (Essentially replicating the older
> > > master/slave setup of pre-SolrCloud)
> > >
> > > Now we've come to Solr 9, and I can't really find a clear way to do the
> > > same thing.
> > >
> > >
> >
> https://solr.apache.org/guide/solr/latest/configuration-guide/replica-placement-plugins.html#affinityplacementfactory
> > >
> > > I've looked through this, and it seems to imply that the
> > > `collectionNodeType` configuration will allow me to place specific
> > > collections on specific nodeTypes. But I can't find a way to place
> > specific
> > > replica types on specific nodeTypes...
> > >
> > > Is this mechanism no longer existing?
> > >
> > > Thank you
> > > Jonathan
> >
> >
>
Re: Solr 9 and the Affinity placement plugin
Posted by Jonathan Tan <jt...@gmail.com>.
For anybody else who comes across this, for easy access, here's the wiki
page where this was first discussed:
https://cwiki.apache.org/confluence/display/SOLR/SIP-8+Autoscaling+policy+engine+V2
And here's the issue where the implementations were discussed:
https://issues.apache.org/jira/browse/SOLR-14613
On Fri, Oct 21, 2022 at 4:03 AM Houston Putman <ho...@apache.org> wrote:
> I agree with Jan. Though I have seen this exact usage multiple times, so it
> will likely be beneficial to the community.
>
> - Houston
>
> On Thu, Oct 13, 2022 at 3:34 AM Jan Høydahl <ja...@cominvent.com> wrote:
>
> > Hi,
> >
> > In Solr 9 the focus is on a rich Java API that will allow you to create
> > your own placement plugin that can do pretty much anything.
> > The affinity plugin tries to give a good OOTB experience for most use
> > cases, but does not aim to be the one everyone uses.
> > You may want to fork the affinity plugin and extend it with your needs.
> If
> > you believe your extension is useful to a larger audience you may
> consider
> > opening a PR with your changes.
> >
> > Jan
> >
> > > 12. okt. 2022 kl. 16:05 skrev Jonathan Tan <jt...@gmail.com>:
> > >
> > > Hi!
> > >
> > > In Solr 8.6, I used the autoscaling configuration to set it up so that
> we
> > > had 2 `nodeTypes`, one for indexing, the other for querying.
> > > And our collections were set up to be TLOG + PULL replicas only, and
> we'd
> > > use the autoscaling to place the TLOG on the indexing nodeTypes, and
> the
> > > PULL on the querying nodeTypes. (Essentially replicating the older
> > > master/slave setup of pre-SolrCloud)
> > >
> > > Now we've come to Solr 9, and I can't really find a clear way to do the
> > > same thing.
> > >
> > >
> >
> https://solr.apache.org/guide/solr/latest/configuration-guide/replica-placement-plugins.html#affinityplacementfactory
> > >
> > > I've looked through this, and it seems to imply that the
> > > `collectionNodeType` configuration will allow me to place specific
> > > collections on specific nodeTypes. But I can't find a way to place
> > specific
> > > replica types on specific nodeTypes...
> > >
> > > Is this mechanism no longer existing?
> > >
> > > Thank you
> > > Jonathan
> >
> >
>
Re: Solr 9 and the Affinity placement plugin
Posted by Houston Putman <ho...@apache.org>.
I agree with Jan. Though I have seen this exact usage multiple times, so it
will likely be beneficial to the community.
- Houston
On Thu, Oct 13, 2022 at 3:34 AM Jan Høydahl <ja...@cominvent.com> wrote:
> Hi,
>
> In Solr 9 the focus is on a rich Java API that will allow you to create
> your own placement plugin that can do pretty much anything.
> The affinity plugin tries to give a good OOTB experience for most use
> cases, but does not aim to be the one everyone uses.
> You may want to fork the affinity plugin and extend it with your needs. If
> you believe your extension is useful to a larger audience you may consider
> opening a PR with your changes.
>
> Jan
>
> > 12. okt. 2022 kl. 16:05 skrev Jonathan Tan <jt...@gmail.com>:
> >
> > Hi!
> >
> > In Solr 8.6, I used the autoscaling configuration to set it up so that we
> > had 2 `nodeTypes`, one for indexing, the other for querying.
> > And our collections were set up to be TLOG + PULL replicas only, and we'd
> > use the autoscaling to place the TLOG on the indexing nodeTypes, and the
> > PULL on the querying nodeTypes. (Essentially replicating the older
> > master/slave setup of pre-SolrCloud)
> >
> > Now we've come to Solr 9, and I can't really find a clear way to do the
> > same thing.
> >
> >
> https://solr.apache.org/guide/solr/latest/configuration-guide/replica-placement-plugins.html#affinityplacementfactory
> >
> > I've looked through this, and it seems to imply that the
> > `collectionNodeType` configuration will allow me to place specific
> > collections on specific nodeTypes. But I can't find a way to place
> specific
> > replica types on specific nodeTypes...
> >
> > Is this mechanism no longer existing?
> >
> > Thank you
> > Jonathan
>
>
Re: Solr 9 and the Affinity placement plugin
Posted by Jan Høydahl <ja...@cominvent.com>.
Hi,
In Solr 9 the focus is on a rich Java API that will allow you to create your own placement plugin that can do pretty much anything.
The affinity plugin tries to give a good OOTB experience for most use cases, but does not aim to be the one everyone uses.
You may want to fork the affinity plugin and extend it with your needs. If you believe your extension is useful to a larger audience you may consider opening a PR with your changes.
Jan
> 12. okt. 2022 kl. 16:05 skrev Jonathan Tan <jt...@gmail.com>:
>
> Hi!
>
> In Solr 8.6, I used the autoscaling configuration to set it up so that we
> had 2 `nodeTypes`, one for indexing, the other for querying.
> And our collections were set up to be TLOG + PULL replicas only, and we'd
> use the autoscaling to place the TLOG on the indexing nodeTypes, and the
> PULL on the querying nodeTypes. (Essentially replicating the older
> master/slave setup of pre-SolrCloud)
>
> Now we've come to Solr 9, and I can't really find a clear way to do the
> same thing.
>
> https://solr.apache.org/guide/solr/latest/configuration-guide/replica-placement-plugins.html#affinityplacementfactory
>
> I've looked through this, and it seems to imply that the
> `collectionNodeType` configuration will allow me to place specific
> collections on specific nodeTypes. But I can't find a way to place specific
> replica types on specific nodeTypes...
>
> Is this mechanism no longer existing?
>
> Thank you
> Jonathan