Re: Issues deploying LTR into SolrCloud

[krishan goyal <kr...@gmail.com>]

Not sure how solr cloud works but if your still facing issues, can try this

1. Deploy the features and models as a _schema_feature-store.json
and _schema_model-store.json file in the right config set.
2. Can either deploy to all nodes (works for me) or add these files
to confFiles in /replication request handler.


On Wed, Aug 26, 2020 at 1:00 PM Dmitry Kan <so...@gmail.com> wrote:

> Hello,
>
> Just noticed my numbering is off, should be:
>
> 1. Deploy a feature store from a JSON file to each collection.
> 2. Reload all collections as advised in the documentation:
>
> https://lucene.apache.org/solr/guide/7_5/learning-to-rank.html#applying-changes
> 3. Deploy the related model from a JSON file.
> 4. Reload all collections again.
>
>
> An update: applying this process twice I was able to fix the issue.
> However, it required "patching" individual collections, while reloading was
> done for all collections at once. I'm not sure this is very transparent to
> the user: maybe show the model deployment status per collection in the
> admin UI?
>
> Thanks,
>
> Dmitry
>
> On Tue, Aug 25, 2020 at 6:20 PM Dmitry Kan <so...@gmail.com> wrote:
>
> > Hi,
> >
> > There is a recent thread "Replication of Solr Model and feature store" on
> > deploying LTR feature store and model into a master/slave Solr topology.
> >
> > I'm facing an issue of deploying into SolrCloud (solr 7.5.0), where
> > collections have shards with replicas. This is the process I've been
> > following:
> >
> > 1. Deploy a feature store from a JSON file to each collection.
> > 2. Reload all collections as advised in the documentation:
> >
> https://lucene.apache.org/solr/guide/7_5/learning-to-rank.html#applying-changes
> > 3. Deploy the related model from a JSON file.
> > 3. Reload all collections again.
> >
> >
> > The problem is that even after reloading the collections, shard replicas
> > continue to not have the model:
> >
> > Error from server at
> > http://server1:8983/solr/collection1_shard1_replica_n1: cannot find
> model
> > 'model_name'
> >
> > What is the proper way to address this issue and can it be potentially a
> > bug in SolrCloud?
> >
> > Is there any workaround I can try, like saving the feature store and
> model
> > JSON files into the collection config path and creating the SolrCloud
> from
> > there?
> >
> > Thanks,
> >
> > Dmitry
> >
> > --
> > Dmitry Kan
> > Luke Toolbox: http://github.com/DmitryKey/luke
> > Blog: http://dmitrykan.blogspot.com and https://medium.com/@dmitry.kan
> > Twitter: http://twitter.com/dmitrykan
> > SemanticAnalyzer: https://semanticanalyzer.info
> >
> >
>

Re: Issues deploying LTR into SolrCloud

[Dmitry Kan <so...@gmail.com>]

Hi Krishan,


Sorry for the late reply and thanks for the suggestion. I will keep it in
mind for the future: as of October last year I have not been working with
the company.


Thanks,


Dmitry

On Mon, Sep 21, 2020 at 2:34 PM krishan goyal <kr...@gmail.com> wrote:

> Not sure how solr cloud works but if your still facing issues, can try this
>
> 1. Deploy the features and models as a _schema_feature-store.json
> and _schema_model-store.json file in the right config set.
> 2. Can either deploy to all nodes (works for me) or add these files
> to confFiles in /replication request handler.
>
>
> On Wed, Aug 26, 2020 at 1:00 PM Dmitry Kan <so...@gmail.com> wrote:
>
> > Hello,
> >
> > Just noticed my numbering is off, should be:
> >
> > 1. Deploy a feature store from a JSON file to each collection.
> > 2. Reload all collections as advised in the documentation:
> >
> >
> https://lucene.apache.org/solr/guide/7_5/learning-to-rank.html#applying-changes
> > 3. Deploy the related model from a JSON file.
> > 4. Reload all collections again.
> >
> >
> > An update: applying this process twice I was able to fix the issue.
> > However, it required "patching" individual collections, while reloading
> was
> > done for all collections at once. I'm not sure this is very transparent
> to
> > the user: maybe show the model deployment status per collection in the
> > admin UI?
> >
> > Thanks,
> >
> > Dmitry
> >
> > On Tue, Aug 25, 2020 at 6:20 PM Dmitry Kan <so...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > There is a recent thread "Replication of Solr Model and feature store"
> on
> > > deploying LTR feature store and model into a master/slave Solr
> topology.
> > >
> > > I'm facing an issue of deploying into SolrCloud (solr 7.5.0), where
> > > collections have shards with replicas. This is the process I've been
> > > following:
> > >
> > > 1. Deploy a feature store from a JSON file to each collection.
> > > 2. Reload all collections as advised in the documentation:
> > >
> >
> https://lucene.apache.org/solr/guide/7_5/learning-to-rank.html#applying-changes
> > > 3. Deploy the related model from a JSON file.
> > > 3. Reload all collections again.
> > >
> > >
> > > The problem is that even after reloading the collections, shard
> replicas
> > > continue to not have the model:
> > >
> > > Error from server at
> > > http://server1:8983/solr/collection1_shard1_replica_n1: cannot find
> > model
> > > 'model_name'
> > >
> > > What is the proper way to address this issue and can it be potentially
> a
> > > bug in SolrCloud?
> > >
> > > Is there any workaround I can try, like saving the feature store and
> > model
> > > JSON files into the collection config path and creating the SolrCloud
> > from
> > > there?
> > >
> > > Thanks,
> > >
> > > Dmitry
> > >
> > > --
> > > Dmitry Kan
> > > Luke Toolbox: http://github.com/DmitryKey/luke
> > > Blog: http://dmitrykan.blogspot.com and https://medium.com/@dmitry.kan
> > > Twitter: http://twitter.com/dmitrykan
> > > SemanticAnalyzer: https://semanticanalyzer.info
> > >
> > >
> >
>


-- 
Dmitry Kan
Luke Toolbox: http://github.com/DmitryKey/luke
Blog: https://dmitry-kan.medium.com/
Twitter: http://twitter.com/dmitrykan