You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@solr.apache.org by The Maverick <ma...@posteo.de> on 2021/04/09 13:52:09 UTC
Basic server setup
Hello.
I have almost 2 decades of development experience. I ha e recently started to use Solr for my life long project.
I am looking for :
1-The best way to get documents into the solr.. Currently writing my own console app to do so, which will iterate over HTML files in folders ..how do you guys manage it .
2- server configuration eg how about 1 core with 2gb ram and 25 GB disk to start with .. I will start with about 1000 docs but it will grow for sure.
3- any beginners tips and tricks or any links to start with basics solr in practice. I have read a few books which describe how it all works but none talks about practical setup and architecture.
Regards
M
Re: Basic server setup
Posted by Alexandre Rafalovitch <ar...@gmail.com>.
The most relevant presentation for the beginners is probably this one:
https://www.slideshare.net/arafalov/rapid-solr-schema-development-phone-directory
. Some other presentations are next to it under the same username.
Simple configs that are opposite to Solr's current kitchen sink
approach are: https://github.com/arafalov/simplest-solr-config .
Understanding both and their differences was very helpful to my
learning process. Related presentation is at:
https://www.slideshare.net/arafalov/rebuilding-solr-6-examples-layer-by-layer-lucenesolrrevolution-2016
.
Tweaking data before schema is URPs:
https://solr.apache.org/guide/8_8/update-request-processors.html , I
find they are like a hidden power not many people realize about.
https://solr.apache.org/guide/8_8/update-request-processors.html . For
example Schemaless mode is just a bunch of URPs.
Regards,
Alex.
P.s. Deployment story is a separate discussion, deserving its own
thread. Make sure to give a bit more details on
clustered/non-clustered, version, specific pains, etc. There are many
people with different needs and experiences.
On Fri, 9 Apr 2021 at 10:50, Shahzad <sh...@posteo.net> wrote:
>
> Thanks Alex
>
> is there a link to your presentations somewhere ?
>
> I don't understand tweaking data before schema. What does it mean :)
> I have created a basic schema but nothing is on production yet. Its another pain point o how to deploy solr indexes and config
>
>
> 9 Apr 2021 16:16:00 Alexandre Rafalovitch <ar...@gmail.com>:
>
> > Welcome aboard.
> >
> > For me, I think the biggest trick is not to think forward from data but
> > backwards from search. That's what will drive the shape of processing.
> >
> > In the beginning, just focus on getting data indexed and searched in
> > primitive ways, even with just a single multivalued wildcards catch-all
> > field. Then, evolve from there.
> >
> > Oh and to understand request handlers (/select, etc.) in solrconfig.xml,
> > especially with the way to provide defaults. And UpdateRequestProcessor
> > pipeline if you need to tweak data in Solr but before schema.
> >
> > And Json facets on top of the ones the older books cover.
> >
> > Regards,
> > Alex
> > P. S. I usually have some newbie tricks in my presentations on slideshare
> > too. And very basic schemas on Github.
> >
> > On Fri., Apr. 9, 2021, 9:52 a.m. The Maverick, <ma...@posteo.de> wrote:
> >
> >> Hello.
> >> I have almost 2 decades of development experience. I ha e recently started
> >> to use Solr for my life long project.
> >> I am looking for :
> >> 1-The best way to get documents into the solr.. Currently writing my own
> >> console app to do so, which will iterate over HTML files in folders ..how
> >> do you guys manage it .
> >> 2- server configuration eg how about 1 core with 2gb ram and 25 GB disk
> >> to start with .. I will start with about 1000 docs but it will grow for
> >> sure.
> >>
> >> 3- any beginners tips and tricks or any links to start with basics solr in
> >> practice. I have read a few books which describe how it all works but none
> >> talks about practical setup and architecture.
> >>
> >> Regards
> >> M
> >>
> >>
> >>
Re: Basic server setup
Posted by Shahzad <sh...@posteo.net>.
Thanks Alex
is there a link to your presentations somewhere ?
I don't understand tweaking data before schema. What does it mean :)
I have created a basic schema but nothing is on production yet. Its another pain point o how to deploy solr indexes and config
9 Apr 2021 16:16:00 Alexandre Rafalovitch <ar...@gmail.com>:
> Welcome aboard.
>
> For me, I think the biggest trick is not to think forward from data but
> backwards from search. That's what will drive the shape of processing.
>
> In the beginning, just focus on getting data indexed and searched in
> primitive ways, even with just a single multivalued wildcards catch-all
> field. Then, evolve from there.
>
> Oh and to understand request handlers (/select, etc.) in solrconfig.xml,
> especially with the way to provide defaults. And UpdateRequestProcessor
> pipeline if you need to tweak data in Solr but before schema.
>
> And Json facets on top of the ones the older books cover.
>
> Regards,
> Alex
> P. S. I usually have some newbie tricks in my presentations on slideshare
> too. And very basic schemas on Github.
>
> On Fri., Apr. 9, 2021, 9:52 a.m. The Maverick, <ma...@posteo.de> wrote:
>
>> Hello.
>> I have almost 2 decades of development experience. I ha e recently started
>> to use Solr for my life long project.
>> I am looking for :
>> 1-The best way to get documents into the solr.. Currently writing my own
>> console app to do so, which will iterate over HTML files in folders ..how
>> do you guys manage it .
>> 2- server configuration eg how about 1 core with 2gb ram and 25 GB disk
>> to start with .. I will start with about 1000 docs but it will grow for
>> sure.
>>
>> 3- any beginners tips and tricks or any links to start with basics solr in
>> practice. I have read a few books which describe how it all works but none
>> talks about practical setup and architecture.
>>
>> Regards
>> M
>>
>>
>>
Re: Basic server setup
Posted by Alexandre Rafalovitch <ar...@gmail.com>.
Welcome aboard.
For me, I think the biggest trick is not to think forward from data but
backwards from search. That's what will drive the shape of processing.
In the beginning, just focus on getting data indexed and searched in
primitive ways, even with just a single multivalued wildcards catch-all
field. Then, evolve from there.
Oh and to understand request handlers (/select, etc.) in solrconfig.xml,
especially with the way to provide defaults. And UpdateRequestProcessor
pipeline if you need to tweak data in Solr but before schema.
And Json facets on top of the ones the older books cover.
Regards,
Alex
P. S. I usually have some newbie tricks in my presentations on slideshare
too. And very basic schemas on Github.
On Fri., Apr. 9, 2021, 9:52 a.m. The Maverick, <ma...@posteo.de> wrote:
> Hello.
> I have almost 2 decades of development experience. I ha e recently started
> to use Solr for my life long project.
> I am looking for :
> 1-The best way to get documents into the solr.. Currently writing my own
> console app to do so, which will iterate over HTML files in folders ..how
> do you guys manage it .
> 2- server configuration eg how about 1 core with 2gb ram and 25 GB disk
> to start with .. I will start with about 1000 docs but it will grow for
> sure.
>
> 3- any beginners tips and tricks or any links to start with basics solr in
> practice. I have read a few books which describe how it all works but none
> talks about practical setup and architecture.
>
> Regards
> M
>
>
>