You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Zheng Lin Edwin Yeo <ed...@gmail.com> on 2015/10/13 10:35:26 UTC
Indexing Solr in production
Hi,
What is the best practice to do indexing in Solr for production system.I'm
using Solr 5.3.0.
I understand that post.jar does not have things like robustness checks and
retires, which is important in production, as sometimes certain records
might failed during the indexing, and we need to re-try the indexing for
those records that fails.
Normally, do we need to write a new custom handler in order to achieve all
these?
Want to find out what most people did before I decide on a method and
proceed on to the next step.
Thank you.
Regards,
Edwin
Re: Indexing Solr in production
Posted by Zheng Lin Edwin Yeo <ed...@gmail.com>.
Thank you Alessandro and Erick.
Will try out the SolrJ methond.
Regards,
Edwin
On 14 October 2015 at 00:00, Erick Erickson <er...@gmail.com> wrote:
> Here's a sample:
> https://lucidworks.com/blog/2012/02/14/indexing-with-solrj/
>
> On Tue, Oct 13, 2015 at 4:18 AM, Alessandro Benedetti
> <be...@gmail.com> wrote:
> > The most robust and simple way to go is building your own Indexer.
> > You can decide the platform you want, Solr has plenty of client API
> > libraries.
> >
> > For example if you want to write your Indexer app in Java, you can use
> > SolrJ..
> > Each client library will give you all the flexibility you need to index
> > solr in a robust way.
> >
> > [1] https://cwiki.apache.org/confluence/display/solr/Client+APIs
> > Cheers
> >
> > On 13 October 2015 at 09:35, Zheng Lin Edwin Yeo <ed...@gmail.com>
> > wrote:
> >
> >> Hi,
> >>
> >> What is the best practice to do indexing in Solr for production
> system.I'm
> >> using Solr 5.3.0.
> >>
> >> I understand that post.jar does not have things like robustness checks
> and
> >> retires, which is important in production, as sometimes certain records
> >> might failed during the indexing, and we need to re-try the indexing for
> >> those records that fails.
> >>
> >> Normally, do we need to write a new custom handler in order to achieve
> all
> >> these?
> >> Want to find out what most people did before I decide on a method and
> >> proceed on to the next step.
> >>
> >> Thank you.
> >>
> >> Regards,
> >> Edwin
> >>
> >
> >
> >
> > --
> > --------------------------
> >
> > Benedetti Alessandro
> > Visiting card - http://about.me/alessandro_benedetti
> > Blog - http://alexbenedetti.blogspot.co.uk
> >
> > "Tyger, tyger burning bright
> > In the forests of the night,
> > What immortal hand or eye
> > Could frame thy fearful symmetry?"
> >
> > William Blake - Songs of Experience -1794 England
>
Re: Indexing Solr in production
Posted by Erick Erickson <er...@gmail.com>.
Here's a sample:
https://lucidworks.com/blog/2012/02/14/indexing-with-solrj/
On Tue, Oct 13, 2015 at 4:18 AM, Alessandro Benedetti
<be...@gmail.com> wrote:
> The most robust and simple way to go is building your own Indexer.
> You can decide the platform you want, Solr has plenty of client API
> libraries.
>
> For example if you want to write your Indexer app in Java, you can use
> SolrJ..
> Each client library will give you all the flexibility you need to index
> solr in a robust way.
>
> [1] https://cwiki.apache.org/confluence/display/solr/Client+APIs
> Cheers
>
> On 13 October 2015 at 09:35, Zheng Lin Edwin Yeo <ed...@gmail.com>
> wrote:
>
>> Hi,
>>
>> What is the best practice to do indexing in Solr for production system.I'm
>> using Solr 5.3.0.
>>
>> I understand that post.jar does not have things like robustness checks and
>> retires, which is important in production, as sometimes certain records
>> might failed during the indexing, and we need to re-try the indexing for
>> those records that fails.
>>
>> Normally, do we need to write a new custom handler in order to achieve all
>> these?
>> Want to find out what most people did before I decide on a method and
>> proceed on to the next step.
>>
>> Thank you.
>>
>> Regards,
>> Edwin
>>
>
>
>
> --
> --------------------------
>
> Benedetti Alessandro
> Visiting card - http://about.me/alessandro_benedetti
> Blog - http://alexbenedetti.blogspot.co.uk
>
> "Tyger, tyger burning bright
> In the forests of the night,
> What immortal hand or eye
> Could frame thy fearful symmetry?"
>
> William Blake - Songs of Experience -1794 England
Re: Indexing Solr in production
Posted by Alessandro Benedetti <be...@gmail.com>.
The most robust and simple way to go is building your own Indexer.
You can decide the platform you want, Solr has plenty of client API
libraries.
For example if you want to write your Indexer app in Java, you can use
SolrJ..
Each client library will give you all the flexibility you need to index
solr in a robust way.
[1] https://cwiki.apache.org/confluence/display/solr/Client+APIs
Cheers
On 13 October 2015 at 09:35, Zheng Lin Edwin Yeo <ed...@gmail.com>
wrote:
> Hi,
>
> What is the best practice to do indexing in Solr for production system.I'm
> using Solr 5.3.0.
>
> I understand that post.jar does not have things like robustness checks and
> retires, which is important in production, as sometimes certain records
> might failed during the indexing, and we need to re-try the indexing for
> those records that fails.
>
> Normally, do we need to write a new custom handler in order to achieve all
> these?
> Want to find out what most people did before I decide on a method and
> proceed on to the next step.
>
> Thank you.
>
> Regards,
> Edwin
>
--
--------------------------
Benedetti Alessandro
Visiting card - http://about.me/alessandro_benedetti
Blog - http://alexbenedetti.blogspot.co.uk
"Tyger, tyger burning bright
In the forests of the night,
What immortal hand or eye
Could frame thy fearful symmetry?"
William Blake - Songs of Experience -1794 England