You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Nils Weinander <ni...@gmail.com> on 2012/11/15 10:29:27 UTC
Solr 4.0 indexing performance
I have just updated from Solr 3.6 to 4.0, using defaults in solrconfig.xml
for both versions. With 4.0, bulk indexing takes about twice the time it
did in 3.6. Is this to be expected, or the result of my lack of optimization
in the configuration?
--
____________________________________________________________
Nils Weinander
Re: Solr 4.0 indexing performance
Posted by Jack Krupansky <ja...@basetechnology.com>.
Did you start from scratch, or did you bulk index into an existing index?
There is some "backcompat" logic in there, which is convenient, but not
necessarily the best performance.
-- Jack Krupansky
-----Original Message-----
From: Nils Weinander
Sent: Thursday, November 15, 2012 1:29 AM
To: solr-user@lucene.apache.org
Subject: Solr 4.0 indexing performance
I have just updated from Solr 3.6 to 4.0, using defaults in solrconfig.xml
for both versions. With 4.0, bulk indexing takes about twice the time it
did in 3.6. Is this to be expected, or the result of my lack of optimization
in the configuration?
--
____________________________________________________________
Nils Weinander
Re: Solr 4.0 indexing performance
Posted by Otis Gospodnetic <ot...@gmail.com>.
But slower indexing with solr 4.0 sounds suspicious to me... you compared
your configs? JVM parameters? GC? IO? CPU?
Otis
--
Performance Monitoring - http://sematext.com/spm
On Nov 15, 2012 5:26 AM, "Nils Weinander" <ni...@gmail.com> wrote:
> Ah, thanks Markus!
>
> That's a good thing. I tried disabling the transaction log, the difference
> performance is marginal. So, I'll stick with the transaction logging.
>
>
> On Thu, Nov 15, 2012 at 11:02 AM, Markus Jelsma
> <ma...@openindex.io>wrote:
>
> > Hi - you're likely seeing a drop in performance because of durability
> > which is enabled by default via a transaction log. When disabled 4.0 is
> > iirc slightly faster than 3.x.
> >
> >
> > -----Original message-----
> > > From:Nils Weinander <ni...@gmail.com>
> > > Sent: Thu 15-Nov-2012 10:35
> > > To: solr-user@lucene.apache.org
> > > Subject: Solr 4.0 indexing performance
> > >
> > > I have just updated from Solr 3.6 to 4.0, using defaults in
> > solrconfig.xml
> > > for both versions. With 4.0, bulk indexing takes about twice the time
> it
> > > did in 3.6. Is this to be expected, or the result of my lack of
> > optimization
> > > in the configuration?
> > >
> > > --
> > > ____________________________________________________________
> > > Nils Weinander
> > >
> >
>
>
>
> --
> ____________________________________________________________
> Nils Weinander
>
Re: Solr 4.0 indexing performance
Posted by Nils Weinander <ni...@gmail.com>.
Ah, thanks Markus!
That's a good thing. I tried disabling the transaction log, the difference
performance is marginal. So, I'll stick with the transaction logging.
On Thu, Nov 15, 2012 at 11:02 AM, Markus Jelsma
<ma...@openindex.io>wrote:
> Hi - you're likely seeing a drop in performance because of durability
> which is enabled by default via a transaction log. When disabled 4.0 is
> iirc slightly faster than 3.x.
>
>
> -----Original message-----
> > From:Nils Weinander <ni...@gmail.com>
> > Sent: Thu 15-Nov-2012 10:35
> > To: solr-user@lucene.apache.org
> > Subject: Solr 4.0 indexing performance
> >
> > I have just updated from Solr 3.6 to 4.0, using defaults in
> solrconfig.xml
> > for both versions. With 4.0, bulk indexing takes about twice the time it
> > did in 3.6. Is this to be expected, or the result of my lack of
> optimization
> > in the configuration?
> >
> > --
> > ____________________________________________________________
> > Nils Weinander
> >
>
--
____________________________________________________________
Nils Weinander
RE: Solr 4.0 indexing performance
Posted by Markus Jelsma <ma...@openindex.io>.
Hi - you're likely seeing a drop in performance because of durability which is enabled by default via a transaction log. When disabled 4.0 is iirc slightly faster than 3.x.
-----Original message-----
> From:Nils Weinander <ni...@gmail.com>
> Sent: Thu 15-Nov-2012 10:35
> To: solr-user@lucene.apache.org
> Subject: Solr 4.0 indexing performance
>
> I have just updated from Solr 3.6 to 4.0, using defaults in solrconfig.xml
> for both versions. With 4.0, bulk indexing takes about twice the time it
> did in 3.6. Is this to be expected, or the result of my lack of optimization
> in the configuration?
>
> --
> ____________________________________________________________
> Nils Weinander
>