You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by "tamanjit.bindra@yahoo.co.in" <ta...@yahoo.co.in> on 2013/08/11 15:23:01 UTC
commit vs soft-commit
Hi,
Some confusion in my head.
http://http://wiki.apache.org/solr/UpdateXmlMessages#A.22commit.22_and_.22optimize.22
<http://http://wiki.apache.org/solr/UpdateXmlMessages#A.22commit.22_and_.22optimize.22>
says that
/A soft commit is much faster since it only makes index changes visible and
does not fsync index files or write a new index descriptor./
So this means that even with every softcommit a new searcher opens right? If
it does, isn't it still very heavy?
--
View this message in context: http://lucene.472066.n3.nabble.com/commit-vs-soft-commit-tp4083817.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: commit vs soft-commit
Posted by Erick Erickson <er...@gmail.com>.
Take a loot at solrconfig.xml. You configure filtrerCache,
documentCache, queryResultCache. These (and
some others I believe, but certainly these) are _not_
per-segment caches, so are invalidated on soft commit.
Any autowarming you've specified also gets executed
if applicable.
On the other hand, you specify short autocommit
intervals for tight NRT searching capabilities, so it's
likely these caches aren't being re-used all that much
anyway.
Best
Erick
On Sun, Aug 11, 2013 at 11:22 AM, tamanjit.bindra@yahoo.co.in <
tamanjit.bindra@yahoo.co.in> wrote:
> Erik-
> /It does invalidate the "top level" caches, including the caches you
> configure in solrconfig.xml. /
>
> Could you elucidate?
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/commit-vs-soft-commit-tp4083817p4083844.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: commit vs soft-commit
Posted by "tamanjit.bindra@yahoo.co.in" <ta...@yahoo.co.in>.
Erik-
/It does invalidate the "top level" caches, including the caches you
configure in solrconfig.xml. /
Could you elucidate?
--
View this message in context: http://lucene.472066.n3.nabble.com/commit-vs-soft-commit-tp4083817p4083844.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: commit vs soft-commit
Posted by Erick Erickson <er...@gmail.com>.
Soft commits also do not rebuild certain per-segment caches
etc. It does invalidate the "top level" caches, including
the caches you configure in solrconfig.xml.
So no, it's not free at all. Your soft commits should still
be as long an interval as makes sense in your app. But
they're still much faster than hard commits with openSearcher
set to false.
Best
Erick
On Sun, Aug 11, 2013 at 11:00 AM, Shreejay Nair <sh...@gmail.com> wrote:
> Yes a new searcher is opened with every soft commit. It's still considered
> faster because it does not write to the disk which is a slow IO operation
> and might take a lot more time.
>
> On Sunday, August 11, 2013, tamanjit.bindra@yahoo.co.in wrote:
>
> > Hi,
> > Some confusion in my head.
> > http://
> >
> http://wiki.apache.org/solr/UpdateXmlMessages#A.22commit.22_and_.22optimize.22
> > <http://
> >
> http://wiki.apache.org/solr/UpdateXmlMessages#A.22commit.22_and_.22optimize.22
> > >
> > says that
> > /A soft commit is much faster since it only makes index changes visible
> and
> > does not fsync index files or write a new index descriptor./
> >
> > So this means that even with every softcommit a new searcher opens right?
> > If
> > it does, isn't it still very heavy?
> >
> >
> >
> >
> > --
> > View this message in context:
> > http://lucene.472066.n3.nabble.com/commit-vs-soft-commit-tp4083817.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
> >
>
>
> --
> --
> Shreejay Nair
> Sent from my mobile device. Please excuse brevity and typos.
>
Re: commit vs soft-commit
Posted by Shreejay Nair <sh...@gmail.com>.
Yes a new searcher is opened with every soft commit. It's still considered
faster because it does not write to the disk which is a slow IO operation
and might take a lot more time.
On Sunday, August 11, 2013, tamanjit.bindra@yahoo.co.in wrote:
> Hi,
> Some confusion in my head.
> http://
> http://wiki.apache.org/solr/UpdateXmlMessages#A.22commit.22_and_.22optimize.22
> <http://
> http://wiki.apache.org/solr/UpdateXmlMessages#A.22commit.22_and_.22optimize.22
> >
> says that
> /A soft commit is much faster since it only makes index changes visible and
> does not fsync index files or write a new index descriptor./
>
> So this means that even with every softcommit a new searcher opens right?
> If
> it does, isn't it still very heavy?
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/commit-vs-soft-commit-tp4083817.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
--
--
Shreejay Nair
Sent from my mobile device. Please excuse brevity and typos.