You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Mohsen Saboorian <mo...@gmail.com> on 2014/11/08 20:03:20 UTC
Solr 4.10 very slow on build()
I have a ~4GB index which takes a minute (or over) to /build()/ when starting
server. I noticed that this happens when I upgrade from solr 4.0 to 4.10.
The index was fully rebuilt with solr 4.10 (using DIH). How can I speed up
startup time?Here is the slow part of the starting log:INFO
141101-23:48:18.239 Loading spell index for spellchecker: wordbreakINFO
141101-23:48:18.239 Loading suggester index for: mySuggesterINFO
141101-23:48:18.239 reload()INFO *141101-23:48:18.239* build()INFO
*141101-23:49:15.270* [admin] webapp=null path=/admin/cores
params={_=1414873135659&wt=json} status=0 QTime=11INFO 141101-23:49:22.503
[news] Registered new searcher Searcher@28195344[news]
main{StandardDirectoryReader(segments_1b6:65731:nrt _fgm(4.10.1):C244111
_1pw(4.10.1):C191483/156:delGen=140 _1wg(4.10.1):C174054/11:delGen=11
_236(4.10.1):C1920/1:delGen=1 _23h(4.10.1):C1756
_67x(4.10.1):C2120/144:delGen=126 _23l(4.10.1):C2185/2:delGen=2
_4ch(4.10.1):C784/145:delGen=126 _3b5(4.10.1):C758/80:delGen=79
_23q(4.10.1):C3391 _97s(4.10.1):C1218/136:delGen=127
_buo(4.10.1):C1096/86:delGen=84 _eh8(4.10.1):C819/73:delGen=69
_fg8(4.10.1):C413/94:delGen=81 _geb(4.10.1):C229/5:delGen=5
_g4b(4.10.1):C130/24:delGen=23 _g6c(4.10.1):C144/15:delGen=14
_ghj(4.10.1):C21/2:delGen=2 _gj6(4.10.1):C25/3:delGen=3
_gfz(4.10.1):C10/1:delGen=1 _ghe(4.10.1):C1 _gir(4.10.1):C3/2:delGen=1
_gis(4.10.1):C2/1:delGen=1 _gja(4.10.1):C1 _gjb(4.10.1):C2/1:delGen=1
_gjd(4.10.1):C1 _gjj(4.10.1):C1 _gjo(4.10.1):C1 _gjp(4.10.1):C1
_gjq(4.10.1):C1 _gjs(4.10.1):C1)}INFO 141101-23:49:22.505 Creating new
IndexWriter...INFO 141101-23:49:22.506 Waiting until IndexWriter is
unused... core=newsINFO 141101-23:49:22.506 Closing old IndexWriter...
core=newsINFO 141101-23:49:22.650 SolrDeletionPolicy.onInit: commits:
num=1
commit{dir=NRTCachingDirectory(MMapDirectory@/app/solr/solrhome/news/data/index
lockFactory=NativeFSLockFactory@/app/solr/solrhome/news/data/index;
maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_bpm,generation=15178}INFO
141101-23:49:22.650 newest commit generation = 15178
--
View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-10-very-slow-on-build-tp4168368.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr 4.10 very slow on build()
Posted by Mohsen Saboorian <mo...@gmail.com>.
Thanks for the answer. Voted for the issue.
On Sat, Nov 8, 2014 at 11:38 PM, Yonik Seeley-5 [via Lucene] <
ml-node+s472066n4168375h78@n3.nabble.com> wrote:
> Try commenting out the suggester component & handler in solrconfig.xml:
> https://issues.apache.org/jira/browse/SOLR-6679
>
> -Yonik
> http://heliosearch.org - native code faceting, facet functions,
> sub-facets, off-heap data
>
>
> On Sat, Nov 8, 2014 at 2:03 PM, Mohsen Saboorian <[hidden email]
> <http://user/SendEmail.jtp?type=node&node=4168375&i=0>> wrote:
>
> > I have a ~4GB index which takes a minute (or over) to /build()/ when
> starting
> > server. I noticed that this happens when I upgrade from solr 4.0 to
> 4.10.
> > The index was fully rebuilt with solr 4.10 (using DIH). How can I speed
> up
> > startup time?Here is the slow part of the starting log:INFO
> > 141101-23:48:18.239 Loading spell index for spellchecker: wordbreakINFO
> > 141101-23:48:18.239 Loading suggester index for: mySuggesterINFO
> > 141101-23:48:18.239 reload()INFO *141101-23:48:18.239* build()INFO
> > *141101-23:49:15.270* [admin] webapp=null path=/admin/cores
> > params={_=1414873135659&wt=json} status=0 QTime=11INFO
> 141101-23:49:22.503
> > [news] Registered new searcher Searcher@28195344[news]
> > main{StandardDirectoryReader(segments_1b6:65731:nrt _fgm(4.10.1):C244111
> > _1pw(4.10.1):C191483/156:delGen=140 _1wg(4.10.1):C174054/11:delGen=11
> > _236(4.10.1):C1920/1:delGen=1 _23h(4.10.1):C1756
> > _67x(4.10.1):C2120/144:delGen=126 _23l(4.10.1):C2185/2:delGen=2
> > _4ch(4.10.1):C784/145:delGen=126 _3b5(4.10.1):C758/80:delGen=79
> > _23q(4.10.1):C3391 _97s(4.10.1):C1218/136:delGen=127
> > _buo(4.10.1):C1096/86:delGen=84 _eh8(4.10.1):C819/73:delGen=69
> > _fg8(4.10.1):C413/94:delGen=81 _geb(4.10.1):C229/5:delGen=5
> > _g4b(4.10.1):C130/24:delGen=23 _g6c(4.10.1):C144/15:delGen=14
> > _ghj(4.10.1):C21/2:delGen=2 _gj6(4.10.1):C25/3:delGen=3
> > _gfz(4.10.1):C10/1:delGen=1 _ghe(4.10.1):C1 _gir(4.10.1):C3/2:delGen=1
> > _gis(4.10.1):C2/1:delGen=1 _gja(4.10.1):C1 _gjb(4.10.1):C2/1:delGen=1
> > _gjd(4.10.1):C1 _gjj(4.10.1):C1 _gjo(4.10.1):C1 _gjp(4.10.1):C1
> > _gjq(4.10.1):C1 _gjs(4.10.1):C1)}INFO 141101-23:49:22.505 Creating new
> > IndexWriter...INFO 141101-23:49:22.506 Waiting until IndexWriter is
> > unused... core=newsINFO 141101-23:49:22.506 Closing old IndexWriter...
> > core=newsINFO 141101-23:49:22.650 SolrDeletionPolicy.onInit: commits:
> > num=1
> > commit{dir=NRTCachingDirectory(MMapDirectory@/app/solr/solrhome/news/data/index
>
> > lockFactory=NativeFSLockFactory@/app/solr/solrhome/news/data/index;
> > maxCacheMB=48.0
> maxMergeSizeMB=4.0),segFN=segments_bpm,generation=15178}INFO
> > 141101-23:49:22.650 newest commit generation = 15178
> >
> >
> >
> > --
> > View this message in context:
> http://lucene.472066.n3.nabble.com/Solr-4-10-very-slow-on-build-tp4168368.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://lucene.472066.n3.nabble.com/Solr-4-10-very-slow-on-build-tp4168368p4168375.html
> To unsubscribe from Solr 4.10 very slow on build(), click here
> <http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4168368&code=bW9oc2Vuc0BnbWFpbC5jb218NDE2ODM2OHw5MTY2NjQ3NTA=>
> .
> NAML
> <http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-10-very-slow-on-build-tp4168368p4168406.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr 4.10 very slow on build()
Posted by Yonik Seeley <yo...@heliosearch.com>.
Try commenting out the suggester component & handler in solrconfig.xml:
https://issues.apache.org/jira/browse/SOLR-6679
-Yonik
http://heliosearch.org - native code faceting, facet functions,
sub-facets, off-heap data
On Sat, Nov 8, 2014 at 2:03 PM, Mohsen Saboorian <mo...@gmail.com> wrote:
> I have a ~4GB index which takes a minute (or over) to /build()/ when starting
> server. I noticed that this happens when I upgrade from solr 4.0 to 4.10.
> The index was fully rebuilt with solr 4.10 (using DIH). How can I speed up
> startup time?Here is the slow part of the starting log:INFO
> 141101-23:48:18.239 Loading spell index for spellchecker: wordbreakINFO
> 141101-23:48:18.239 Loading suggester index for: mySuggesterINFO
> 141101-23:48:18.239 reload()INFO *141101-23:48:18.239* build()INFO
> *141101-23:49:15.270* [admin] webapp=null path=/admin/cores
> params={_=1414873135659&wt=json} status=0 QTime=11INFO 141101-23:49:22.503
> [news] Registered new searcher Searcher@28195344[news]
> main{StandardDirectoryReader(segments_1b6:65731:nrt _fgm(4.10.1):C244111
> _1pw(4.10.1):C191483/156:delGen=140 _1wg(4.10.1):C174054/11:delGen=11
> _236(4.10.1):C1920/1:delGen=1 _23h(4.10.1):C1756
> _67x(4.10.1):C2120/144:delGen=126 _23l(4.10.1):C2185/2:delGen=2
> _4ch(4.10.1):C784/145:delGen=126 _3b5(4.10.1):C758/80:delGen=79
> _23q(4.10.1):C3391 _97s(4.10.1):C1218/136:delGen=127
> _buo(4.10.1):C1096/86:delGen=84 _eh8(4.10.1):C819/73:delGen=69
> _fg8(4.10.1):C413/94:delGen=81 _geb(4.10.1):C229/5:delGen=5
> _g4b(4.10.1):C130/24:delGen=23 _g6c(4.10.1):C144/15:delGen=14
> _ghj(4.10.1):C21/2:delGen=2 _gj6(4.10.1):C25/3:delGen=3
> _gfz(4.10.1):C10/1:delGen=1 _ghe(4.10.1):C1 _gir(4.10.1):C3/2:delGen=1
> _gis(4.10.1):C2/1:delGen=1 _gja(4.10.1):C1 _gjb(4.10.1):C2/1:delGen=1
> _gjd(4.10.1):C1 _gjj(4.10.1):C1 _gjo(4.10.1):C1 _gjp(4.10.1):C1
> _gjq(4.10.1):C1 _gjs(4.10.1):C1)}INFO 141101-23:49:22.505 Creating new
> IndexWriter...INFO 141101-23:49:22.506 Waiting until IndexWriter is
> unused... core=newsINFO 141101-23:49:22.506 Closing old IndexWriter...
> core=newsINFO 141101-23:49:22.650 SolrDeletionPolicy.onInit: commits:
> num=1
> commit{dir=NRTCachingDirectory(MMapDirectory@/app/solr/solrhome/news/data/index
> lockFactory=NativeFSLockFactory@/app/solr/solrhome/news/data/index;
> maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_bpm,generation=15178}INFO
> 141101-23:49:22.650 newest commit generation = 15178
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-10-very-slow-on-build-tp4168368.html
> Sent from the Solr - User mailing list archive at Nabble.com.