You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by davers <db...@improvementdirect.com> on 2013/05/30 21:09:55 UTC

Collections API Reload killing my cloud

Everytime I try to do a reload using the collections API my entire cloud goes
down and I cannot search it. The solrconfig.xml and schema.xml are good
because when I just restart tomcat everything works fine. 

Here is the output of the collections api reload command:

59155087 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Overseer
Collection Processor: Get the message
id:/overseer/collection-queue-work/qn-0000000000 message:{
  "operation":"reloadcollection",
  "name":"productindex"}
59155098 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Executing
Collection Cmd : action=RELOAD
59155099 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
sending CoreAdmin cmd to solr-shard-1:8080/solr
params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
59155099 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
sending CoreAdmin cmd to solr-shard-4:8080/solr
params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
59155100 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
sending CoreAdmin cmd to solr-shard-2:8080/solr
params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
59155102 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
sending CoreAdmin cmd to solr-shard-5:8080/solr
params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
59155103 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
sending CoreAdmin cmd to solr-shard-3:8080/solr
params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
59155105 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
sending CoreAdmin cmd to solr-shard-6:8080/solr
params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
59155108 [http-bio-8080-exec-7] INFO  org.apache.solr.core.CoreContainer  –
Reloading SolrCore 'productindex' using instanceDir: /srv/solr/productindex
59155109 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
Check for collection zkNode:productindex
59155111 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
Collection zkNode exists
59155112 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
Load collection config from:/collections/productindex
59155114 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – new SolrResourceLoader for
directory: '/srv/solr/productindex/'
59155166 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrConfig  –
Adding specified lib dirs to ClassLoader
59155167 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/bcmail-jdk15-1.45.jar' to classloader
59155168 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/metadata-extractor-2.6.2.jar' to
classloader
59155168 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/apache-mime4j-core-0.7.2.jar' to
classloader
59155168 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/vorbis-java-core-0.1.jar' to
classloader
59155168 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/juniversalchardet-1.0.3.jar' to
classloader
59155169 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/poi-3.8.jar' to classloader
59155169 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/rome-0.9.jar' to classloader
59155169 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/jdom-1.0.jar' to classloader
59155170 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/poi-ooxml-schemas-3.8.jar' to
classloader
59155170 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/commons-compress-1.4.1.jar' to
classloader
59155170 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/apache-mime4j-dom-0.7.2.jar' to
classloader
59155170 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/icu4j-49.1.jar' to classloader
59155171 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/pdfbox-1.7.1.jar' to classloader
59155171 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/isoparser-1.0-RC-1.jar' to
classloader
59155171 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/xercesImpl-2.9.1.jar' to classloader
59155172 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/tagsoup-1.2.1.jar' to classloader
59155172 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/poi-ooxml-3.8.jar' to classloader
59155172 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/bcprov-jdk15-1.45.jar' to classloader
59155172 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/netcdf-4.2-min.jar' to classloader
59155173 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/poi-scratchpad-3.8.jar' to
classloader
59155173 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/jempbox-1.7.1.jar' to classloader
59155173 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/vorbis-java-tika-0.1.jar' to
classloader
59155174 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/boilerpipe-1.1.0.jar' to classloader
59155174 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/fontbox-1.7.1.jar' to classloader
59155174 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/tika-core-1.3.jar' to classloader
59155174 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/dom4j-1.6.1.jar' to classloader
59155175 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/tika-parsers-1.3.jar' to classloader
59155175 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/xz-1.0.jar' to classloader
59155175 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/extraction/lib/xmlbeans-2.3.0.jar' to classloader
59155176 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/dist/solr-cell-4.3.0.jar' to classloader
59155177 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/clustering/lib/simple-xml-2.6.4.jar' to classloader
59155177 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/clustering/lib/jackson-core-asl-1.7.4.jar' to
classloader
59155177 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/clustering/lib/mahout-math-0.6.jar' to classloader
59155177 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/clustering/lib/attributes-binder-1.0.1.jar' to
classloader
59155178 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/clustering/lib/jackson-mapper-asl-1.7.4.jar' to
classloader
59155178 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/clustering/lib/carrot2-mini-3.6.2.jar' to
classloader
59155178 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/clustering/lib/mahout-collections-1.0.jar' to
classloader
59155179 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/clustering/lib/hppc-0.4.1.jar' to classloader
59155179 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/dist/solr-clustering-4.3.0.jar' to classloader
59155180 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/langid/lib/jsonic-1.2.7.jar' to classloader
59155180 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/langid/lib/langdetect-1.1-20120112.jar' to
classloader
59155181 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/dist/solr-langid-4.3.0.jar' to classloader
59155182 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/velocity/lib/velocity-1.7.jar' to classloader
59155182 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/velocity/lib/commons-collections-3.2.1.jar' to
classloader
59155182 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/velocity/lib/commons-beanutils-1.7.0.jar' to
classloader
59155182 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/velocity/lib/velocity-tools-2.0.jar' to classloader
59155183 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/dist/solr-velocity-4.3.0.jar' to classloader
59155184 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/dataimporthandler/lib/mail-1.4.1.jar' to classloader
59155184 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/dataimporthandler/lib/data-import-transformers.jar'
to classloader
59155184 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/dataimporthandler/lib/jtds-1.2.5.jar' to classloader
59155185 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/contrib/dataimporthandler/lib/activation-1.1.jar' to
classloader
59155185 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/dist/solr-dataimporthandler-extras-4.3.0.jar' to classloader
59155186 [http-bio-8080-exec-7] INFO 
org.apache.solr.core.SolrResourceLoader  – Adding
'file:/srv/solr/dist/solr-dataimporthandler-4.3.0.jar' to classloader
59155243 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrConfig  –
Using Lucene MatchVersion: LUCENE_43
59155315 [http-bio-8080-exec-7] INFO  org.apache.solr.core.Config  – Loaded
SolrConfig: solrconfig.xml
59155318 [http-bio-8080-exec-7] INFO  org.apache.solr.schema.IndexSchema  –
Reading Solr Schema from schema.xml
59155351 [http-bio-8080-exec-7] INFO  org.apache.solr.schema.IndexSchema  –
Schema name=example
59155546 [http-bio-8080-exec-7] INFO  org.apache.solr.schema.IndexSchema  –
unique key field: id
59155581 [http-bio-8080-exec-7] INFO 
org.apache.solr.schema.FileExchangeRateProvider  – Reloading exchange rates
from file currency.xml
59155593 [http-bio-8080-exec-7] INFO 
org.apache.solr.schema.FileExchangeRateProvider  – Reloading exchange rates
from file currency.xml
59155607 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
[productindex] Opening new SolrCore at /srv/solr/productindex/,
dataDir=/srv/solr/productindex/data/
59155607 [http-bio-8080-exec-7] INFO  org.apache.solr.core.JmxMonitoredMap 
– JMX monitoring is enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@623199dc
59155608 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
[productindex] Added SolrEventListener for newSearcher:
org.apache.solr.core.QuerySenderListener{queries=[]}
59155609 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
[productindex] Added SolrEventListener for firstSearcher:
org.apache.solr.core.QuerySenderListener{queries=[{}]}
59155610 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  – New
index directory detected: old=null new=/srv/solr/productindex/data/index/
59155611 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
created json: solr.JSONResponseWriter
59155611 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
adding lazy queryResponseWriter: solr.VelocityResponseWriter
59155611 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
created velocity: solr.VelocityResponseWriter
59155611 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
created xslt: solr.XSLTResponseWriter
59155612 [http-bio-8080-exec-7] INFO 
org.apache.solr.response.XSLTResponseWriter  – xsltCacheLifetimeSeconds=5
59155614 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /select: solr.SearchHandler
59155616 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /productQuery: solr.SearchHandler
59155617 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /query: solr.SearchHandler
59155618 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /get: solr.RealTimeGetHandler
59155619 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /update: solr.UpdateRequestHandler
59155620 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /update/json: solr.JsonUpdateRequestHandler
59155621 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /update/csv: solr.CSVRequestHandler
59155621 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
59155621 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /update/extract: solr.extraction.ExtractingRequestHandler
59155622 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– adding lazy requestHandler: solr.FieldAnalysisRequestHandler
59155622 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /analysis/field: solr.FieldAnalysisRequestHandler
59155622 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
59155623 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /analysis/document: solr.DocumentAnalysisRequestHandler
59155623 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /admin/: solr.admin.AdminHandlers
59155624 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /admin/ping: solr.PingRequestHandler
59155625 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /debug/dump: solr.DumpRequestHandler
59155626 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /replication: solr.ReplicationHandler
59155641 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /dataimport: org.apache.solr.handler.dataimport.DataImportHandler
59155641 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– adding lazy requestHandler: solr.SearchHandler
59155641 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /tvrh: solr.SearchHandler
59155642 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– adding lazy requestHandler: solr.SearchHandler
59155642 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /terms: solr.SearchHandler
59155642 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– adding lazy requestHandler: solr.SearchHandler
59155643 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
– created /elevate: solr.SearchHandler
59155644 [http-bio-8080-exec-7] INFO 
org.apache.solr.handler.loader.XMLLoader  – xsltCacheLifetimeSeconds=60
59155644 [http-bio-8080-exec-7] INFO 
org.apache.solr.handler.loader.XMLLoader  – xsltCacheLifetimeSeconds=60
59155645 [http-bio-8080-exec-7] INFO 
org.apache.solr.handler.loader.XMLLoader  – xsltCacheLifetimeSeconds=60
59155658 [http-bio-8080-exec-7] INFO 
org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@391d58ad main
59155658 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  – Hard
AutoCommit: if uncommited for 15000ms;
59155659 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  – Soft
AutoCommit: disabled
59155660 [http-bio-8080-exec-7] INFO 
org.apache.solr.handler.component.SpellCheckComponent  – Initializing spell
checkers
59155660 [http-bio-8080-exec-7] INFO 
org.apache.solr.spelling.DirectSolrSpellChecker  – init:
{name=default,field=spell,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
59155660 [http-bio-8080-exec-7] INFO 
org.apache.solr.handler.component.SpellCheckComponent  – No queryConverter
defined, using default converter
59155661 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
Load collection config from:/collections/productindex
59155670 [http-bio-8080-exec-7] INFO 
org.apache.solr.handler.ReplicationHandler  – Commits will be reserved for 
10000
59155692 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
– QuerySenderListener sending requests to Searcher@391d58ad
main{StandardDirectoryReader(segments_2:1:nrt)}
59155694 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
– [productindex] webapp=null path=null
params={event=firstSearcher&distrib=false} hits=0 status=0 QTime=1
59155695 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
– QuerySenderListener done.
59155695 [searcherExecutor-13-thread-1] INFO 
org.apache.solr.handler.component.SpellCheckComponent  – Loading spell index
for spellchecker: default
59155699 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
– [productindex] Registered new searcher Searcher@391d58ad
main{StandardDirectoryReader(segments_2:1:nrt)}
59155704 [http-bio-8080-exec-7] INFO 
org.apache.solr.update.DefaultSolrCoreState  – Creating new IndexWriter...
59155705 [http-bio-8080-exec-7] INFO 
org.apache.solr.update.DefaultSolrCoreState  – Waiting until IndexWriter is
unused... core=productindex
59155705 [http-bio-8080-exec-7] INFO 
org.apache.solr.update.DefaultSolrCoreState  – Closing old IndexWriter...
core=productindex
59155709 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
SolrDeletionPolicy.onInit: commits:num=1

commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/srv/solr/productindex/data/index
lockFactory=org.apache.lucene.store.NativeFSLockFactory@7fb4dbe7;
maxCacheMB=48.0
maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
59155710 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
newest commit = 2[segments_2]
59155710 [http-bio-8080-exec-7] INFO 
org.apache.solr.update.DefaultSolrCoreState  – New IndexWriter is ready to
be used.
59155710 [http-bio-8080-exec-7] INFO 
org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@4acdd45c main
59155711 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
publishing core=productindex state=down
59155711 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
numShards not found on descriptor - reading it from system property
59155712 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
– QuerySenderListener sending requests to Searcher@4acdd45c
main{StandardDirectoryReader(segments_2:1:nrt)}
59155712 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
– QuerySenderListener done.
59155715 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
– [productindex] Registered new searcher Searcher@4acdd45c
main{StandardDirectoryReader(segments_2:1:nrt)}
59155716 [http-bio-8080-exec-7] INFO  org.apache.solr.core.CoreContainer  –
replacing core: productindex
59155716 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
[productindex]  CLOSING SolrCore org.apache.solr.core.SolrCore@202525a2
59155721 [http-bio-8080-exec-7] INFO  org.apache.solr.update.UpdateHandler 
– closing DirectUpdateHandler2{commits=0,autocommit
maxTime=15000ms,autocommits=0,soft
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
59155722 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
[productindex] Closing main searcher on request.
59155723 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
Register replica - core:productindex address:http://solr-shard-4:8080/solr
collection:productindex shard:shard1
59155731 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
We are http://solr-shard-4:8080/solr/productindex/ and leader is
http://solr-shard-1:8080/solr/productindex/
59155732 [http-bio-8080-exec-7] INFO 
org.apache.solr.common.cloud.ZkStateReader  – Updating cloud state from
ZooKeeper...
59155750 [http-bio-8080-exec-7] INFO 
org.apache.solr.servlet.SolrDispatchFilter  – [admin] webapp=null
path=/admin/cores
params={action=RELOAD&core=productindex&wt=javabin&qt=/admin/cores&version=2}
status=0 QTime=642
59155926 [localhost-startStop-1-EventThread] INFO 
org.apache.solr.cloud.DistributedQueue  – Watcher fired on path:
/overseer/collection-queue-work state: SyncConnected type
NodeChildrenChanged
59155926 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Overseer
Collection Processor: Message
id:/overseer/collection-queue-work/qn-0000000000 complete,
response:{success={solr-shard-6:8080_solr={responseHeader={status=0,QTime=635}},solr-shard-4:8080_solr={responseHeader={status=0,QTime=642}},solr-shard-2:8080_solr={responseHeader={status=0,QTime=683}},solr-shard-5:8080_solr={responseHeader={status=0,QTime=711}},solr-shard-3:8080_solr={responseHeader={status=0,QTime=727}},solr-shard-1:8080_solr={responseHeader={status=0,QTime=793}}}}
59157030 [Thread-2] INFO  org.apache.solr.common.cloud.ZkStateReader  –
Updating cloud state from ZooKeeper...
59157032 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
numShards=null message={
  "operation":"state",
  "core_node_name":"solr-shard-4:8080_solr_productindex",
  "numShards":null,
  "shard":"shard1",
  "roles":null,
  "state":"down",
  "shard_state":"active",
  "core":"productindex",
  "collection":"productindex",
  "shard_range":null,
  "node_name":"solr-shard-4:8080_solr",
  "base_url":"http://solr-shard-4:8080/solr"}
59157044 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
numShards=null message={
  "operation":"state",
  "core_node_name":"solr-shard-6:8080_solr_productindex",
  "numShards":null,
  "shard":"shard3",
  "roles":null,
  "state":"down",
  "shard_state":"active",
  "core":"productindex",
  "collection":"productindex",
  "shard_range":null,
  "node_name":"solr-shard-6:8080_solr",
  "base_url":"http://solr-shard-6:8080/solr"}
59157054 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
numShards=null message={
  "operation":"state",
  "core_node_name":"solr-shard-2:8080_solr_productindex",
  "numShards":null,
  "shard":"shard2",
  "roles":null,
  "state":"down",
  "shard_state":"active",
  "core":"productindex",
  "collection":"productindex",
  "shard_range":null,
  "node_name":"solr-shard-2:8080_solr",
  "base_url":"http://solr-shard-2:8080/solr"}
59157062 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
numShards=null message={
  "operation":"state",
  "core_node_name":"solr-shard-5:8080_solr_productindex",
  "numShards":null,
  "shard":"shard2",
  "roles":null,
  "state":"down",
  "shard_state":"active",
  "core":"productindex",
  "collection":"productindex",
  "shard_range":null,
  "node_name":"solr-shard-5:8080_solr",
  "base_url":"http://solr-shard-5:8080/solr"}
59157071 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
numShards=null message={
  "operation":"state",
  "core_node_name":"solr-shard-3:8080_solr_productindex",
  "numShards":null,
  "shard":"shard3",
  "roles":null,
  "state":"down",
  "shard_state":"active",
  "core":"productindex",
  "collection":"productindex",
  "shard_range":null,
  "node_name":"solr-shard-3:8080_solr",
  "base_url":"http://solr-shard-3:8080/solr"}
59157081 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
numShards=3 message={
  "operation":"state",
  "core_node_name":"solr-shard-1:8080_solr_productindex",
  "numShards":"3",
  "shard":"shard1",
  "roles":null,
  "state":"down",
  "shard_state":"active",
  "core":"productindex",
  "collection":"productindex",
  "shard_range":null,
  "node_name":"solr-shard-1:8080_solr",
  "base_url":"http://solr-shard-1:8080/solr"}
59157092 [localhost-startStop-1-EventThread] INFO 
org.apache.solr.common.cloud.ZkStateReader  – A cluster state change:
WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 6)




Here is a picture of my cloud after the reload: http://d.pr/i/vN1A

Here is the output when I try to do a search:

<response>
<lst name="responseHeader">
<int name="status">503</int>
<int name="QTime">111</int>
<lst name="params">
<str name="q">*:*</str>
</lst>
</lst>
<lst name="error">
<str name="msg">no servers hosting shard:</str>
<int name="code">503</int>
</lst>
</response>



Any help is greatly appreciated as I often have to tweak my configs on my
production cloud.



--
View this message in context: http://lucene.472066.n3.nabble.com/Collections-API-Reload-killing-my-cloud-tp4067141.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Collections API Reload killing my cloud

Posted by davers <db...@improvementdirect.com>.
Is it possible that this has something do do with it?

59157032 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
numShards=null message={

numShards=null



--
View this message in context: http://lucene.472066.n3.nabble.com/Collections-API-Reload-killing-my-cloud-tp4067141p4067151.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Collections API Reload killing my cloud

Posted by Mark Miller <ma...@gmail.com>.
https://issues.apache.org/jira/browse/SOLR-4805

- Mark

On May 30, 2013, at 3:09 PM, davers <db...@improvementdirect.com> wrote:

> Everytime I try to do a reload using the collections API my entire cloud goes
> down and I cannot search it. The solrconfig.xml and schema.xml are good
> because when I just restart tomcat everything works fine. 
> 
> Here is the output of the collections api reload command:
> 
> 59155087 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
> INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Overseer
> Collection Processor: Get the message
> id:/overseer/collection-queue-work/qn-0000000000 message:{
>  "operation":"reloadcollection",
>  "name":"productindex"}
> 59155098 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
> INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Executing
> Collection Cmd : action=RELOAD
> 59155099 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
> INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
> sending CoreAdmin cmd to solr-shard-1:8080/solr
> params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
> 59155099 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
> INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
> sending CoreAdmin cmd to solr-shard-4:8080/solr
> params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
> 59155100 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
> INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
> sending CoreAdmin cmd to solr-shard-2:8080/solr
> params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
> 59155102 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
> INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
> sending CoreAdmin cmd to solr-shard-5:8080/solr
> params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
> 59155103 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
> INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
> sending CoreAdmin cmd to solr-shard-3:8080/solr
> params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
> 59155105 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
> INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Collection Admin
> sending CoreAdmin cmd to solr-shard-6:8080/solr
> params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores
> 59155108 [http-bio-8080-exec-7] INFO  org.apache.solr.core.CoreContainer  –
> Reloading SolrCore 'productindex' using instanceDir: /srv/solr/productindex
> 59155109 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
> Check for collection zkNode:productindex
> 59155111 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
> Collection zkNode exists
> 59155112 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
> Load collection config from:/collections/productindex
> 59155114 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – new SolrResourceLoader for
> directory: '/srv/solr/productindex/'
> 59155166 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrConfig  –
> Adding specified lib dirs to ClassLoader
> 59155167 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/bcmail-jdk15-1.45.jar' to classloader
> 59155168 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/metadata-extractor-2.6.2.jar' to
> classloader
> 59155168 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/apache-mime4j-core-0.7.2.jar' to
> classloader
> 59155168 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/vorbis-java-core-0.1.jar' to
> classloader
> 59155168 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/juniversalchardet-1.0.3.jar' to
> classloader
> 59155169 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/poi-3.8.jar' to classloader
> 59155169 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/rome-0.9.jar' to classloader
> 59155169 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/jdom-1.0.jar' to classloader
> 59155170 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/poi-ooxml-schemas-3.8.jar' to
> classloader
> 59155170 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/commons-compress-1.4.1.jar' to
> classloader
> 59155170 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/apache-mime4j-dom-0.7.2.jar' to
> classloader
> 59155170 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/icu4j-49.1.jar' to classloader
> 59155171 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/pdfbox-1.7.1.jar' to classloader
> 59155171 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/isoparser-1.0-RC-1.jar' to
> classloader
> 59155171 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/xercesImpl-2.9.1.jar' to classloader
> 59155172 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/tagsoup-1.2.1.jar' to classloader
> 59155172 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/poi-ooxml-3.8.jar' to classloader
> 59155172 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/bcprov-jdk15-1.45.jar' to classloader
> 59155172 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/netcdf-4.2-min.jar' to classloader
> 59155173 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/poi-scratchpad-3.8.jar' to
> classloader
> 59155173 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/jempbox-1.7.1.jar' to classloader
> 59155173 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/vorbis-java-tika-0.1.jar' to
> classloader
> 59155174 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/boilerpipe-1.1.0.jar' to classloader
> 59155174 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/fontbox-1.7.1.jar' to classloader
> 59155174 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/tika-core-1.3.jar' to classloader
> 59155174 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/dom4j-1.6.1.jar' to classloader
> 59155175 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/tika-parsers-1.3.jar' to classloader
> 59155175 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/xz-1.0.jar' to classloader
> 59155175 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/extraction/lib/xmlbeans-2.3.0.jar' to classloader
> 59155176 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/dist/solr-cell-4.3.0.jar' to classloader
> 59155177 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/clustering/lib/simple-xml-2.6.4.jar' to classloader
> 59155177 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/clustering/lib/jackson-core-asl-1.7.4.jar' to
> classloader
> 59155177 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/clustering/lib/mahout-math-0.6.jar' to classloader
> 59155177 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/clustering/lib/attributes-binder-1.0.1.jar' to
> classloader
> 59155178 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/clustering/lib/jackson-mapper-asl-1.7.4.jar' to
> classloader
> 59155178 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/clustering/lib/carrot2-mini-3.6.2.jar' to
> classloader
> 59155178 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/clustering/lib/mahout-collections-1.0.jar' to
> classloader
> 59155179 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/clustering/lib/hppc-0.4.1.jar' to classloader
> 59155179 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/dist/solr-clustering-4.3.0.jar' to classloader
> 59155180 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/langid/lib/jsonic-1.2.7.jar' to classloader
> 59155180 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/langid/lib/langdetect-1.1-20120112.jar' to
> classloader
> 59155181 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/dist/solr-langid-4.3.0.jar' to classloader
> 59155182 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/velocity/lib/velocity-1.7.jar' to classloader
> 59155182 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/velocity/lib/commons-collections-3.2.1.jar' to
> classloader
> 59155182 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/velocity/lib/commons-beanutils-1.7.0.jar' to
> classloader
> 59155182 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/velocity/lib/velocity-tools-2.0.jar' to classloader
> 59155183 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/dist/solr-velocity-4.3.0.jar' to classloader
> 59155184 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/dataimporthandler/lib/mail-1.4.1.jar' to classloader
> 59155184 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/dataimporthandler/lib/data-import-transformers.jar'
> to classloader
> 59155184 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/dataimporthandler/lib/jtds-1.2.5.jar' to classloader
> 59155185 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/contrib/dataimporthandler/lib/activation-1.1.jar' to
> classloader
> 59155185 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/dist/solr-dataimporthandler-extras-4.3.0.jar' to classloader
> 59155186 [http-bio-8080-exec-7] INFO 
> org.apache.solr.core.SolrResourceLoader  – Adding
> 'file:/srv/solr/dist/solr-dataimporthandler-4.3.0.jar' to classloader
> 59155243 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrConfig  –
> Using Lucene MatchVersion: LUCENE_43
> 59155315 [http-bio-8080-exec-7] INFO  org.apache.solr.core.Config  – Loaded
> SolrConfig: solrconfig.xml
> 59155318 [http-bio-8080-exec-7] INFO  org.apache.solr.schema.IndexSchema  –
> Reading Solr Schema from schema.xml
> 59155351 [http-bio-8080-exec-7] INFO  org.apache.solr.schema.IndexSchema  –
> Schema name=example
> 59155546 [http-bio-8080-exec-7] INFO  org.apache.solr.schema.IndexSchema  –
> unique key field: id
> 59155581 [http-bio-8080-exec-7] INFO 
> org.apache.solr.schema.FileExchangeRateProvider  – Reloading exchange rates
> from file currency.xml
> 59155593 [http-bio-8080-exec-7] INFO 
> org.apache.solr.schema.FileExchangeRateProvider  – Reloading exchange rates
> from file currency.xml
> 59155607 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
> [productindex] Opening new SolrCore at /srv/solr/productindex/,
> dataDir=/srv/solr/productindex/data/
> 59155607 [http-bio-8080-exec-7] INFO  org.apache.solr.core.JmxMonitoredMap 
> – JMX monitoring is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@623199dc
> 59155608 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
> [productindex] Added SolrEventListener for newSearcher:
> org.apache.solr.core.QuerySenderListener{queries=[]}
> 59155609 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
> [productindex] Added SolrEventListener for firstSearcher:
> org.apache.solr.core.QuerySenderListener{queries=[{}]}
> 59155610 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  – New
> index directory detected: old=null new=/srv/solr/productindex/data/index/
> 59155611 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
> created json: solr.JSONResponseWriter
> 59155611 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
> adding lazy queryResponseWriter: solr.VelocityResponseWriter
> 59155611 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
> created velocity: solr.VelocityResponseWriter
> 59155611 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
> created xslt: solr.XSLTResponseWriter
> 59155612 [http-bio-8080-exec-7] INFO 
> org.apache.solr.response.XSLTResponseWriter  – xsltCacheLifetimeSeconds=5
> 59155614 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /select: solr.SearchHandler
> 59155616 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /productQuery: solr.SearchHandler
> 59155617 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /query: solr.SearchHandler
> 59155618 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /get: solr.RealTimeGetHandler
> 59155619 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /update: solr.UpdateRequestHandler
> 59155620 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /update/json: solr.JsonUpdateRequestHandler
> 59155621 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /update/csv: solr.CSVRequestHandler
> 59155621 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
> 59155621 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /update/extract: solr.extraction.ExtractingRequestHandler
> 59155622 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – adding lazy requestHandler: solr.FieldAnalysisRequestHandler
> 59155622 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /analysis/field: solr.FieldAnalysisRequestHandler
> 59155622 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
> 59155623 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /analysis/document: solr.DocumentAnalysisRequestHandler
> 59155623 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /admin/: solr.admin.AdminHandlers
> 59155624 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /admin/ping: solr.PingRequestHandler
> 59155625 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /debug/dump: solr.DumpRequestHandler
> 59155626 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /replication: solr.ReplicationHandler
> 59155641 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /dataimport: org.apache.solr.handler.dataimport.DataImportHandler
> 59155641 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – adding lazy requestHandler: solr.SearchHandler
> 59155641 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /tvrh: solr.SearchHandler
> 59155642 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – adding lazy requestHandler: solr.SearchHandler
> 59155642 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /terms: solr.SearchHandler
> 59155642 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – adding lazy requestHandler: solr.SearchHandler
> 59155643 [http-bio-8080-exec-7] INFO  org.apache.solr.core.RequestHandlers 
> – created /elevate: solr.SearchHandler
> 59155644 [http-bio-8080-exec-7] INFO 
> org.apache.solr.handler.loader.XMLLoader  – xsltCacheLifetimeSeconds=60
> 59155644 [http-bio-8080-exec-7] INFO 
> org.apache.solr.handler.loader.XMLLoader  – xsltCacheLifetimeSeconds=60
> 59155645 [http-bio-8080-exec-7] INFO 
> org.apache.solr.handler.loader.XMLLoader  – xsltCacheLifetimeSeconds=60
> 59155658 [http-bio-8080-exec-7] INFO 
> org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@391d58ad main
> 59155658 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  – Hard
> AutoCommit: if uncommited for 15000ms;
> 59155659 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  – Soft
> AutoCommit: disabled
> 59155660 [http-bio-8080-exec-7] INFO 
> org.apache.solr.handler.component.SpellCheckComponent  – Initializing spell
> checkers
> 59155660 [http-bio-8080-exec-7] INFO 
> org.apache.solr.spelling.DirectSolrSpellChecker  – init:
> {name=default,field=spell,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
> 59155660 [http-bio-8080-exec-7] INFO 
> org.apache.solr.handler.component.SpellCheckComponent  – No queryConverter
> defined, using default converter
> 59155661 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
> Load collection config from:/collections/productindex
> 59155670 [http-bio-8080-exec-7] INFO 
> org.apache.solr.handler.ReplicationHandler  – Commits will be reserved for 
> 10000
> 59155692 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
> – QuerySenderListener sending requests to Searcher@391d58ad
> main{StandardDirectoryReader(segments_2:1:nrt)}
> 59155694 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
> – [productindex] webapp=null path=null
> params={event=firstSearcher&distrib=false} hits=0 status=0 QTime=1
> 59155695 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
> – QuerySenderListener done.
> 59155695 [searcherExecutor-13-thread-1] INFO 
> org.apache.solr.handler.component.SpellCheckComponent  – Loading spell index
> for spellchecker: default
> 59155699 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
> – [productindex] Registered new searcher Searcher@391d58ad
> main{StandardDirectoryReader(segments_2:1:nrt)}
> 59155704 [http-bio-8080-exec-7] INFO 
> org.apache.solr.update.DefaultSolrCoreState  – Creating new IndexWriter...
> 59155705 [http-bio-8080-exec-7] INFO 
> org.apache.solr.update.DefaultSolrCoreState  – Waiting until IndexWriter is
> unused... core=productindex
> 59155705 [http-bio-8080-exec-7] INFO 
> org.apache.solr.update.DefaultSolrCoreState  – Closing old IndexWriter...
> core=productindex
> 59155709 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
> SolrDeletionPolicy.onInit: commits:num=1
> 
> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/srv/solr/productindex/data/index
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@7fb4dbe7;
> maxCacheMB=48.0
> maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
> 59155710 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
> newest commit = 2[segments_2]
> 59155710 [http-bio-8080-exec-7] INFO 
> org.apache.solr.update.DefaultSolrCoreState  – New IndexWriter is ready to
> be used.
> 59155710 [http-bio-8080-exec-7] INFO 
> org.apache.solr.search.SolrIndexSearcher  – Opening Searcher@4acdd45c main
> 59155711 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
> publishing core=productindex state=down
> 59155711 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
> numShards not found on descriptor - reading it from system property
> 59155712 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
> – QuerySenderListener sending requests to Searcher@4acdd45c
> main{StandardDirectoryReader(segments_2:1:nrt)}
> 59155712 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
> – QuerySenderListener done.
> 59155715 [searcherExecutor-13-thread-1] INFO  org.apache.solr.core.SolrCore 
> – [productindex] Registered new searcher Searcher@4acdd45c
> main{StandardDirectoryReader(segments_2:1:nrt)}
> 59155716 [http-bio-8080-exec-7] INFO  org.apache.solr.core.CoreContainer  –
> replacing core: productindex
> 59155716 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
> [productindex]  CLOSING SolrCore org.apache.solr.core.SolrCore@202525a2
> 59155721 [http-bio-8080-exec-7] INFO  org.apache.solr.update.UpdateHandler 
> – closing DirectUpdateHandler2{commits=0,autocommit
> maxTime=15000ms,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> 59155722 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  –
> [productindex] Closing main searcher on request.
> 59155723 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
> Register replica - core:productindex address:http://solr-shard-4:8080/solr
> collection:productindex shard:shard1
> 59155731 [http-bio-8080-exec-7] INFO  org.apache.solr.cloud.ZkController  –
> We are http://solr-shard-4:8080/solr/productindex/ and leader is
> http://solr-shard-1:8080/solr/productindex/
> 59155732 [http-bio-8080-exec-7] INFO 
> org.apache.solr.common.cloud.ZkStateReader  – Updating cloud state from
> ZooKeeper...
> 59155750 [http-bio-8080-exec-7] INFO 
> org.apache.solr.servlet.SolrDispatchFilter  – [admin] webapp=null
> path=/admin/cores
> params={action=RELOAD&core=productindex&wt=javabin&qt=/admin/cores&version=2}
> status=0 QTime=642
> 59155926 [localhost-startStop-1-EventThread] INFO 
> org.apache.solr.cloud.DistributedQueue  – Watcher fired on path:
> /overseer/collection-queue-work state: SyncConnected type
> NodeChildrenChanged
> 59155926 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000]
> INFO  org.apache.solr.cloud.OverseerCollectionProcessor  – Overseer
> Collection Processor: Message
> id:/overseer/collection-queue-work/qn-0000000000 complete,
> response:{success={solr-shard-6:8080_solr={responseHeader={status=0,QTime=635}},solr-shard-4:8080_solr={responseHeader={status=0,QTime=642}},solr-shard-2:8080_solr={responseHeader={status=0,QTime=683}},solr-shard-5:8080_solr={responseHeader={status=0,QTime=711}},solr-shard-3:8080_solr={responseHeader={status=0,QTime=727}},solr-shard-1:8080_solr={responseHeader={status=0,QTime=793}}}}
> 59157030 [Thread-2] INFO  org.apache.solr.common.cloud.ZkStateReader  –
> Updating cloud state from ZooKeeper...
> 59157032 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
> numShards=null message={
>  "operation":"state",
>  "core_node_name":"solr-shard-4:8080_solr_productindex",
>  "numShards":null,
>  "shard":"shard1",
>  "roles":null,
>  "state":"down",
>  "shard_state":"active",
>  "core":"productindex",
>  "collection":"productindex",
>  "shard_range":null,
>  "node_name":"solr-shard-4:8080_solr",
>  "base_url":"http://solr-shard-4:8080/solr"}
> 59157044 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
> numShards=null message={
>  "operation":"state",
>  "core_node_name":"solr-shard-6:8080_solr_productindex",
>  "numShards":null,
>  "shard":"shard3",
>  "roles":null,
>  "state":"down",
>  "shard_state":"active",
>  "core":"productindex",
>  "collection":"productindex",
>  "shard_range":null,
>  "node_name":"solr-shard-6:8080_solr",
>  "base_url":"http://solr-shard-6:8080/solr"}
> 59157054 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
> numShards=null message={
>  "operation":"state",
>  "core_node_name":"solr-shard-2:8080_solr_productindex",
>  "numShards":null,
>  "shard":"shard2",
>  "roles":null,
>  "state":"down",
>  "shard_state":"active",
>  "core":"productindex",
>  "collection":"productindex",
>  "shard_range":null,
>  "node_name":"solr-shard-2:8080_solr",
>  "base_url":"http://solr-shard-2:8080/solr"}
> 59157062 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
> numShards=null message={
>  "operation":"state",
>  "core_node_name":"solr-shard-5:8080_solr_productindex",
>  "numShards":null,
>  "shard":"shard2",
>  "roles":null,
>  "state":"down",
>  "shard_state":"active",
>  "core":"productindex",
>  "collection":"productindex",
>  "shard_range":null,
>  "node_name":"solr-shard-5:8080_solr",
>  "base_url":"http://solr-shard-5:8080/solr"}
> 59157071 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
> numShards=null message={
>  "operation":"state",
>  "core_node_name":"solr-shard-3:8080_solr_productindex",
>  "numShards":null,
>  "shard":"shard3",
>  "roles":null,
>  "state":"down",
>  "shard_state":"active",
>  "core":"productindex",
>  "collection":"productindex",
>  "shard_range":null,
>  "node_name":"solr-shard-3:8080_solr",
>  "base_url":"http://solr-shard-3:8080/solr"}
> 59157081 [Thread-2] INFO  org.apache.solr.cloud.Overseer  – Update state
> numShards=3 message={
>  "operation":"state",
>  "core_node_name":"solr-shard-1:8080_solr_productindex",
>  "numShards":"3",
>  "shard":"shard1",
>  "roles":null,
>  "state":"down",
>  "shard_state":"active",
>  "core":"productindex",
>  "collection":"productindex",
>  "shard_range":null,
>  "node_name":"solr-shard-1:8080_solr",
>  "base_url":"http://solr-shard-1:8080/solr"}
> 59157092 [localhost-startStop-1-EventThread] INFO 
> org.apache.solr.common.cloud.ZkStateReader  – A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
> 
> 
> 
> 
> Here is a picture of my cloud after the reload: http://d.pr/i/vN1A
> 
> Here is the output when I try to do a search:
> 
> <response>
> <lst name="responseHeader">
> <int name="status">503</int>
> <int name="QTime">111</int>
> <lst name="params">
> <str name="q">*:*</str>
> </lst>
> </lst>
> <lst name="error">
> <str name="msg">no servers hosting shard:</str>
> <int name="code">503</int>
> </lst>
> </response>
> 
> 
> 
> Any help is greatly appreciated as I often have to tweak my configs on my
> production cloud.
> 
> 
> 
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Collections-API-Reload-killing-my-cloud-tp4067141.html
> Sent from the Solr - User mailing list archive at Nabble.com.