You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by mahesh16d <m....@gmail.com> on 2018/12/13 13:04:19 UTC

Error waiting for SolrCore to be created

Thanks in advance.

We have Apache Solr version 6.4.1 installed and configured on Red Hat
Enterprise Linux Server release 7.5 and Java is 1.8.0_181.  Command to start
solr is bin/solr start -c -m 15g

It was working till yesterday. We had to reboot server hardware maintenance
activity and post reboot it stopped working. There was no software upgrade
done during this activity. 

I tried to run checkIndex but it failed to execute. 

On the solr front end I am getting "SolrCore Initialization Failures"
coreStore_shard1_replica1:
rg.apache.solr.common.SolrException:org.apache.solr.common.SolrException:
Error opening new searcher

Can someone please review and let me know how to recover the system?

Below is the error logs which I got from
/solr/solr-6.4.1/server/logs/solr.log file. 

---------
20YY-MM-DD 11:05:04.327 INFO  (main) [   ] o.e.j.s.Server
jetty-9.3.14.v20161028
20YY-MM-DD 11:05:04.707 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter  ___     
_       Welcome to Apache Solr™ version 6.4.1
20YY-MM-DD 11:05:04.707 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter / __|
___| |_ _   Starting in standalone mode on port 7788
20YY-MM-DD 11:05:04.707 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter \__ \/
_ \ | '_|  Install dir: /solr/solr-6.4.1
20YY-MM-DD 11:05:04.721 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter
|___/\___/_|_|    Start time: 20YY-MM-DDT11:05:04.708Z
20YY-MM-DD 11:05:04.721 INFO  (main) [   ] o.a.s.s.StartupLoggingUtils
Property solr.log.muteconsole given. Muting ConsoleAppender named CONSOLE
20YY-MM-DD 11:05:04.733 INFO  (main) [   ] o.a.s.c.SolrResourceLoader Using
system property solr.solr.home: /solr/solr-6.4.1/server/solr
20YY-MM-DD 11:05:04.738 INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading
container configuration from /solr/solr-6.4.1/server/solr/solr.xml
20YY-MM-DD 11:05:05.082 INFO  (main) [   ] o.a.s.u.UpdateShardHandler
Creating UpdateShardHandler HTTP client with params:
socketTimeout=600000&connTimeout=60000&retry=true
20YY-MM-DD 11:05:05.150 INFO  (main) [   ] o.a.s.c.CorePropertiesLocator
Found 1 core definitions underneath /solr/solr-6.4.1/server/solr
20YY-MM-DD 11:05:05.156 INFO  (main) [   ] o.a.s.c.CorePropertiesLocator
Cores are: [coreStore_shard1_replica1]
20YY-MM-DD 11:05:05.235 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.c.SolrResourceLoader
[coreStore_shard1_replica1] Added 51 libs to classloader, from paths:
[/solr/solr-6.4.1/contrib/clustering/lib,
/solr/solr-6.4.1/contrib/extraction/lib,
/solr/solr-6.4.1/contrib/langid/lib, /solr/solr-6.4.1/contrib/velocity/lib,
/solr/solr-6.4.1/dist]
20YY-MM-DD 11:05:05.252 INFO  (main) [   ] o.e.j.s.Server Started @1542ms
20YY-MM-DD 11:05:05.418 INFO  (qtp834133664-26) [   ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/info/logging
params={wt=json&_=1544698499929&since=0} status=0 QTime=41
20YY-MM-DD 11:05:05.423 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion:
6.4.1
20YY-MM-DD 11:05:05.437 INFO  (qtp834133664-32) [   ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/info/logging
params={wt=json&_=1544697223873&since=0} status=0 QTime=2
20YY-MM-DD 11:05:05.584 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.s.IndexSchema [coreStore_shard1_replica1]
Schema name=example-data-driven-schema
20YY-MM-DD 11:05:05.688 WARN  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.c.SolrResourceLoader Solr loaded a
deprecated plugin/analysis class [solr.SynonymFilterFactory]. Please consult
documentation how to replace it accordingly.
20YY-MM-DD 11:05:06.228 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.s.IndexSchema Loaded schema
example-data-driven-schema/1.6 with uniqueid field id
20YY-MM-DD 11:05:06.272 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore
'coreStore_shard1_replica1' using configuration from instancedir
/solr/solr-6.4.1/server/solr/coreStore_shard1_replica1
20YY-MM-DD 11:05:06.298 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.c.SolrCore [[coreStore_shard1_replica1] ]
Opening new SolrCore at
[/solr/solr-6.4.1/server/solr/coreStore_shard1_replica1],
dataDir=[/solr/solr-6.4.1/server/solr/coreStore_shard1_replica1/data/]
20YY-MM-DD 11:05:06.300 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@5939a379
20YY-MM-DD 11:05:06.365 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.r.XSLTResponseWriter
xsltCacheLifetimeSeconds=5
20YY-MM-DD 11:05:06.681 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog
implementation: org.apache.solr.update.UpdateLog
20YY-MM-DD 11:05:06.681 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog:
dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
numVersionBuckets=65536
20YY-MM-DD 11:05:06.707 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: if
uncommited for 15000ms;
20YY-MM-DD 11:05:06.707 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
20YY-MM-DD 11:05:06.751 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.c.SolrCore [coreStore_shard1_replica1] 
CLOSING SolrCore org.apache.solr.core.SolrCore@1de0b99a
20YY-MM-DD 11:05:06.761 INFO  (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.m.SolrMetricManager Closing metric
reporters for: solr.core.coreStore_shard1_replica1
20YY-MM-DD 11:05:06.762 ERROR (coreLoadExecutor-6-thread-1) [  
x:coreStore_shard1_replica1] o.a.s.c.CoreContainer Error creating core
[coreStore_shard1_replica1]: Error opening new searcher
org.apache.solr.common.SolrException: Error opening new searcher
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:959)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:823)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:890)
        at
org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:542)
        at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
        at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1898)
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2018)
        at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1048)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:932)
        ... 9 more
Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file
found in
LockValidatingDirectoryWrapper(MetricsDirectory(NRTCachingDirectory(MMapDirectory@/solr/solr-6.4.1/server/solr/coreStore_shard1_replica1/data/index
lockFactory=org.apache.lucene.store.NativeFSLockFactory@673d8b3;
maxCacheMB=48.0 maxMergeSizeMB=4.0))): files: [_107fc.cfe, _107fc.cfs,
_107fc.si, _107fc_14e.liv, _10eoq.cfe, _10eoq.cfs, _10eoq.si, _10eoq_5i.liv,
_10n5a.cfe, _10n5a.cfs, _10n5a.si, _116nn.cfe, _116nn.cfs, _116nn.si,
_116nn_7lw.liv, _121f5.cfe, _121f5.cfs, _121f5.si, _121f5_2wt.liv,
_1265m.cfe, _1265m.cfs, _1265m.si, _1265m_73.liv, _12fss.cfe, _12fss.cfs,
_12fss.si, _12fss_1bm.liv, _12xy4.cfe, _12xy4.cfs, _12xy4.si, _12xy4_vd.liv,
_12zqt.cfe, _12zqt.cfs, _12zqt.si, _1388z.cfe, _1388z.cfs, _1388z.si,
_1388z_1tf.liv, _13k0s.cfe, _13k0s.cfs, _13k0s.si, _13k0s_11l.liv,
_13nk5.cfe, _13nk5.cfs, _13nk5.si, _13nk5_32.liv, _13xhl.cfe, _13xhl.cfs,
_13xhl.si, _14inu.cfe, _14inu.cfs, _14inu.si, _14inu_xm.liv, _14tqs.cfe,
_14tqs.cfs, _14tqs.si, _14tqs_2x8.liv, _14xzd.cfe, _14xzd.cfs, _14xzd.si,
_14xzd_2q9.liv, _154j1.cfe, _154j1.cfs, _154j1.si, _154j1_mo.liv,
_15b8x.cfe, _15b8x.cfs, _15b8x.si, _15b8x_19g.liv, _15mb5.cfe, _15mb5.cfs,
_15mb5.si, _15mb5_1pu.liv, _15r6i.cfe, _15r6i.cfs, _15r6i.si, _15r6i_bc.liv,
_15vc7.cfe, _15vc7.cfs, _15vc7.si, _160hq.cfe, _160hq.cfs, _160hq.si,
_160hq_8o.liv, _1680z.cfe, _1680z.cfs, _1680z.si, _1680z_2bl.liv,
_16ghc.cfe, _16ghc.cfs, _16ghc.si, _16ghc_4fc.liv, _16shl.cfe, _16shl.cfs,
_16shl.si, _16shl_185.liv, _16sim.cfe, _16sim.cfs, _16sim.si,
_16sim_2pg.liv, _16zm8.cfe, _16zm8.cfs, _16zm8.si, _16zm8_in.liv,
_177tg.cfe, _177tg.cfs, _177tg.si, _177tg_1gk.liv, _179nr.cfe, _179nr.cfs,
_179nr.si, _179nr_12t.liv, _17e4a.cfe, _17e4a.cfs, _17e4a.si, _17e4a_ci.liv,
_17o1q.cfe, _17o1q.cfs, _17o1q.si, _17o1q_d6.liv, _17ww1.cfe, _17ww1.cfs,
_17ww1.si, _17ww1_kk.liv, _188pe.cfe, _188pe.cfs, _188pe.si, _188pe_1xp.liv,
_18hal.cfe, _18hal.cfs, _18hal.si, _18hal_9t.liv, _18kh9.cfe, _18kh9.cfs,
_18kh9.si, _18kh9_1ih.liv, _18nuv.cfe, _18nuv.cfs, _18nuv.si,
_18nuv_11j.liv, _18s3x.cfe, _18s3x.cfs, _18s3x.si, _18s3x_345.liv,
_193go.cfe, _193go.cfs, _193go.si, _193go_1tl.liv, _19d4i.cfe, _19d4i.cfs,
_19d4i.si, _19d4i_a9.liv, _19hjt.cfe, _19hjt.cfs, _19hjt.si, _19hjt_iy.liv,
_19ry5.cfe, _19ry5.cfs, _19ry5.si, _19ry5_51.liv, _1be8n.cfe, _1be8n.cfs,
_1be8n.si, _1be8n_1vc.liv, _1bkyw.cfe, _1bkyw.cfs, _1bkyw.si, _1bkyw_u.liv,
_1c6h3.cfe, _1c6h3.cfs, _1c6h3.si, _1c6h3_3yz.liv, _1cbb6.cfe, _1cbb6.cfs,
_1cbb6.si, _1cbb6_2kf.liv, _1djni.cfe, _1djni.cfs, _1djni.si, _1djni_u.liv,
_1e9e6.cfe, _1e9e6.cfs, _1e9e6.si, _1el7e.cfe, _1el7e.cfs, _1el7e.si,
_1el7e_od.liv, _1f95i.cfe, _1f95i.cfs, _1f95i.si, _1f95i_d7.liv, _1fe0w.cfe,
_1fe0w.cfs, _1fe0w.si, _1fe0w_xs.liv, _1flm8.cfe, _1flm8.cfs, _1flm8.si,
_1flm8_6yv.liv, _1fs1n.cfe, _1fs1n.cfs, _1fs1n.si, _1fs1n_1oo.liv,
_1g6uk.cfe, _1g6uk.cfs, _1g6uk.si, _1g6uk_2e2.liv, _1gl0u.cfe, _1gl0u.cfs,
_1gl0u.si, _1gl0u_1y.liv, _1gxud.cfe, _1gxud.cfs, _1gxud.si, _1gxud_42.liv,
_1h6d3.cfe, _1h6d3.cfs, _1h6d3.si, _1h6d3_3n.liv, _1hcvv.cfe, _1hcvv.cfs,
_1hcvv.si, _1hcvv_3q.liv, _1hlg0.cfe, _1hlg0.cfs, _1hlg0.si, _1hlg0_5ag.liv,
_1hr9f.cfe, _1hr9f.cfs, _1hr9f.si, _1hr9f_1.liv, _1hxmn.cfe, _1hxmn.cfs,
_1hxmn.si, _1i7vn.cfe, _1i7vn.cfs, _1i7vn.si, _1i7vn_4.liv, _1igsw.cfe,
_1igsw.cfs, _1igsw.si, _1igsw_24.liv, _1ir1f.cfe, _1ir1f.cfs, _1ir1f.si,
_1ir1f_3r.liv, _1j23p.cfe, _1j23p.cfs, _1j23p.si, _1j23p_21.liv, _1jk62.cfe,
_1jk62.cfs, _1jk62.si, _1jk62_hf.liv, _1jl1s.cfe, _1jl1s.cfs, _1jl1s.si,
_1jl1s_fe.liv, _1jubq.cfe, _1jubq.cfs, _1jubq.si, _1jubq_ja.liv, _1k128.cfe,
_1k128.cfs, _1k128.si, _1k128_1.liv, _1k86g.cfe, _1k86g.cfs, _1k86g.si,
_1kfcu.cfe, _1kfcu.cfs, _1kfcu.si, _1kmm0.cfe, _1kmm0.cfs, _1kmm0.si,
_1kuoy.cfe, _1kuoy.cfs, _1kuoy.si, _1kuoy_b.liv, _1lc48.cfe, _1lc48.cfs,
_1lc48.si, _1lc48_y1.liv, _1m2gq.cfe, _1m2gq.cfs, _1m2gq.si, _1m2gq_fw.liv,
_1m6t.fdt, _1m6t.fdx, _1m6t.fnm, _1m6t.nvd, _1m6t.nvm, _1m6t.si,
_1m6t_2jw.liv, _1m6t_Lucene50_0.doc, _1m6t_Lucene50_0.pos,
_1m6t_Lucene50_0.tim, _1m6t_Lucene50_0.tip, _1m6t_Lucene54_0.dvd,
_1m6t_Lucene54_0.dvm, _1mh9c.cfe, _1mh9c.cfs, _1mh9c.si, _1mh9c_3.liv,
_1myct.cfe, _1myct.cfs, _1myct.si, _1myct_66x.liv, _1n0yx.cfe, _1n0yx.cfs,
_1n0yx.si, _1n0yx_z7.liv, _1n4xd.cfe, _1n4xd.cfs, _1n4xd.si, _1n4xd_1.liv,
_1ndbf.cfe, _1ndbf.cfs, _1ndbf.si, _1nmuk.cfe, _1nmuk.cfs, _1nmuk.si,
_1nmuk_1.liv, _1nshx.cfe, _1nshx.cfs, _1nshx.si, _1nshx_8f.liv, _1o03s.cfe,
_1o03s.cfs, _1o03s.si, _1o03s_2.liv, _1o7nc.cfe, _1o7nc.cfs, _1o7nc.si,
_1ogof.cfe, _1ogof.cfs, _1ogof.si, _1otm6.cfe, _1otm6.cfs, _1otm6.si,
_1otm6_4.liv, _1p3qo.cfe, _1p3qo.cfs, _1p3qo.si, _1p3qo_w.liv, _1pbxe.cfe,
_1pbxe.cfs, _1pbxe.si, _1pbxe_4jm.liv, _1phf3.cfe, _1phf3.cfs, _1phf3.si,
_1phf3_1.liv, _1pnfv.cfe, _1pnfv.cfs, _1pnfv.si, _1pu1g.cfe, _1pu1g.cfs,
_1pu1g.si, _1pu1g_2.liv, _1q2zc.cfe, _1q2zc.cfs, _1q2zc.si, _1q2zc_12.liv,
_1q9pw.cfe, _1q9pw.cfs, _1q9pw.si, _1q9pw_1g.liv, _1qitq.cfe, _1qitq.cfs,
_1qitq.si, _1qitq_46.liv, _1r1xo.cfe, _1r1xo.cfs, _1r1xo.si, _1r8fl.cfe,
_1r8fl.cfs, _1r8fl.si, _1rh2q.cfe, _1rh2q.cfs, _1rh2q.si, _1rh2q_7p.liv,
_1rriw.cfe, _1rriw.cfs, _1rriw.si, _1rriw_8.liv, _1s4y3.cfe, _1s4y3.cfs,
_1s4y3.si, _1s4y3_ai.liv, _1sbmx.cfe, _1sbmx.cfs, _1sbmx.si, _1sbmx_u5.liv,
_1sec2.cfe, _1sec2.cfs, _1sec2.si, _1sec2_h7.liv, _1sn79.cfe, _1sn79.cfs,
_1sn79.si, _1sn79_1.liv, _1stb3.cfe, _1stb3.cfs, _1stb3.si, _1stb3_no.liv,
_1ta58.cfe, _1ta58.cfs, _1ta58.si, _1ta58_zb.liv, _1tk01.cfe, _1tk01.cfs,
_1tk01.si, _1tk01_ys.liv, _1tz3b.cfe, _1tz3b.cfs, _1tz3b.si, _1tz3b_1.liv,
_1u43y.cfe, _1u43y.cfs, _1u43y.si, _1u43y_1.liv, _1uc0d.cfe, _1uc0d.cfs,
_1uc0d.si, _1uc0d_2i.liv, _1um40.cfe, _1um40.cfs, _1um40.si, _1um40_37.liv,
_1usoh.cfe, _1usoh.cfs, _1usoh.si, _1usoh_q.liv, _1uzsk.cfe, _1uzsk.cfs,
_1uzsk.si, _1v8lz.cfe, _1v8lz.cfs, _1v8lz.si, _1vedc.cfe
20YY-MM-DD 11:05:06.765 ERROR (coreContainerWorkExecutor-2-thread-1) [   ]
o.a.s.c.CoreContainer Error waiting for SolrCore to be created
java.util.concurrent.ExecutionException:
org.apache.solr.common.SolrException: Unable to create core
[coreStore_shard1_replica1]
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at
org.apache.solr.core.CoreContainer.lambda$load$4(CoreContainer.java:570)
        at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.common.SolrException: Unable to create core
[coreStore_shard1_replica1]
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:903)
        at
org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:542)
        at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
        ... 5 more
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:959)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:823)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:890)
        ... 7 more
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
        at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1898)
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2018)
        at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1048)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:932)
        ... 9 more
at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:933)
        at
org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:135)
        at
org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:99)
        at
org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:240)
        at
org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:114)
        at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1859)
        ... 12 more
20YY-MM-DD 11:05:06.899 ERROR (Finalizer) [   ] o.a.s.u.SolrIndexWriter
SolrIndexWriter was not closed prior to finalize(), indicates a bug --
POSSIBLE RESOURCE LEAK!!!
20YY-MM-DD 11:05:06.900 ERROR (Finalizer) [   ] o.a.s.u.SolrIndexWriter
Error closing IndexWriter
java.lang.NullPointerException
        at
org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3402)
        at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3364)
        at
org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1130)
        at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1175)
        at
org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:295)
        at
org.apache.solr.update.SolrIndexWriter.finalize(SolrIndexWriter.java:351)
        at java.lang.System$2.invokeFinalize(System.java:1270)
        at java.lang.ref.Finalizer.runFinalizer(Finalizer.java:102)
        at java.lang.ref.Finalizer.access$100(Finalizer.java:34)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:217)
20YY-MM-DD 11:05:07.640 INFO  (qtp834133664-33) [   ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/info/logging
params={wt=json&_=1544698499929&since=0} status=0 QTime=3
20YY-MM-DD 11:05:09.017 INFO  (qtp834133664-43) [   ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/info/logging
params={wt=json&_=1544697223873&since=0} status=0 QTime=1
20YY-MM-DD 11:05:19.018 INFO  (qtp834133664-24) [   ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/info/logging
params={wt=json&_=1544697223873&since=0} status=0 QTime=1
20YY-MM-DD 11:05:20.814 INFO  (qtp834133664-44) [   ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={indexInfo=false&wt=json&_=1544699120682} status=0 QTime=1
20YY-MM-DD 11:05:20.842 INFO  (qtp834133664-32) [   ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/info/system params={wt=json&_=1544699120683}
status=0 QTime=23
20YY-MM-DD 11:05:20.870 INFO  (qtp834133664-43) [   ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/info/system params={wt=json&_=1544699120683}
status=0 QTime=21
20YY-MM-DD 11:05:21.077 INFO  (qtp834133664-32) [   ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={indexInfo=false&wt=json&_=1544699120965} status=0 QTime=0
---------



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Error waiting for SolrCore to be created

Posted by Erick Erickson <er...@gmail.com>.
So I don't know what to recommend except rebooting.
Solr (actually, Lucene)  would _not_ delete that file without
replacing it. There is a great deal of care taken to insure
that the index is consistent and I haven't heard of the
segments file disappearing by itself, some external process
is very likely responsible.

I'm afraid the only thing I can recommend just blowing the
data directory away (rm -rf
/solr/solr-6.4.1/server/solr/coreStore_shard1_replica1/data)
while Solr is shut down and re-indexing from scratch.

I suppose some of the Lucene folks might have magic for creating
a new segments* file, but frankly that'd be suspect given
the unknown state of the segments.

Sorry I can't be more help,
Erick
On Thu, Dec 13, 2018 at 11:42 AM mahesh16d <m....@gmail.com> wrote:
>
> @Erick Erickson
>
> Thanks for your feedback and support.
>
> segments* file is missing from
> /solr/solr-6.4.1/server/solr/coreStore_shard1_replica1/data/index directory.
>
> Erick: Is that directory the one you expect for that replica? This is a
> sanity check, as there's no reason it would change magically.
>
> Answer: I am not sure about this. I am very new to solr. index folder
> contains all my indexes or data on which we do search. After last reboot of
> server we encountered this error.
> coreStore_shard1_replica1 is the only folder we have and as far as I know we
> do not have another replica.
>
> Erick: How much extra room is there on the disk? Disk full situations might
> _possibly_ explain it, although that's doubtful.
>
> There is no issue with the free disk space on the partition, we still have
> few TB's of disk space available.
>
> Is there any other configuration which I can share here which will be
> helpful to fix the issue?
>
> Thank you for all your help.
> Mahesh
>
>
>
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Error waiting for SolrCore to be created

Posted by mahesh16d <m....@gmail.com>.
@Erick Erickson

Thanks for your feedback and support.

segments* file is missing from
/solr/solr-6.4.1/server/solr/coreStore_shard1_replica1/data/index directory.

Erick: Is that directory the one you expect for that replica? This is a
sanity check, as there's no reason it would change magically. 

Answer: I am not sure about this. I am very new to solr. index folder
contains all my indexes or data on which we do search. After last reboot of
server we encountered this error.
coreStore_shard1_replica1 is the only folder we have and as far as I know we
do not have another replica.

Erick: How much extra room is there on the disk? Disk full situations might
_possibly_ explain it, although that's doubtful. 

There is no issue with the free disk space on the partition, we still have
few TB's of disk space available.

Is there any other configuration which I can share here which will be
helpful to fix the issue?

Thank you for all your help.
Mahesh



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Error waiting for SolrCore to be created

Posted by Erick Erickson <er...@gmail.com>.
Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file
found in
LockValidatingDirectoryWrapper(MetricsDirectory(NRTCachingDirectory(MMapDirectory@/solr/solr-6.4.1/server/solr/coreStore_shard1_replica1/data/index

segments* is what's used to indicate what segments are available in
the index, so not having one is fatal. First thing I'd do is look in
the directory indicated and see if there really isn't a segments*
file. Also check that the permissions didn't somehow change.

Checkindex relies on that file too so...

I don't know of any  good way to recreate this file, maybe one of the
Lucene folks could chime in.

Is that directory the one you  expect for that replica? This is a
sanity check, as there's no reason it would change magically.

If you have another healthy replica for that shard, you can
DELETEREPLICA/ADDREPLICA for the sick one as a way to get the replica
back, that'll pull the index from the leader. Doesn't explain how
segments* disappeared though.

How much extra room is there on the disk? Disk full situations  might
_possibly_ explain it, although that's doubtful.

Best,
Erick
On Thu, Dec 13, 2018 at 6:35 AM mahesh16d <m....@gmail.com> wrote:
>
> Thanks in advance.
>
> We have Apache Solr version 6.4.1 installed and configured on Red Hat
> Enterprise Linux Server release 7.5 and Java is 1.8.0_181.  Command to start
> solr is bin/solr start -c -m 15g
>
> It was working till yesterday. We had to reboot server hardware maintenance
> activity and post reboot it stopped working. There was no software upgrade
> done during this activity.
>
> I tried to run checkIndex but it failed to execute.
>
> On the solr front end I am getting "SolrCore Initialization Failures"
> coreStore_shard1_replica1:
> rg.apache.solr.common.SolrException:org.apache.solr.common.SolrException:
> Error opening new searcher
>
> Can someone please review and let me know how to recover the system?
>
> Below is the error logs which I got from
> /solr/solr-6.4.1/server/logs/solr.log file.
>
> ---------
> 20YY-MM-DD 11:05:04.327 INFO  (main) [   ] o.e.j.s.Server
> jetty-9.3.14.v20161028
> 20YY-MM-DD 11:05:04.707 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter  ___
> _       Welcome to Apache Solr™ version 6.4.1
> 20YY-MM-DD 11:05:04.707 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter / __|
> ___| |_ _   Starting in standalone mode on port 7788
> 20YY-MM-DD 11:05:04.707 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter \__ \/
> _ \ | '_|  Install dir: /solr/solr-6.4.1
> 20YY-MM-DD 11:05:04.721 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter
> |___/\___/_|_|    Start time: 20YY-MM-DDT11:05:04.708Z
> 20YY-MM-DD 11:05:04.721 INFO  (main) [   ] o.a.s.s.StartupLoggingUtils
> Property solr.log.muteconsole given. Muting ConsoleAppender named CONSOLE
> 20YY-MM-DD 11:05:04.733 INFO  (main) [   ] o.a.s.c.SolrResourceLoader Using
> system property solr.solr.home: /solr/solr-6.4.1/server/solr
> 20YY-MM-DD 11:05:04.738 INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading
> container configuration from /solr/solr-6.4.1/server/solr/solr.xml
> 20YY-MM-DD 11:05:05.082 INFO  (main) [   ] o.a.s.u.UpdateShardHandler
> Creating UpdateShardHandler HTTP client with params:
> socketTimeout=600000&connTimeout=60000&retry=true
> 20YY-MM-DD 11:05:05.150 INFO  (main) [   ] o.a.s.c.CorePropertiesLocator
> Found 1 core definitions underneath /solr/solr-6.4.1/server/solr
> 20YY-MM-DD 11:05:05.156 INFO  (main) [   ] o.a.s.c.CorePropertiesLocator
> Cores are: [coreStore_shard1_replica1]
> 20YY-MM-DD 11:05:05.235 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.c.SolrResourceLoader
> [coreStore_shard1_replica1] Added 51 libs to classloader, from paths:
> [/solr/solr-6.4.1/contrib/clustering/lib,
> /solr/solr-6.4.1/contrib/extraction/lib,
> /solr/solr-6.4.1/contrib/langid/lib, /solr/solr-6.4.1/contrib/velocity/lib,
> /solr/solr-6.4.1/dist]
> 20YY-MM-DD 11:05:05.252 INFO  (main) [   ] o.e.j.s.Server Started @1542ms
> 20YY-MM-DD 11:05:05.418 INFO  (qtp834133664-26) [   ] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/info/logging
> params={wt=json&_=1544698499929&since=0} status=0 QTime=41
> 20YY-MM-DD 11:05:05.423 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion:
> 6.4.1
> 20YY-MM-DD 11:05:05.437 INFO  (qtp834133664-32) [   ] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/info/logging
> params={wt=json&_=1544697223873&since=0} status=0 QTime=2
> 20YY-MM-DD 11:05:05.584 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.s.IndexSchema [coreStore_shard1_replica1]
> Schema name=example-data-driven-schema
> 20YY-MM-DD 11:05:05.688 WARN  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.c.SolrResourceLoader Solr loaded a
> deprecated plugin/analysis class [solr.SynonymFilterFactory]. Please consult
> documentation how to replace it accordingly.
> 20YY-MM-DD 11:05:06.228 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.s.IndexSchema Loaded schema
> example-data-driven-schema/1.6 with uniqueid field id
> 20YY-MM-DD 11:05:06.272 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore
> 'coreStore_shard1_replica1' using configuration from instancedir
> /solr/solr-6.4.1/server/solr/coreStore_shard1_replica1
> 20YY-MM-DD 11:05:06.298 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.c.SolrCore [[coreStore_shard1_replica1] ]
> Opening new SolrCore at
> [/solr/solr-6.4.1/server/solr/coreStore_shard1_replica1],
> dataDir=[/solr/solr-6.4.1/server/solr/coreStore_shard1_replica1/data/]
> 20YY-MM-DD 11:05:06.300 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is
> enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@5939a379
> 20YY-MM-DD 11:05:06.365 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.r.XSLTResponseWriter
> xsltCacheLifetimeSeconds=5
> 20YY-MM-DD 11:05:06.681 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog
> implementation: org.apache.solr.update.UpdateLog
> 20YY-MM-DD 11:05:06.681 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog:
> dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
> numVersionBuckets=65536
> 20YY-MM-DD 11:05:06.707 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: if
> uncommited for 15000ms;
> 20YY-MM-DD 11:05:06.707 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
> 20YY-MM-DD 11:05:06.751 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.c.SolrCore [coreStore_shard1_replica1]
> CLOSING SolrCore org.apache.solr.core.SolrCore@1de0b99a
> 20YY-MM-DD 11:05:06.761 INFO  (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.m.SolrMetricManager Closing metric
> reporters for: solr.core.coreStore_shard1_replica1
> 20YY-MM-DD 11:05:06.762 ERROR (coreLoadExecutor-6-thread-1) [
> x:coreStore_shard1_replica1] o.a.s.c.CoreContainer Error creating core
> [coreStore_shard1_replica1]: Error opening new searcher
> org.apache.solr.common.SolrException: Error opening new searcher
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:959)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:823)
>         at org.apache.solr.core.CoreContainer.create(CoreContainer.java:890)
>         at
> org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:542)
>         at
> com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.solr.common.SolrException: Error opening new searcher
>         at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1898)
>         at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2018)
>         at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1048)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:932)
>         ... 9 more
> Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file
> found in
> LockValidatingDirectoryWrapper(MetricsDirectory(NRTCachingDirectory(MMapDirectory@/solr/solr-6.4.1/server/solr/coreStore_shard1_replica1/data/index
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@673d8b3;
> maxCacheMB=48.0 maxMergeSizeMB=4.0))): files: [_107fc.cfe, _107fc.cfs,
> _107fc.si, _107fc_14e.liv, _10eoq.cfe, _10eoq.cfs, _10eoq.si, _10eoq_5i.liv,
> _10n5a.cfe, _10n5a.cfs, _10n5a.si, _116nn.cfe, _116nn.cfs, _116nn.si,
> _116nn_7lw.liv, _121f5.cfe, _121f5.cfs, _121f5.si, _121f5_2wt.liv,
> _1265m.cfe, _1265m.cfs, _1265m.si, _1265m_73.liv, _12fss.cfe, _12fss.cfs,
> _12fss.si, _12fss_1bm.liv, _12xy4.cfe, _12xy4.cfs, _12xy4.si, _12xy4_vd.liv,
> _12zqt.cfe, _12zqt.cfs, _12zqt.si, _1388z.cfe, _1388z.cfs, _1388z.si,
> _1388z_1tf.liv, _13k0s.cfe, _13k0s.cfs, _13k0s.si, _13k0s_11l.liv,
> _13nk5.cfe, _13nk5.cfs, _13nk5.si, _13nk5_32.liv, _13xhl.cfe, _13xhl.cfs,
> _13xhl.si, _14inu.cfe, _14inu.cfs, _14inu.si, _14inu_xm.liv, _14tqs.cfe,
> _14tqs.cfs, _14tqs.si, _14tqs_2x8.liv, _14xzd.cfe, _14xzd.cfs, _14xzd.si,
> _14xzd_2q9.liv, _154j1.cfe, _154j1.cfs, _154j1.si, _154j1_mo.liv,
> _15b8x.cfe, _15b8x.cfs, _15b8x.si, _15b8x_19g.liv, _15mb5.cfe, _15mb5.cfs,
> _15mb5.si, _15mb5_1pu.liv, _15r6i.cfe, _15r6i.cfs, _15r6i.si, _15r6i_bc.liv,
> _15vc7.cfe, _15vc7.cfs, _15vc7.si, _160hq.cfe, _160hq.cfs, _160hq.si,
> _160hq_8o.liv, _1680z.cfe, _1680z.cfs, _1680z.si, _1680z_2bl.liv,
> _16ghc.cfe, _16ghc.cfs, _16ghc.si, _16ghc_4fc.liv, _16shl.cfe, _16shl.cfs,
> _16shl.si, _16shl_185.liv, _16sim.cfe, _16sim.cfs, _16sim.si,
> _16sim_2pg.liv, _16zm8.cfe, _16zm8.cfs, _16zm8.si, _16zm8_in.liv,
> _177tg.cfe, _177tg.cfs, _177tg.si, _177tg_1gk.liv, _179nr.cfe, _179nr.cfs,
> _179nr.si, _179nr_12t.liv, _17e4a.cfe, _17e4a.cfs, _17e4a.si, _17e4a_ci.liv,
> _17o1q.cfe, _17o1q.cfs, _17o1q.si, _17o1q_d6.liv, _17ww1.cfe, _17ww1.cfs,
> _17ww1.si, _17ww1_kk.liv, _188pe.cfe, _188pe.cfs, _188pe.si, _188pe_1xp.liv,
> _18hal.cfe, _18hal.cfs, _18hal.si, _18hal_9t.liv, _18kh9.cfe, _18kh9.cfs,
> _18kh9.si, _18kh9_1ih.liv, _18nuv.cfe, _18nuv.cfs, _18nuv.si,
> _18nuv_11j.liv, _18s3x.cfe, _18s3x.cfs, _18s3x.si, _18s3x_345.liv,
> _193go.cfe, _193go.cfs, _193go.si, _193go_1tl.liv, _19d4i.cfe, _19d4i.cfs,
> _19d4i.si, _19d4i_a9.liv, _19hjt.cfe, _19hjt.cfs, _19hjt.si, _19hjt_iy.liv,
> _19ry5.cfe, _19ry5.cfs, _19ry5.si, _19ry5_51.liv, _1be8n.cfe, _1be8n.cfs,
> _1be8n.si, _1be8n_1vc.liv, _1bkyw.cfe, _1bkyw.cfs, _1bkyw.si, _1bkyw_u.liv,
> _1c6h3.cfe, _1c6h3.cfs, _1c6h3.si, _1c6h3_3yz.liv, _1cbb6.cfe, _1cbb6.cfs,
> _1cbb6.si, _1cbb6_2kf.liv, _1djni.cfe, _1djni.cfs, _1djni.si, _1djni_u.liv,
> _1e9e6.cfe, _1e9e6.cfs, _1e9e6.si, _1el7e.cfe, _1el7e.cfs, _1el7e.si,
> _1el7e_od.liv, _1f95i.cfe, _1f95i.cfs, _1f95i.si, _1f95i_d7.liv, _1fe0w.cfe,
> _1fe0w.cfs, _1fe0w.si, _1fe0w_xs.liv, _1flm8.cfe, _1flm8.cfs, _1flm8.si,
> _1flm8_6yv.liv, _1fs1n.cfe, _1fs1n.cfs, _1fs1n.si, _1fs1n_1oo.liv,
> _1g6uk.cfe, _1g6uk.cfs, _1g6uk.si, _1g6uk_2e2.liv, _1gl0u.cfe, _1gl0u.cfs,
> _1gl0u.si, _1gl0u_1y.liv, _1gxud.cfe, _1gxud.cfs, _1gxud.si, _1gxud_42.liv,
> _1h6d3.cfe, _1h6d3.cfs, _1h6d3.si, _1h6d3_3n.liv, _1hcvv.cfe, _1hcvv.cfs,
> _1hcvv.si, _1hcvv_3q.liv, _1hlg0.cfe, _1hlg0.cfs, _1hlg0.si, _1hlg0_5ag.liv,
> _1hr9f.cfe, _1hr9f.cfs, _1hr9f.si, _1hr9f_1.liv, _1hxmn.cfe, _1hxmn.cfs,
> _1hxmn.si, _1i7vn.cfe, _1i7vn.cfs, _1i7vn.si, _1i7vn_4.liv, _1igsw.cfe,
> _1igsw.cfs, _1igsw.si, _1igsw_24.liv, _1ir1f.cfe, _1ir1f.cfs, _1ir1f.si,
> _1ir1f_3r.liv, _1j23p.cfe, _1j23p.cfs, _1j23p.si, _1j23p_21.liv, _1jk62.cfe,
> _1jk62.cfs, _1jk62.si, _1jk62_hf.liv, _1jl1s.cfe, _1jl1s.cfs, _1jl1s.si,
> _1jl1s_fe.liv, _1jubq.cfe, _1jubq.cfs, _1jubq.si, _1jubq_ja.liv, _1k128.cfe,
> _1k128.cfs, _1k128.si, _1k128_1.liv, _1k86g.cfe, _1k86g.cfs, _1k86g.si,
> _1kfcu.cfe, _1kfcu.cfs, _1kfcu.si, _1kmm0.cfe, _1kmm0.cfs, _1kmm0.si,
> _1kuoy.cfe, _1kuoy.cfs, _1kuoy.si, _1kuoy_b.liv, _1lc48.cfe, _1lc48.cfs,
> _1lc48.si, _1lc48_y1.liv, _1m2gq.cfe, _1m2gq.cfs, _1m2gq.si, _1m2gq_fw.liv,
> _1m6t.fdt, _1m6t.fdx, _1m6t.fnm, _1m6t.nvd, _1m6t.nvm, _1m6t.si,
> _1m6t_2jw.liv, _1m6t_Lucene50_0.doc, _1m6t_Lucene50_0.pos,
> _1m6t_Lucene50_0.tim, _1m6t_Lucene50_0.tip, _1m6t_Lucene54_0.dvd,
> _1m6t_Lucene54_0.dvm, _1mh9c.cfe, _1mh9c.cfs, _1mh9c.si, _1mh9c_3.liv,
> _1myct.cfe, _1myct.cfs, _1myct.si, _1myct_66x.liv, _1n0yx.cfe, _1n0yx.cfs,
> _1n0yx.si, _1n0yx_z7.liv, _1n4xd.cfe, _1n4xd.cfs, _1n4xd.si, _1n4xd_1.liv,
> _1ndbf.cfe, _1ndbf.cfs, _1ndbf.si, _1nmuk.cfe, _1nmuk.cfs, _1nmuk.si,
> _1nmuk_1.liv, _1nshx.cfe, _1nshx.cfs, _1nshx.si, _1nshx_8f.liv, _1o03s.cfe,
> _1o03s.cfs, _1o03s.si, _1o03s_2.liv, _1o7nc.cfe, _1o7nc.cfs, _1o7nc.si,
> _1ogof.cfe, _1ogof.cfs, _1ogof.si, _1otm6.cfe, _1otm6.cfs, _1otm6.si,
> _1otm6_4.liv, _1p3qo.cfe, _1p3qo.cfs, _1p3qo.si, _1p3qo_w.liv, _1pbxe.cfe,
> _1pbxe.cfs, _1pbxe.si, _1pbxe_4jm.liv, _1phf3.cfe, _1phf3.cfs, _1phf3.si,
> _1phf3_1.liv, _1pnfv.cfe, _1pnfv.cfs, _1pnfv.si, _1pu1g.cfe, _1pu1g.cfs,
> _1pu1g.si, _1pu1g_2.liv, _1q2zc.cfe, _1q2zc.cfs, _1q2zc.si, _1q2zc_12.liv,
> _1q9pw.cfe, _1q9pw.cfs, _1q9pw.si, _1q9pw_1g.liv, _1qitq.cfe, _1qitq.cfs,
> _1qitq.si, _1qitq_46.liv, _1r1xo.cfe, _1r1xo.cfs, _1r1xo.si, _1r8fl.cfe,
> _1r8fl.cfs, _1r8fl.si, _1rh2q.cfe, _1rh2q.cfs, _1rh2q.si, _1rh2q_7p.liv,
> _1rriw.cfe, _1rriw.cfs, _1rriw.si, _1rriw_8.liv, _1s4y3.cfe, _1s4y3.cfs,
> _1s4y3.si, _1s4y3_ai.liv, _1sbmx.cfe, _1sbmx.cfs, _1sbmx.si, _1sbmx_u5.liv,
> _1sec2.cfe, _1sec2.cfs, _1sec2.si, _1sec2_h7.liv, _1sn79.cfe, _1sn79.cfs,
> _1sn79.si, _1sn79_1.liv, _1stb3.cfe, _1stb3.cfs, _1stb3.si, _1stb3_no.liv,
> _1ta58.cfe, _1ta58.cfs, _1ta58.si, _1ta58_zb.liv, _1tk01.cfe, _1tk01.cfs,
> _1tk01.si, _1tk01_ys.liv, _1tz3b.cfe, _1tz3b.cfs, _1tz3b.si, _1tz3b_1.liv,
> _1u43y.cfe, _1u43y.cfs, _1u43y.si, _1u43y_1.liv, _1uc0d.cfe, _1uc0d.cfs,
> _1uc0d.si, _1uc0d_2i.liv, _1um40.cfe, _1um40.cfs, _1um40.si, _1um40_37.liv,
> _1usoh.cfe, _1usoh.cfs, _1usoh.si, _1usoh_q.liv, _1uzsk.cfe, _1uzsk.cfs,
> _1uzsk.si, _1v8lz.cfe, _1v8lz.cfs, _1v8lz.si, _1vedc.cfe
> 20YY-MM-DD 11:05:06.765 ERROR (coreContainerWorkExecutor-2-thread-1) [   ]
> o.a.s.c.CoreContainer Error waiting for SolrCore to be created
> java.util.concurrent.ExecutionException:
> org.apache.solr.common.SolrException: Unable to create core
> [coreStore_shard1_replica1]
>         at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>         at java.util.concurrent.FutureTask.get(FutureTask.java:192)
>         at
> org.apache.solr.core.CoreContainer.lambda$load$4(CoreContainer.java:570)
>         at
> com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
>         at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.solr.common.SolrException: Unable to create core
> [coreStore_shard1_replica1]
>         at org.apache.solr.core.CoreContainer.create(CoreContainer.java:903)
>         at
> org.apache.solr.core.CoreContainer.lambda$load$3(CoreContainer.java:542)
>         at
> com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
>         ... 5 more
> Caused by: org.apache.solr.common.SolrException: Error opening new searcher
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:959)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:823)
>         at org.apache.solr.core.CoreContainer.create(CoreContainer.java:890)
>         ... 7 more
> Caused by: org.apache.solr.common.SolrException: Error opening new searcher
>         at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1898)
>         at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2018)
>         at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1048)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:932)
>         ... 9 more
> at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:933)
>         at
> org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:135)
>         at
> org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:99)
>         at
> org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:240)
>         at
> org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:114)
>         at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1859)
>         ... 12 more
> 20YY-MM-DD 11:05:06.899 ERROR (Finalizer) [   ] o.a.s.u.SolrIndexWriter
> SolrIndexWriter was not closed prior to finalize(), indicates a bug --
> POSSIBLE RESOURCE LEAK!!!
> 20YY-MM-DD 11:05:06.900 ERROR (Finalizer) [   ] o.a.s.u.SolrIndexWriter
> Error closing IndexWriter
> java.lang.NullPointerException
>         at
> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3402)
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3364)
>         at
> org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1130)
>         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1175)
>         at
> org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:295)
>         at
> org.apache.solr.update.SolrIndexWriter.finalize(SolrIndexWriter.java:351)
>         at java.lang.System$2.invokeFinalize(System.java:1270)
>         at java.lang.ref.Finalizer.runFinalizer(Finalizer.java:102)
>         at java.lang.ref.Finalizer.access$100(Finalizer.java:34)
>         at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:217)
> 20YY-MM-DD 11:05:07.640 INFO  (qtp834133664-33) [   ] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/info/logging
> params={wt=json&_=1544698499929&since=0} status=0 QTime=3
> 20YY-MM-DD 11:05:09.017 INFO  (qtp834133664-43) [   ] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/info/logging
> params={wt=json&_=1544697223873&since=0} status=0 QTime=1
> 20YY-MM-DD 11:05:19.018 INFO  (qtp834133664-24) [   ] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/info/logging
> params={wt=json&_=1544697223873&since=0} status=0 QTime=1
> 20YY-MM-DD 11:05:20.814 INFO  (qtp834133664-44) [   ] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/cores
> params={indexInfo=false&wt=json&_=1544699120682} status=0 QTime=1
> 20YY-MM-DD 11:05:20.842 INFO  (qtp834133664-32) [   ] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/info/system params={wt=json&_=1544699120683}
> status=0 QTime=23
> 20YY-MM-DD 11:05:20.870 INFO  (qtp834133664-43) [   ] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/info/system params={wt=json&_=1544699120683}
> status=0 QTime=21
> 20YY-MM-DD 11:05:21.077 INFO  (qtp834133664-32) [   ] o.a.s.s.HttpSolrCall
> [admin] webapp=null path=/admin/cores
> params={indexInfo=false&wt=json&_=1544699120965} status=0 QTime=0
> ---------
>
>
>
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html