You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Arkadi Colson <ar...@smartbit.be> on 2013/05/22 08:59:34 UTC

shard splitting

Hi


I tried to split a shard but it failed. If I try to do it again it does 
not start again.
I see the to extra shards in /collections/messages/leader_elect/ and 
/collections/messages/leaders/
How can I fix this?


root@solr07-dcg:/solr/messages_shard3_replica2# curl 
'http://localhost:8983/solr/admin/collections?action=SPLITSHARD&collection=messages&shard=shard3'
<?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">500</int><int 
name="QTime">300117</int></lst><lst name="error"><str 
name="msg">splitshard the collection time out:300s</str><str 
name="trace">org.apache.solr.common.SolrException: splitshard the 
collection time out:300s
     at 
org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:166)
     at 
org.apache.solr.handler.admin.CollectionsHandler.handleSplitShardAction(CollectionsHandler.java:300)
     at 
org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:136)
     at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
     at 
org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:608)
     at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:215)
     at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:155)
     at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
     at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
     at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
     at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
     at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
     at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
     at 
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
     at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
     at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
     at 
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1008)
     at 
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
     at 
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
     at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
     at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
     at java.lang.Thread.run(Thread.java:722)
</str><int name="code">500</int></lst>
</response>

INFO  - 2013-05-22 06:45:54.148; 
org.apache.solr.handler.admin.CoreAdminHandler; Invoked split action for 
core: messages_shard3_replica1
INFO  - 2013-05-22 06:45:54.271; 
org.apache.solr.update.SolrIndexSplitter; SolrIndexSplitter: 
partitions=2 segments=29
INFO  - 2013-05-22 06:46:03.240; 
org.apache.solr.update.SolrIndexSplitter; SolrIndexSplitter: partition 
#0 range=2aaa0000-5554ffff


BR
Arkadi

Re: shard splitting

Posted by Yago Riveiro <ya...@gmail.com>.
You will need to edit it manually and upload using a zookeeper client, you can use kazoo, it's very easy to use. 

-- 
Yago Riveiro
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)


On Wednesday, May 22, 2013 at 10:04 AM, Arkadi Colson wrote:

> clusterstate.json is now reporting shard3 as inactive. Any idea how to 
> change clusterstate.json manually from commandline?
> 
> On 05/22/2013 08:59 AM, Arkadi Colson wrote:
> > Hi
> > 
> > 
> > I tried to split a shard but it failed. If I try to do it again it 
> > does not start again.
> > I see the to extra shards in /collections/messages/leader_elect/ and 
> > /collections/messages/leaders/
> > How can I fix this?
> > 
> > 
> > root@solr07-dcg:/solr/messages_shard3_replica2# curl 
> > 'http://localhost:8983/solr/admin/collections?action=SPLITSHARD&collection=messages&shard=shard3'
> > <?xml version="1.0" encoding="UTF-8"?>
> > <response>
> > <lst name="responseHeader"><int name="status">500</int><int 
> > name="QTime">300117</int></lst><lst name="error"><str 
> > name="msg">splitshard the collection time out:300s</str><str 
> > name="trace">org.apache.solr.common.SolrException: splitshard the 
> > collection time out:300s
> > at 
> > org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:166)
> > at 
> > org.apache.solr.handler.admin.CollectionsHandler.handleSplitShardAction(CollectionsHandler.java:300)
> > at 
> > org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:136)
> > at 
> > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
> > at 
> > org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:608)
> > at 
> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:215)
> > at 
> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:155)
> > at 
> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
> > at 
> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
> > at 
> > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
> > at 
> > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
> > at 
> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
> > at 
> > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
> > at 
> > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
> > at 
> > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
> > at 
> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
> > at 
> > org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1008)
> > at 
> > org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
> > at 
> > org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
> > at 
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at 
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:722)
> > </str><int name="code">500</int></lst>
> > </response>
> > 
> > INFO - 2013-05-22 06:45:54.148; 
> > org.apache.solr.handler.admin.CoreAdminHandler; Invoked split action 
> > for core: messages_shard3_replica1
> > INFO - 2013-05-22 06:45:54.271; 
> > org.apache.solr.update.SolrIndexSplitter; SolrIndexSplitter: 
> > partitions=2 segments=29
> > INFO - 2013-05-22 06:46:03.240; 
> > org.apache.solr.update.SolrIndexSplitter; SolrIndexSplitter: partition 
> > #0 range=2aaa0000-5554ffff
> > 
> > 
> > BR
> > Arkadi
> > 
> 
> 
> 



Re: shard splitting

Posted by Arkadi Colson <ar...@smartbit.be>.
clusterstate.json is now reporting shard3 as inactive. Any idea how to 
change clusterstate.json manually from commandline?

On 05/22/2013 08:59 AM, Arkadi Colson wrote:
> Hi
>
>
> I tried to split a shard but it failed. If I try to do it again it 
> does not start again.
> I see the to extra shards in /collections/messages/leader_elect/ and 
> /collections/messages/leaders/
> How can I fix this?
>
>
> root@solr07-dcg:/solr/messages_shard3_replica2# curl 
> 'http://localhost:8983/solr/admin/collections?action=SPLITSHARD&collection=messages&shard=shard3'
> <?xml version="1.0" encoding="UTF-8"?>
> <response>
> <lst name="responseHeader"><int name="status">500</int><int 
> name="QTime">300117</int></lst><lst name="error"><str 
> name="msg">splitshard the collection time out:300s</str><str 
> name="trace">org.apache.solr.common.SolrException: splitshard the 
> collection time out:300s
>     at 
> org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:166)
>     at 
> org.apache.solr.handler.admin.CollectionsHandler.handleSplitShardAction(CollectionsHandler.java:300)
>     at 
> org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:136)
>     at 
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
>     at 
> org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:608)
>     at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:215)
>     at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:155)
>     at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
>     at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>     at 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
>     at 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
>     at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
>     at 
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
>     at 
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
>     at 
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
>     at 
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
>     at 
> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1008)
>     at 
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
>     at 
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
>     at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>     at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>     at java.lang.Thread.run(Thread.java:722)
> </str><int name="code">500</int></lst>
> </response>
>
> INFO  - 2013-05-22 06:45:54.148; 
> org.apache.solr.handler.admin.CoreAdminHandler; Invoked split action 
> for core: messages_shard3_replica1
> INFO  - 2013-05-22 06:45:54.271; 
> org.apache.solr.update.SolrIndexSplitter; SolrIndexSplitter: 
> partitions=2 segments=29
> INFO  - 2013-05-22 06:46:03.240; 
> org.apache.solr.update.SolrIndexSplitter; SolrIndexSplitter: partition 
> #0 range=2aaa0000-5554ffff
>
>
> BR
> Arkadi
>
>


Re: solr starting time takes too long

Posted by Erick Erickson <er...@gmail.com>.
Right, the Wiki is a bit out of date. What's going to happen (I hope)
is that SOLR-4779 will allow you to share the complete configuration,
schema and solrconfig rather than try to share them individually. This
is consistent with the SolrCloud way of having named config sets.

Essentially, you'll point a core at a "conf" directory (which will
probably be located in <solrhome>/configs/conf1,
<solrhome>/config/conf2 etc) and multiple cores can point to the same
conf directory. Then both schema and solrconfig (and stopwords and all
the rest of the stuff in the conf dir) will be shared amongst all
cores that specify the same dir.

At least that's the plan..

Thanks for this feedback btw, it's good to have some field evidence of
where the time is actually spent.

Best
Erick

On Thu, May 30, 2013 at 6:24 PM, Zhang, Lisheng
<Li...@broadvision.com> wrote:
> Hi Eric,
>
> Thanks very much for helps (I should have responded sooner):
>
> 1/ My problem in 3.6 turned out to be much related to the fact I did not share schema,
>    after using shareSchema, the start time is reduced up to 80% (to my great surprise,
>    previously I thought burden is most in solrconfig).
>
> 2/ I just upgraded to solr 4.3, but somehow I did not see all the fixes mentioned in
>    the WIKI (like shareConfig), I saw the resolution is "Won't fix", do you have plan
>    to put the fix into next release?
>
> Thanks and best regards, Lisheng
>
> -----Original Message-----
> From: Erick Erickson [mailto:erickerickson@gmail.com]
> Sent: Wednesday, May 22, 2013 4:57 AM
> To: solr-user@lucene.apache.org
> Subject: Re: solr starting time takes too long
>
>
> Zhang:
>
> In 3.6, there's really no choice except to load all the cores on
> startup. 10 minutes still seems excessive, do you perhaps have a
> heavy-weight firstSearcher query?
>
> Yes, soft commits are 4.x only, so that's not your problem.
>
> There's a shareSchema option that tries to only load 1 copy of the
> schema that should help, but that doesn't help with loading
> solrconfig.xml.
>
> Also in the 4.3+ world there's the option to lazily-load cores, see:
> http://wiki.apache.org/solr/LotsOfCores for the overview. Perhaps not
> an option, but I thought I'd mention it.
>
> But I'm afraid you're stuck. You might be able to run bigger hardware
> (perhaps you're memory-starved). Other than that, you may need to use
> more than one machine to get fast enough startup times.
>
> Best,
> Erick
>
> On Wed, May 22, 2013 at 3:27 AM, Zhang, Lisheng
> <Li...@broadvision.com> wrote:
>> Thanks very much for quick helps! I searched but it seems that
>> autoSoftCommit is solr 4x feature and we are still using 3.6.1?
>>
>> Best regards, Lisheng
>>
>> -----Original Message-----
>> From: Carlos Bonilla [mailto:carlosbonilla84@gmail.com]
>> Sent: Wednesday, May 22, 2013 12:17 AM
>> To: solr-user@lucene.apache.org
>> Subject: Re: solr starting time takes too long
>>
>>
>> Hi Lisheng,
>> I had the same problem when I enabled the "autoSoftCommit" in
>> solrconfig.xml. If you have it enabled, disabling it could fix your problem,
>>
>> Cheers.
>> Carlos.
>>
>>
>> 2013/5/22 Zhang, Lisheng <Li...@broadvision.com>
>>
>>>
>>> Hi,
>>>
>>> We are using solr 3.6.1, our application has many cores (more than 1K),
>>> the problem is that solr starting took a long time (>10m). Examing log
>>> file and code we found that for each core we loaded many resources, but
>>> in our app, we are sure we are always using the same solrconfig.xml and
>>> schema.xml for all cores. While we can config schema.xml to be shared,
>>> we cannot share SolrConfig object. But looking inside SolrConfig code,
>>> we donot use any of the cache.
>>>
>>> Could we somehow change config (or source code) to share resource between
>>> cores to reduce solr starting time?
>>>
>>> Thanks very much for helps, Lisheng
>>>

RE: solr starting time takes too long

Posted by "Zhang, Lisheng" <Li...@BroadVision.com>.
Hi Eric,

Thanks very much for helps (I should have responded sooner):

1/ My problem in 3.6 turned out to be much related to the fact I did not share schema,
   after using shareSchema, the start time is reduced up to 80% (to my great surprise,
   previously I thought burden is most in solrconfig).
   
2/ I just upgraded to solr 4.3, but somehow I did not see all the fixes mentioned in
   the WIKI (like shareConfig), I saw the resolution is "Won't fix", do you have plan
   to put the fix into next release?

Thanks and best regards, Lisheng

-----Original Message-----
From: Erick Erickson [mailto:erickerickson@gmail.com]
Sent: Wednesday, May 22, 2013 4:57 AM
To: solr-user@lucene.apache.org
Subject: Re: solr starting time takes too long


Zhang:

In 3.6, there's really no choice except to load all the cores on
startup. 10 minutes still seems excessive, do you perhaps have a
heavy-weight firstSearcher query?

Yes, soft commits are 4.x only, so that's not your problem.

There's a shareSchema option that tries to only load 1 copy of the
schema that should help, but that doesn't help with loading
solrconfig.xml.

Also in the 4.3+ world there's the option to lazily-load cores, see:
http://wiki.apache.org/solr/LotsOfCores for the overview. Perhaps not
an option, but I thought I'd mention it.

But I'm afraid you're stuck. You might be able to run bigger hardware
(perhaps you're memory-starved). Other than that, you may need to use
more than one machine to get fast enough startup times.

Best,
Erick

On Wed, May 22, 2013 at 3:27 AM, Zhang, Lisheng
<Li...@broadvision.com> wrote:
> Thanks very much for quick helps! I searched but it seems that
> autoSoftCommit is solr 4x feature and we are still using 3.6.1?
>
> Best regards, Lisheng
>
> -----Original Message-----
> From: Carlos Bonilla [mailto:carlosbonilla84@gmail.com]
> Sent: Wednesday, May 22, 2013 12:17 AM
> To: solr-user@lucene.apache.org
> Subject: Re: solr starting time takes too long
>
>
> Hi Lisheng,
> I had the same problem when I enabled the "autoSoftCommit" in
> solrconfig.xml. If you have it enabled, disabling it could fix your problem,
>
> Cheers.
> Carlos.
>
>
> 2013/5/22 Zhang, Lisheng <Li...@broadvision.com>
>
>>
>> Hi,
>>
>> We are using solr 3.6.1, our application has many cores (more than 1K),
>> the problem is that solr starting took a long time (>10m). Examing log
>> file and code we found that for each core we loaded many resources, but
>> in our app, we are sure we are always using the same solrconfig.xml and
>> schema.xml for all cores. While we can config schema.xml to be shared,
>> we cannot share SolrConfig object. But looking inside SolrConfig code,
>> we donot use any of the cache.
>>
>> Could we somehow change config (or source code) to share resource between
>> cores to reduce solr starting time?
>>
>> Thanks very much for helps, Lisheng
>>

Re: solr starting time takes too long

Posted by Erick Erickson <er...@gmail.com>.
Zhang:

In 3.6, there's really no choice except to load all the cores on
startup. 10 minutes still seems excessive, do you perhaps have a
heavy-weight firstSearcher query?

Yes, soft commits are 4.x only, so that's not your problem.

There's a shareSchema option that tries to only load 1 copy of the
schema that should help, but that doesn't help with loading
solrconfig.xml.

Also in the 4.3+ world there's the option to lazily-load cores, see:
http://wiki.apache.org/solr/LotsOfCores for the overview. Perhaps not
an option, but I thought I'd mention it.

But I'm afraid you're stuck. You might be able to run bigger hardware
(perhaps you're memory-starved). Other than that, you may need to use
more than one machine to get fast enough startup times.

Best,
Erick

On Wed, May 22, 2013 at 3:27 AM, Zhang, Lisheng
<Li...@broadvision.com> wrote:
> Thanks very much for quick helps! I searched but it seems that
> autoSoftCommit is solr 4x feature and we are still using 3.6.1?
>
> Best regards, Lisheng
>
> -----Original Message-----
> From: Carlos Bonilla [mailto:carlosbonilla84@gmail.com]
> Sent: Wednesday, May 22, 2013 12:17 AM
> To: solr-user@lucene.apache.org
> Subject: Re: solr starting time takes too long
>
>
> Hi Lisheng,
> I had the same problem when I enabled the "autoSoftCommit" in
> solrconfig.xml. If you have it enabled, disabling it could fix your problem,
>
> Cheers.
> Carlos.
>
>
> 2013/5/22 Zhang, Lisheng <Li...@broadvision.com>
>
>>
>> Hi,
>>
>> We are using solr 3.6.1, our application has many cores (more than 1K),
>> the problem is that solr starting took a long time (>10m). Examing log
>> file and code we found that for each core we loaded many resources, but
>> in our app, we are sure we are always using the same solrconfig.xml and
>> schema.xml for all cores. While we can config schema.xml to be shared,
>> we cannot share SolrConfig object. But looking inside SolrConfig code,
>> we donot use any of the cache.
>>
>> Could we somehow change config (or source code) to share resource between
>> cores to reduce solr starting time?
>>
>> Thanks very much for helps, Lisheng
>>

RE: solr starting time takes too long

Posted by "Zhang, Lisheng" <Li...@BroadVision.com>.
Thanks very much for quick helps! I searched but it seems that
autoSoftCommit is solr 4x feature and we are still using 3.6.1?

Best regards, Lisheng

-----Original Message-----
From: Carlos Bonilla [mailto:carlosbonilla84@gmail.com]
Sent: Wednesday, May 22, 2013 12:17 AM
To: solr-user@lucene.apache.org
Subject: Re: solr starting time takes too long


Hi Lisheng,
I had the same problem when I enabled the "autoSoftCommit" in
solrconfig.xml. If you have it enabled, disabling it could fix your problem,

Cheers.
Carlos.


2013/5/22 Zhang, Lisheng <Li...@broadvision.com>

>
> Hi,
>
> We are using solr 3.6.1, our application has many cores (more than 1K),
> the problem is that solr starting took a long time (>10m). Examing log
> file and code we found that for each core we loaded many resources, but
> in our app, we are sure we are always using the same solrconfig.xml and
> schema.xml for all cores. While we can config schema.xml to be shared,
> we cannot share SolrConfig object. But looking inside SolrConfig code,
> we donot use any of the cache.
>
> Could we somehow change config (or source code) to share resource between
> cores to reduce solr starting time?
>
> Thanks very much for helps, Lisheng
>

Re: solr starting time takes too long

Posted by Carlos Bonilla <ca...@gmail.com>.
Hi Lisheng,
I had the same problem when I enabled the "autoSoftCommit" in
solrconfig.xml. If you have it enabled, disabling it could fix your problem,

Cheers.
Carlos.


2013/5/22 Zhang, Lisheng <Li...@broadvision.com>

>
> Hi,
>
> We are using solr 3.6.1, our application has many cores (more than 1K),
> the problem is that solr starting took a long time (>10m). Examing log
> file and code we found that for each core we loaded many resources, but
> in our app, we are sure we are always using the same solrconfig.xml and
> schema.xml for all cores. While we can config schema.xml to be shared,
> we cannot share SolrConfig object. But looking inside SolrConfig code,
> we donot use any of the cache.
>
> Could we somehow change config (or source code) to share resource between
> cores to reduce solr starting time?
>
> Thanks very much for helps, Lisheng
>

RE: solr starting time takes too long

Posted by "Zhang, Lisheng" <Li...@BroadVision.com>.
Very sorry about hijacking existing thread (I thought it would be OK
if I just change the title and content, but still wrong).

It will never happen again.

Lisheng

-----Original Message-----
From: Chris Hostetter [mailto:hossman_lucene@fucit.org]
Sent: Wednesday, May 22, 2013 11:58 AM
To: solr-user@lucene.apache.org
Subject: Re: solr starting time takes too long



: Subject: solr starting time takes too long
: In-Reply-To: <51...@smartbit.be>
: Thread-Topic: shard splitting

https://people.apache.org/~hossman/#threadhijack


-Hoss

Re: solr starting time takes too long

Posted by Chris Hostetter <ho...@fucit.org>.
: Subject: solr starting time takes too long
: In-Reply-To: <51...@smartbit.be>
: Thread-Topic: shard splitting

https://people.apache.org/~hossman/#threadhijack


-Hoss

solr starting time takes too long

Posted by "Zhang, Lisheng" <Li...@BroadVision.com>.
Hi,

We are using solr 3.6.1, our application has many cores (more than 1K),
the problem is that solr starting took a long time (>10m). Examing log 
file and code we found that for each core we loaded many resources, but 
in our app, we are sure we are always using the same solrconfig.xml and
schema.xml for all cores. While we can config schema.xml to be shared, 
we cannot share SolrConfig object. But looking inside SolrConfig code, 
we donot use any of the cache. 

Could we somehow change config (or source code) to share resource between
cores to reduce solr starting time?

Thanks very much for helps, Lisheng