You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by yriveiro <ya...@gmail.com> on 2013/05/30 13:16:10 UTC
SPLITSHARD: time out error
Hi,
I have a time out error when I try to split a collection with 15M documents
The exception (solr version 4.3):
542468 [catalina-exec-27] INFO org.apache.solr.servlet.SolrDispatchFilter
– [admin] webapp=null path=/admin/collections
params={shard=00&action=SPLITSHARD&collection=ST-0112_replicated} status=500
QTime=300028
542469 [catalina-exec-27] ERROR org.apache.solr.servlet.SolrDispatchFilter
– null:org.apache.solr.common.SolrException: splitshard the collection time
out:300s
at
org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:166)
at
org.apache.solr.handler.admin.CollectionsHandler.handleSplitShardAction(CollectionsHandler.java:300)
at
org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:136)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at
org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:608)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:215)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:155)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:947)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1009)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
582557 [catalina-exec-39] INFO org.apache.solr.update.SolrIndexSplitter –
SolrIndexSplitter: partition #1
582561 [catalina-exec-39] INFO org.apache.solr.core.SolrCore –
SolrDeletionPolicy.onInit: commits:num=1
commit{dir=/disk2/node00.solrcloud/solr/home/0112_replicated_00_1_replica1/data/index,segFN=segments_1,generation=1,filenames=[segments_1]
582563 [catalina-exec-39] INFO org.apache.solr.core.SolrCore – newest
commit = 1[segments_1]
How I can split my collection without this error?
-----
Best regards
--
View this message in context: http://lucene.472066.n3.nabble.com/SPLITSHARD-time-out-error-tp4066991.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: SPLITSHARD: time out error
Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
Shard splitting is buggy in 4.3. I recommend that you wait for the next
release (4.3.1) before using this feature.
That being said, the split is executed by the Overseer and will continue to
happen even after the http request times out. There aren't enough hooks to
monitor the progress of the operation. You can look at ZooKeeper
clusterstate to see if the sub shards are up and running. In your case, the
sub shards will be called "00_0" and "00_1" and should be in active state
(both "shardState" and "state" attribute in zk should be "active").
On Thu, May 30, 2013 at 4:46 PM, yriveiro <ya...@gmail.com> wrote:
> Hi,
>
> I have a time out error when I try to split a collection with 15M documents
>
> The exception (solr version 4.3):
>
> 542468 [catalina-exec-27] INFO org.apache.solr.servlet.SolrDispatchFilter
> – [admin] webapp=null path=/admin/collections
> params={shard=00&action=SPLITSHARD&collection=ST-0112_replicated}
> status=500
> QTime=300028
> 542469 [catalina-exec-27] ERROR org.apache.solr.servlet.SolrDispatchFilter
> – null:org.apache.solr.common.SolrException: splitshard the collection time
> out:300s
> at
>
> org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:166)
> at
>
> org.apache.solr.handler.admin.CollectionsHandler.handleSplitShardAction(CollectionsHandler.java:300)
> at
>
> org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:136)
> at
>
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
> at
>
> org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:608)
> at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:215)
> at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:155)
> at
>
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
> at
>
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
> at
>
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
> at
>
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
> at
>
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
> at
>
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
> at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:947)
> at
>
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
> at
>
> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1009)
> at
>
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
> at
>
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
> Source)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
> at java.lang.Thread.run(Unknown Source)
>
> 582557 [catalina-exec-39] INFO org.apache.solr.update.SolrIndexSplitter –
> SolrIndexSplitter: partition #1
> 582561 [catalina-exec-39] INFO org.apache.solr.core.SolrCore –
> SolrDeletionPolicy.onInit: commits:num=1
>
>
> commit{dir=/disk2/node00.solrcloud/solr/home/0112_replicated_00_1_replica1/data/index,segFN=segments_1,generation=1,filenames=[segments_1]
> 582563 [catalina-exec-39] INFO org.apache.solr.core.SolrCore – newest
> commit = 1[segments_1]
>
> How I can split my collection without this error?
>
>
>
> -----
> Best regards
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/SPLITSHARD-time-out-error-tp4066991.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
--
Regards,
Shalin Shekhar Mangar.