You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by prakash chandrasekaran <pr...@live.com> on 2011/11/07 23:44:26 UTC

Replication fails in SolrCloud

hi all, i followed steps in link  http://wiki.apache.org/solr/SolrCloud#Example_C:_Two_shard_cluster_with_shard_replicas_and_zookeeper_ensemble and created "Two shard cluster with shard replicas and zookeeper ensemble", and then for Solr Replication i followed steps in link http://wiki.apache.org/solr/SolrReplication .. 
now after server start, when slave tries to pull data from master .. i m seeing below error messages .. 
org.apache.solr.common.SolrException logSEVERE: org.apache.solr.common.cloud.ZooKeeperException: ZkSolrResourceLoader does not support getConfigDir() - likely, what you are trying to do is not supported in ZooKeeper mode	at org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceLoader.java:99)	at org.apache.solr.handler.ReplicationHandler.getConfFileInfoFromCache(ReplicationHandler.java:378)	at org.apache.solr.handler.ReplicationHandler.getFileList(ReplicationHandler.java:364)
i have few questions regarding this 1) Does Solr Cloud supports Replication ??2) or do we need to follow different steps to achieve Replication in Solr Cloud ?? 

Thanks,prakash

> From: prakashchandrasekaran@live.com
> To: solr-user@lucene.apache.org
> Subject: Zookeeper aware Replication in SolrCloud
> Date: Fri, 4 Nov 2011 03:36:27 +0000
> 
> 
> 
> hi,
> i m using SolrCloud and i wanted to add Replication feature to it .. 
> i followed the steps in Solr Wiki .. but when the client tried to poll for data from server i got below Error Message ..
> in Master LogNov 3, 2011 8:34:00 PM 
> 
> in Slave logNov 3, 2011 8:34:00 PM org.apache.solr.handler.ReplicationHandler doFetchSEVERE: SnapPull failed org.apache.solr.common.SolrException: Request failed for the url org.apache.commons.httpclient.methods.PostMethod@18eabf6	at org.apache.solr.handler.SnapPuller.getNamedListResponse(SnapPuller.java:197)	at org.apache.solr.handler.SnapPuller.fetchFileList(SnapPuller.java:219)	at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:281)	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:284)
> but i could see the slave pointing to correct master from link : http://localhost:7574/solr/replication?command=details
> i m also seeing these values in replication details link .. (http://localhost:7574/solr/replication?command=details)
> <arr name="indexReplicatedAtList"><str>Thu Nov 03 20:28:00 PDT 2011</str><str>Thu Nov 03 20:27:00 PDT 2011</str><str>Thu Nov 03 20:26:00 PDT 2011</str><str>Thu Nov 03 20:25:00 PDT 2011</str></arr> <arr name="replicationFailedAtList"> <str>Thu Nov 03 20:28:00 PDT 2011</str> <str>Thu Nov 03 20:27:00 PDT 2011</str> <str>Thu Nov 03 20:26:00 PDT 2011</str> <str>Thu Nov 03 20:25:00 PDT 2011</str></arr>
> 
> 
> Thanks,Prakash 		 	   		  
 		 	   		  

Re: Replication fails in SolrCloud

Posted by yayati <ya...@gmail.com>.
we have put other  configuration files  in conf directory now also have
with zookeeper  in addition to solrconfig and schema..
>
> Does solr 3.6 search component works for solrcloud?







>
> On Friday, November 30, 2012, Mark Miller-3 [via Lucene] <
ml-node+s472066n4023486h66@n3.nabble.com> wrote:
>>
>> On Nov 30, 2012, at 11:01 AM, yayati <[hidden email]> wrote:
>>
>>> We have created some custom search component, where this error occur in
>>> inform method at line
>>> .getResourceLoader().getConfigDir()));
>>
>> Does your custom component try and get the config dir? What for?
>>
>> - Mark
>>
>>
>> ________________________________
>> If you reply to this email, your message will be added to the discussion
below:
>>
http://lucene.472066.n3.nabble.com/Zookeeper-aware-Replication-in-SolrCloud-tp3479497p4023486.html
>> To unsubscribe from Zookeeper aware Replication in SolrCloud, click here.
>> NAML

-- 
Yayati Rajpal




--
View this message in context: http://lucene.472066.n3.nabble.com/Zookeeper-aware-Replication-in-SolrCloud-tp3479497p4023646.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Replication fails in SolrCloud

Posted by Mark Miller <ma...@gmail.com>.
On Nov 30, 2012, at 11:01 AM, yayati <ya...@gmail.com> wrote:

> We have created some custom search component, where this error occur in
> inform method at line
> .getResourceLoader().getConfigDir()));

Does your custom component try and get the config dir? What for?

- Mark

Re: Replication fails in SolrCloud

Posted by yayati <ya...@gmail.com>.
Hi Mark,

Please find detail stacktrace :


2012-11-30 19:32:58,260 [pool-2-thread-1] ERROR
apache.solr.core.CoreContainer - null:org.apache.solr.common.SolrException:
ZkSolrResourceLoader does not support getConfigDir() - likely, what you are
trying to do is not supported in ZooKeeper mode
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:721)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:566)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:850)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:534)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:356)
        at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:308)
        at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:107)
        at
org.apache.catalina.core.ApplicationFilterConfig.initFilter(ApplicationFilterConfig.java:277)
        at
org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:258)
        at
org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:382)
        at
org.apache.catalina.core.ApplicationFilterConfig.<init>(ApplicationFilterConfig.java:103)
        at
org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:4638)
        at
org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5294)
        at
org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
        at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:895)
        at
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:871)
        at
org.apache.catalina.core.StandardHost.addChild(StandardHost.java:615)
        at
org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:962)
        at
org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1603)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
ZkSolrResourceLoader does not support getConfigDir() - likely, what you are
trying to do is not supported in ZooKeeper mode
        at
org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceLoader.java:100)
        
We have created some custom search component, where this error occur in
inform method at line
.getResourceLoader().getConfigDir()));


For set up i did following steps.

1. Add version field in schema.xml
2. In seperate zookeeper server, upload configuration of solr. 
3. Add following parameter in tomcat startup
       -Dsolr.solr.home=/home/live/solr  -DhostContext=solr
-DzkClientTimeout=20000 -DzkHost=172.23.xx.xx:2181

4. solr.xml contains:

<?xml version="1.0" encoding="UTF-8" ?>
<solr persistent="false" sharedLib="/home/live/lib">
  <cores shareSchema="true" adminPath="/admin/cores" 
zkClientTimeout="${zkClientTimeout:}"
                    hostContext="${hostContext:}">
              
                
                <core name="ns01" instanceDir="." />
                <core name="ns02" instanceDir="." />
                <core name="ns03" instanceDir="."/>

Let me know if you need more details.








--
View this message in context: http://lucene.472066.n3.nabble.com/Zookeeper-aware-Replication-in-SolrCloud-tp3479497p4023484.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Replication fails in SolrCloud

Posted by Mark Miller <ma...@gmail.com>.
Need more information about your setup and config.

Longer stack traces would be helpful as well.

- Mark

On Nov 30, 2012, at 12:35 AM, yayati <ya...@gmail.com> wrote:

> Hi All,
> 
> I also got similar error while moving my solr 3.6 based application on solr
> cloud. While setting solrcloud i got this error :
> SolrCore Initialization Failures
> 
>    ns01:
> org.apache.solr.common.SolrException:org.apache.solr.common.SolrException:
> ZkSolrResourceLoader does not support getConfigDir() - likely, what you are
> trying to do is not supported in ZooKeeper mode
>    ns02:
> org.apache.solr.common.SolrException:org.apache.solr.common.SolrException:
> ZkSolrResourceLoader does not support getConfigDir() - likely, what you are
> trying to do is not supported in ZooKeeper mode 
> 
> 
> 
> 
> 
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Zookeeper-aware-Replication-in-SolrCloud-tp3479497p4023398.html
> Sent from the Solr - User mailing list archive at Nabble.com.


Re: Replication fails in SolrCloud

Posted by yayati <ya...@gmail.com>.
Hi All,

I also got similar error while moving my solr 3.6 based application on solr
cloud. While setting solrcloud i got this error :
SolrCore Initialization Failures

    ns01:
org.apache.solr.common.SolrException:org.apache.solr.common.SolrException:
ZkSolrResourceLoader does not support getConfigDir() - likely, what you are
trying to do is not supported in ZooKeeper mode
    ns02:
org.apache.solr.common.SolrException:org.apache.solr.common.SolrException:
ZkSolrResourceLoader does not support getConfigDir() - likely, what you are
trying to do is not supported in ZooKeeper mode 





--
View this message in context: http://lucene.472066.n3.nabble.com/Zookeeper-aware-Replication-in-SolrCloud-tp3479497p4023398.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Replication fails in SolrCloud

Posted by Pulkit Singhal <pu...@gmail.com>.
@Prakash: Can your please format the body a bit for readability?

@Solr-Users: Is anybody else having any problems when running Zookeeper
from the latest code in the trunk(4.x)?

On Mon, Nov 7, 2011 at 4:44 PM, prakash chandrasekaran <
prakashchandrasekaran@live.com> wrote:

>
> hi all, i followed steps in link
> http://wiki.apache.org/solr/SolrCloud#Example_C:_Two_shard_cluster_with_shard_replicas_and_zookeeper_ensembleand created "Two shard cluster with shard replicas and zookeeper ensemble",
> and then for Solr Replication i followed steps in link
> http://wiki.apache.org/solr/SolrReplication ..
> now after server start, when slave tries to pull data from master .. i m
> seeing below error messages ..
> org.apache.solr.common.SolrException logSEVERE:
> org.apache.solr.common.cloud.ZooKeeperException: ZkSolrResourceLoader does
> not support getConfigDir() - likely, what you are trying to do is not
> supported in ZooKeeper mode    at
> org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceLoader.java:99)
>        at
> org.apache.solr.handler.ReplicationHandler.getConfFileInfoFromCache(ReplicationHandler.java:378)
>     at
> org.apache.solr.handler.ReplicationHandler.getFileList(ReplicationHandler.java:364)
> i have few questions regarding this 1) Does Solr Cloud supports
> Replication ??2) or do we need to follow different steps to achieve
> Replication in Solr Cloud ??
>
> Thanks,prakash
>
> > From: prakashchandrasekaran@live.com
> > To: solr-user@lucene.apache.org
> > Subject: Zookeeper aware Replication in SolrCloud
> > Date: Fri, 4 Nov 2011 03:36:27 +0000
> >
> >
> >
> > hi,
> > i m using SolrCloud and i wanted to add Replication feature to it ..
> > i followed the steps in Solr Wiki .. but when the client tried to poll
> for data from server i got below Error Message ..
> > in Master LogNov 3, 2011 8:34:00 PM
> >
> > in Slave logNov 3, 2011 8:34:00 PM
> org.apache.solr.handler.ReplicationHandler doFetchSEVERE: SnapPull failed
> org.apache.solr.common.SolrException: Request failed for the url
> org.apache.commons.httpclient.methods.PostMethod@18eabf6        at
> org.apache.solr.handler.SnapPuller.getNamedListResponse(SnapPuller.java:197)
> at org.apache.solr.handler.SnapPuller.fetchFileList(SnapPuller.java:219)
>      at
> org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:281)
>   at
> org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:284)
> > but i could see the slave pointing to correct master from link :
> http://localhost:7574/solr/replication?command=details
> > i m also seeing these values in replication details link .. (
> http://localhost:7574/solr/replication?command=details)
> > <arr name="indexReplicatedAtList"><str>Thu Nov 03 20:28:00 PDT
> 2011</str><str>Thu Nov 03 20:27:00 PDT 2011</str><str>Thu Nov 03 20:26:00
> PDT 2011</str><str>Thu Nov 03 20:25:00 PDT 2011</str></arr> <arr
> name="replicationFailedAtList"> <str>Thu Nov 03 20:28:00 PDT 2011</str>
> <str>Thu Nov 03 20:27:00 PDT 2011</str> <str>Thu Nov 03 20:26:00 PDT
> 2011</str> <str>Thu Nov 03 20:25:00 PDT 2011</str></arr>
> >
> >
> > Thanks,Prakash
>