You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Andrej van der Zee <an...@gmail.com> on 2015/12/16 13:24:55 UTC
Solr cloud instance does not read cores from Zookeeper whilst connected
Hi,
I have setup Zookeer and uploaded a collection config. But somehow it seems
that Solr keeps reading core definitions locally ("Looking for core
definitions underneath /opt/solr/server/solr") instead of getting it from
Zookeep. Below the logs.
Probably some kind of config thingy, unfortunately I cannot get from the
documentation what is missing.
In the Solr GUI I can see the Cloud tree on Zookeeper. But I can see this
WARN in the GUI:
12/16/2015, 1:22:45 PMWARNnullZookeeperInfoServletState for collection
connects not found in /clusterstate.json or
/collections/connects/state.json!
Is that related?
Thanks,
Andrej
Starting Solr in SolrCloud mode on port 8983 from /opt/solr/server
0 INFO (main) [ ] o.e.j.u.log Logging initialized @269ms
265 INFO (main) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
278 WARN (main) [ ] o.e.j.s.h.RequestLogHandler !RequestLog
279 INFO (main) [ ] o.e.j.d.p.ScanningAppProvider Deployment monitor
[file:/opt/solr/server/contexts/] at interval 0
586 INFO (main) [ ] o.e.j.w.StandardDescriptorProcessor NO JSP Support
for /solr, did not find org.apache.jasper.servlet.JspServlet
595 WARN (main) [ ] o.e.j.s.SecurityHandler
ServletContext@o.e.j.w.WebAppContext@57fffcd7{/solr,file:/opt/solr/server/solr-webapp/webapp/,STARTING}{/opt/solr/server/solr-webapp/webapp}
has uncovered http methods for path: /
599 INFO (main) [ ] o.a.s.s.SolrDispatchFilter
SolrDispatchFilter.init(): WebAppClassLoader=1926764753@72d818d1
609 INFO (main) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for
solr (NoInitialContextEx)
609 INFO (main) [ ] o.a.s.c.SolrResourceLoader using system property
solr.solr.home: /opt/solr/server/solr
610 INFO (main) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader
for directory: '/opt/solr/server/solr/'
719 WARN (main) [ ] o.a.s.s.SolrDispatchFilter Solr property
solr.solrxml.location is no longer supported. Will automatically load
solr.xml from ZooKeeper if it exists
725 INFO (main) [ ] o.a.s.c.c.SolrZkClient Using default
ZkCredentialsProvider
744 INFO (main) [ ] o.a.s.c.c.ConnectionManager Waiting for client to
connect to ZooKeeper
800 INFO (zkCallback-1-thread-1) [ ] o.a.s.c.c.ConnectionManager
Watcher org.apache.solr.common.cloud.ConnectionManager@e250cde
name:ZooKeeperConnection Watcher:172.31.11.65:2181 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
800 INFO (main) [ ] o.a.s.c.c.ConnectionManager Client is connected to
ZooKeeper
800 INFO (main) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
805 INFO (main) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from
SolrHome (not found in ZooKeeper)
807 INFO (main) [ ] o.a.s.c.SolrXmlConfig Loading container
configuration from /opt/solr/server/solr/solr.xml
852 INFO (main) [ ] o.a.s.c.CoresLocator Config-defined core root
directory: /opt/solr/server/solr
867 INFO (main) [ ] o.a.s.c.CoreContainer New CoreContainer 510063093
867 INFO (main) [ ] o.a.s.c.CoreContainer Loading cores into
CoreContainer [instanceDir=/opt/solr/server/solr/]
867 INFO (main) [ ] o.a.s.c.CoreContainer loading shared library:
/opt/solr/server/solr/lib
868 WARN (main) [ ] o.a.s.c.SolrResourceLoader No files added to
classloader from lib: lib (resolved as: /opt/solr/server/solr/lib).
879 INFO (main) [ ] o.a.s.h.c.HttpShardHandlerFactory created with
socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost :
20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize :
2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy :
false,useRetries : false,
1009 INFO (main) [ ] o.a.s.u.UpdateShardHandler Creating
UpdateShardHandler HTTP client with params:
socketTimeout=600000&connTimeout=60000&retry=true
1010 INFO (main) [ ] o.a.s.l.LogWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
1011 INFO (main) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j
(org.slf4j.impl.Log4jLoggerFactory)]
1012 INFO (main) [ ] o.a.s.c.ZkContainer Zookeeper client=
172.31.11.65:2181
1027 INFO (main) [ ] o.a.s.c.c.ConnectionManager Waiting for client to
connect to ZooKeeper
1031 INFO (zkCallback-3-thread-1-processing-n:172.31.11.63:8983_solr) [
] o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@1de3d8b2
name:ZooKeeperConnection Watcher:172.31.11.65:2181 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
1031 INFO (main) [ ] o.a.s.c.c.ConnectionManager Client is connected to
ZooKeeper
1058 INFO (main) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from
ZooKeeper...
2085 INFO (main) [ ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/172.31.11.63:8983_solr
2089 INFO (main) [ ] o.a.s.c.ZkController Found a previous node that
still exists while trying to register a new live node
/live_nodes/172.31.11.63:8983_solr - removing existing node to create
another.
2089 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath:
/live_nodes/172.31.11.63:8983_solr
2097 INFO (main) [ ] o.a.s.c.Overseer Overseer (id=null) closing
2099 INFO (main) [ ] o.a.s.c.LeaderElector Joined leadership election
with path:
/overseer_elect/election/95044078474494001-172.31.11.63:8983_solr-n_0000000025
2100 INFO (main) [ ] o.a.s.c.LeaderElector was going to be leader
/overseer_elect/election/95044078474494001-172.31.11.63:8983_solr-n_0000000025
, seq(0)
/overseer_elect/election/95044078474493999-172.31.11.63:8983_solr-n_0000000024
2153 INFO (main) [ ] o.a.s.c.CoreContainer Security conf doesn't exist.
Skipping setup for authorization module.
2153 INFO (main) [ ] o.a.s.c.CoreContainer No authentication plugin used.
2198 INFO (main) [ ] o.a.s.c.CoresLocator Looking for core definitions
underneath /opt/solr/server/solr
2201 INFO (main) [ ] o.a.s.c.CoresLocator Found 0 core definitions
2203 INFO (main) [ ] o.a.s.s.SolrDispatchFilter user.dir=/opt/solr/server
2203 INFO (main) [ ] o.a.s.s.SolrDispatchFilter
SolrDispatchFilter.init() done
2211 INFO (main) [ ] o.e.j.s.h.ContextHandler Started
o.e.j.w.WebAppContext@57fffcd7
{/solr,file:/opt/solr/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr/server/solr-webapp/webapp}
2215 INFO (main) [ ] o.e.j.s.ServerConnector Started
ServerConnector@433defed{HTTP/1.1}{0.0.0.0:8983}
2215 INFO (main) [ ] o.e.j.s.Server Started @2486ms
Re: Solr cloud instance does not read cores from Zookeeper whilst connected
Posted by Erick Erickson <er...@gmail.com>.
At a random guess, how are you starting Zookeeper and Solr?
Is it possible that you're running the Zookeeper embedded in Solr
but have an external Zookeeper running also? In that scenario
you might be seeing one Zookeeper in the admin UI and another
when trying to create the collection.
Could you cut/paste the _exact_ commands you use to start Solr and
create the collection?
Best,
Erick
On Wed, Dec 16, 2015 at 4:24 AM, Andrej van der Zee
<an...@gmail.com> wrote:
> Hi,
>
> I have setup Zookeer and uploaded a collection config. But somehow it seems
> that Solr keeps reading core definitions locally ("Looking for core
> definitions underneath /opt/solr/server/solr") instead of getting it from
> Zookeep. Below the logs.
>
> Probably some kind of config thingy, unfortunately I cannot get from the
> documentation what is missing.
>
> In the Solr GUI I can see the Cloud tree on Zookeeper. But I can see this
> WARN in the GUI:
> 12/16/2015, 1:22:45 PMWARNnullZookeeperInfoServletState for collection
> connects not found in /clusterstate.json or
> /collections/connects/state.json!
>
> Is that related?
>
> Thanks,
> Andrej
>
>
>
> Starting Solr in SolrCloud mode on port 8983 from /opt/solr/server
>
> 0 INFO (main) [ ] o.e.j.u.log Logging initialized @269ms
> 265 INFO (main) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
> 278 WARN (main) [ ] o.e.j.s.h.RequestLogHandler !RequestLog
> 279 INFO (main) [ ] o.e.j.d.p.ScanningAppProvider Deployment monitor
> [file:/opt/solr/server/contexts/] at interval 0
> 586 INFO (main) [ ] o.e.j.w.StandardDescriptorProcessor NO JSP Support
> for /solr, did not find org.apache.jasper.servlet.JspServlet
> 595 WARN (main) [ ] o.e.j.s.SecurityHandler
> ServletContext@o.e.j.w.WebAppContext@57fffcd7{/solr,file:/opt/solr/server/solr-webapp/webapp/,STARTING}{/opt/solr/server/solr-webapp/webapp}
> has uncovered http methods for path: /
> 599 INFO (main) [ ] o.a.s.s.SolrDispatchFilter
> SolrDispatchFilter.init(): WebAppClassLoader=1926764753@72d818d1
> 609 INFO (main) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for
> solr (NoInitialContextEx)
> 609 INFO (main) [ ] o.a.s.c.SolrResourceLoader using system property
> solr.solr.home: /opt/solr/server/solr
> 610 INFO (main) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader
> for directory: '/opt/solr/server/solr/'
> 719 WARN (main) [ ] o.a.s.s.SolrDispatchFilter Solr property
> solr.solrxml.location is no longer supported. Will automatically load
> solr.xml from ZooKeeper if it exists
> 725 INFO (main) [ ] o.a.s.c.c.SolrZkClient Using default
> ZkCredentialsProvider
> 744 INFO (main) [ ] o.a.s.c.c.ConnectionManager Waiting for client to
> connect to ZooKeeper
> 800 INFO (zkCallback-1-thread-1) [ ] o.a.s.c.c.ConnectionManager
> Watcher org.apache.solr.common.cloud.ConnectionManager@e250cde
> name:ZooKeeperConnection Watcher:172.31.11.65:2181 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
> 800 INFO (main) [ ] o.a.s.c.c.ConnectionManager Client is connected to
> ZooKeeper
> 800 INFO (main) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
> 805 INFO (main) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from
> SolrHome (not found in ZooKeeper)
> 807 INFO (main) [ ] o.a.s.c.SolrXmlConfig Loading container
> configuration from /opt/solr/server/solr/solr.xml
> 852 INFO (main) [ ] o.a.s.c.CoresLocator Config-defined core root
> directory: /opt/solr/server/solr
> 867 INFO (main) [ ] o.a.s.c.CoreContainer New CoreContainer 510063093
> 867 INFO (main) [ ] o.a.s.c.CoreContainer Loading cores into
> CoreContainer [instanceDir=/opt/solr/server/solr/]
> 867 INFO (main) [ ] o.a.s.c.CoreContainer loading shared library:
> /opt/solr/server/solr/lib
> 868 WARN (main) [ ] o.a.s.c.SolrResourceLoader No files added to
> classloader from lib: lib (resolved as: /opt/solr/server/solr/lib).
> 879 INFO (main) [ ] o.a.s.h.c.HttpShardHandlerFactory created with
> socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost :
> 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize :
> 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy :
> false,useRetries : false,
> 1009 INFO (main) [ ] o.a.s.u.UpdateShardHandler Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=600000&connTimeout=60000&retry=true
> 1010 INFO (main) [ ] o.a.s.l.LogWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
> 1011 INFO (main) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j
> (org.slf4j.impl.Log4jLoggerFactory)]
> 1012 INFO (main) [ ] o.a.s.c.ZkContainer Zookeeper client=
> 172.31.11.65:2181
> 1027 INFO (main) [ ] o.a.s.c.c.ConnectionManager Waiting for client to
> connect to ZooKeeper
> 1031 INFO (zkCallback-3-thread-1-processing-n:172.31.11.63:8983_solr) [
> ] o.a.s.c.c.ConnectionManager Watcher
> org.apache.solr.common.cloud.ConnectionManager@1de3d8b2
> name:ZooKeeperConnection Watcher:172.31.11.65:2181 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
> 1031 INFO (main) [ ] o.a.s.c.c.ConnectionManager Client is connected to
> ZooKeeper
> 1058 INFO (main) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from
> ZooKeeper...
> 2085 INFO (main) [ ] o.a.s.c.ZkController Register node as live in
> ZooKeeper:/live_nodes/172.31.11.63:8983_solr
> 2089 INFO (main) [ ] o.a.s.c.ZkController Found a previous node that
> still exists while trying to register a new live node
> /live_nodes/172.31.11.63:8983_solr - removing existing node to create
> another.
> 2089 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath:
> /live_nodes/172.31.11.63:8983_solr
> 2097 INFO (main) [ ] o.a.s.c.Overseer Overseer (id=null) closing
> 2099 INFO (main) [ ] o.a.s.c.LeaderElector Joined leadership election
> with path:
> /overseer_elect/election/95044078474494001-172.31.11.63:8983_solr-n_0000000025
> 2100 INFO (main) [ ] o.a.s.c.LeaderElector was going to be leader
> /overseer_elect/election/95044078474494001-172.31.11.63:8983_solr-n_0000000025
> , seq(0)
> /overseer_elect/election/95044078474493999-172.31.11.63:8983_solr-n_0000000024
> 2153 INFO (main) [ ] o.a.s.c.CoreContainer Security conf doesn't exist.
> Skipping setup for authorization module.
> 2153 INFO (main) [ ] o.a.s.c.CoreContainer No authentication plugin used.
> 2198 INFO (main) [ ] o.a.s.c.CoresLocator Looking for core definitions
> underneath /opt/solr/server/solr
> 2201 INFO (main) [ ] o.a.s.c.CoresLocator Found 0 core definitions
> 2203 INFO (main) [ ] o.a.s.s.SolrDispatchFilter user.dir=/opt/solr/server
> 2203 INFO (main) [ ] o.a.s.s.SolrDispatchFilter
> SolrDispatchFilter.init() done
> 2211 INFO (main) [ ] o.e.j.s.h.ContextHandler Started
> o.e.j.w.WebAppContext@57fffcd7
> {/solr,file:/opt/solr/server/solr-webapp/webapp/,AVAILABLE}{/opt/solr/server/solr-webapp/webapp}
> 2215 INFO (main) [ ] o.e.j.s.ServerConnector Started
> ServerConnector@433defed{HTTP/1.1}{0.0.0.0:8983}
> 2215 INFO (main) [ ] o.e.j.s.Server Started @2486ms