You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Paul Isaac's <pa...@bristolisopen.com> on 2019/06/03 15:51:35 UTC
Solr 8.1.1 / Zookeeper 3.5.5 problem
Hi,
when attempting to run the example to create a collection the client appears to timeout but has partially created the collection.
[solr@vm-ckan-head ~]$ /opt/solr/bin/solr start -e cloud
Welcome to the SolrCloud example!
This interactive session will help you launch a SolrCloud cluster on your local workstation.
To begin, how many Solr nodes would you like to run in your local cluster? (specify 1-4 nodes) [2]:
Ok, let's start up 2 Solr nodes for your example SolrCloud cluster.
Please enter the port for node1 [8983]:
Please enter the port for node2 [7574]:
Creating Solr home directory /opt/solr/example/cloud/node1/solr
Cloning /opt/solr/example/cloud/node1 into
/opt/solr/example/cloud/node2
Starting up Solr on port 8983 using command:
"/opt/solr/bin/solr" start -cloud -p 8983 -s "/opt/solr/example/cloud/node1/solr"
Waiting up to 180 seconds to see Solr running on port 8983 [\]
Started Solr server on port 8983 (pid=4425). Happy searching!
Starting up Solr on port 7574 using command:
"/opt/solr/bin/solr" start -cloud -p 7574 -s "/opt/solr/example/cloud/node2/solr" -z 192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr
Waiting up to 180 seconds to see Solr running on port 7574 [\]
Started Solr server on port 7574 (pid=4605). Happy searching!
INFO - 2019-06-03 16:25:53.367; org.apache.solr.common.cloud.ConnectionManager; zkClient has connected
INFO - 2019-06-03 16:25:53.412; org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from ZooKeeper... (0) -> (2)
INFO - 2019-06-03 16:25:53.457; org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider; Cluster at 192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr ready
Now let's create a new collection for indexing documents in your 2-node cluster.
Please provide a name for your new collection: [gettingstarted]
How many shards would you like to split gettingstarted into? [2]
How many replicas per shard would you like to create? [2]
Please choose a configuration for the gettingstarted collection, available options are:
_default or sample_techproducts_configs [_default]
sample_techWARN - 2019-06-03 16:26:33.927; org.apache.zookeeper.ClientCnxn; Client session timed out, have not heard from server in 26679ms for sessionid 0x10000003d370009
WARN - 2019-06-03 16:26:34.032; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2a6dc6ad name: ZooKeeperConnection Watcher:192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN - 2019-06-03 16:26:34.032; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
products_configs
WARN - 2019-06-03 16:27:01.683; org.apache.zookeeper.ClientCnxn; Client session timed out, have not heard from server in 26679ms for sessionid 0x10000003d370009
WARN - 2019-06-03 16:27:01.784; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2a6dc6ad name: ZooKeeperConnection Watcher:192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN - 2019-06-03 16:27:01.785; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
^C[solr@vm-ckan-head ~]$ /opt/solr/bin/solr status
Found 2 Solr nodes:
Solr process 4425 running on port 8983
{
"solr_home":"/opt/solr/example/cloud/node1/solr",
"version":"8.1.1 fcbe46c28cef11bc058779afba09521de1b19bef - ab - 2019-05-22 15:20:01",
"startTime":"2019-06-03T15:25:43.816Z",
"uptime":"0 days, 0 hours, 1 minutes, 34 seconds",
"memory":"55.7 MB (%10.9) of 512 MB",
"cloud":{
"ZooKeeper":"192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr",
"liveNodes":"2",
"collections":"0"}}
Solr process 4605 running on port 7574
{
"solr_home":"/opt/solr/example/cloud/node2/solr",
"version":"8.1.1 fcbe46c28cef11bc058779afba09521de1b19bef - ab - 2019-05-22 15:20:01",
"startTime":"2019-06-03T15:25:48.925Z",
"uptime":"0 days, 0 hours, 1 minutes, 30 seconds",
"memory":"223.7 MB (%43.7) of 512 MB",
"cloud":{
"ZooKeeper":"192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr",
"liveNodes":"2",
"collections":"0"}}
[solr@vm-ckan-head solr]$ bin/solr create -c mycollection -d _default
WARNING: Using _default configset with data driven schema functionality. NOT RECOMMENDED for production use.
To turn off: bin/solr config -c mycollection -p 7574 -action set-user-property -property update.autoCreateFields -value false
WARN - 2019-06-03 16:43:05.394; org.apache.zookeeper.ClientCnxn; Client session timed out, have not heard from server in 26675ms for sessionid 0x300000070300007
WARN - 2019-06-03 16:43:05.513; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7f69d988 name: ZooKeeperConnection Watcher:192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN - 2019-06-03 16:43:05.513; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
My zoo.cfg per node is:
[root@vm-zookeeper-node1 centos]# cat /opt/apache-zookeeper-3.5.5-bin/conf/zoo.cfg
# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just
# example sakes.
dataDir=/var/lib/zookeeper
# the port at which the clients will connect
clientPort=2181
# the maximum number of client connections.
# increase this if you need to handle more clients
maxClientCnxns=60
# Increase max file size in Zookeeper from 1MB (Default) to 10MB
# For more info see http://lucene.apache.org/solr/guide/7_7/setting-up-an-external-zookeeper-ensemble.html#updating-solr-s-include-files
jute.maxbuffer=0x9fffff
#
# Be sure to read the maintenance section of the
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
autopurge.snapRetainCount=5
# Purge task interval in hours
# Set to "0" to disable auto purge feature
autopurge.purgeInterval=1
# Cluster servers
# vm-zookeeper-head
server.1=192.168.124.125:2888:3888
# vm-zookeeper-node1
server.2=192.168.124.126:2888:3888
# vm-zookeeper-node2
server.3=192.168.124.124:2888:3888
4lw.commands.whitelist=*
Any help appreciated
Kind regards
Paul
Paul B. Isaac’s
Head of Engineering & Information Management
MSc, MIEEE, MIET, MBCS, MLPI, and IISP(Affiliate)
Bristol is Open
T: +44(0)7930310318
E: paul.isaacs@bristolisopen.com
www.bristolisopen.com <https://www.bristolisopen.com/>
@bristolisopen
IMPORTANT NOTICE: Privileged and/or confidential information may be contained in this message and any attachments ("this Email"). If you are not the intended addressee (or responsible for the delivery of this Email), you may not copy or deliver this Email to anyone and you should instead destroy it and are requested to notify the sender of your receipt of the Email immediately. No warranty is given that this Email is free from viruses and/or that this Email or any reply is secure from interception/corruption. Any opinions, recommendations and other information which do not relate to official business of Bristol is Open Ltd are included in this Email on the basis that they are personal to the sender and are neither given nor endorsed by Bristol is Open Ltd.
Bristol is Open Ltd (Co Reg No: 9302408), P.O. Box 3176, Bristol. BS3 9FS.
Re: Solr 8.1.1 / Zookeeper 3.5.5 problem
Posted by Erick Erickson <er...@gmail.com>.
See: https://issues.apache.org/jira/browse/SOLR-8346. We haven’t released anything yet that even purports to run against ZK 3.5.5 since it’s so new, but 8.2 should have the upgrade.
Meanwhile, if you were ambitious you could apply the patch at the JIRA above and try it, or wait a few days and download/compile after the patch is committed, which should be today or tomorrow.
IOW, you’re on the bleeding edge… I’d like to get all the mileage on this that we can before releasing 8.2, so all help welcome….
Best,
Erick
> On Jun 3, 2019, at 8:51 AM, Paul Isaac's <pa...@bristolisopen.com> wrote:
>
> Hi,
> when attempting to run the example to create a collection the client appears to timeout but has partially created the collection.
>
> [solr@vm-ckan-head ~]$ /opt/solr/bin/solr start -e cloud
>
> Welcome to the SolrCloud example!
>
> This interactive session will help you launch a SolrCloud cluster on your local workstation.
> To begin, how many Solr nodes would you like to run in your local cluster? (specify 1-4 nodes) [2]:
>
> Ok, let's start up 2 Solr nodes for your example SolrCloud cluster.
> Please enter the port for node1 [8983]:
>
> Please enter the port for node2 [7574]:
>
> Creating Solr home directory /opt/solr/example/cloud/node1/solr
> Cloning /opt/solr/example/cloud/node1 into
> /opt/solr/example/cloud/node2
>
> Starting up Solr on port 8983 using command:
> "/opt/solr/bin/solr" start -cloud -p 8983 -s "/opt/solr/example/cloud/node1/solr"
>
> Waiting up to 180 seconds to see Solr running on port 8983 [\]
> Started Solr server on port 8983 (pid=4425). Happy searching!
>
>
> Starting up Solr on port 7574 using command:
> "/opt/solr/bin/solr" start -cloud -p 7574 -s "/opt/solr/example/cloud/node2/solr" -z 192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr
>
> Waiting up to 180 seconds to see Solr running on port 7574 [\]
> Started Solr server on port 7574 (pid=4605). Happy searching!
>
> INFO - 2019-06-03 16:25:53.367; org.apache.solr.common.cloud.ConnectionManager; zkClient has connected
> INFO - 2019-06-03 16:25:53.412; org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from ZooKeeper... (0) -> (2)
> INFO - 2019-06-03 16:25:53.457; org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider; Cluster at 192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr ready
>
> Now let's create a new collection for indexing documents in your 2-node cluster.
> Please provide a name for your new collection: [gettingstarted]
>
> How many shards would you like to split gettingstarted into? [2]
>
> How many replicas per shard would you like to create? [2]
>
> Please choose a configuration for the gettingstarted collection, available options are:
> _default or sample_techproducts_configs [_default]
>
> sample_techWARN - 2019-06-03 16:26:33.927; org.apache.zookeeper.ClientCnxn; Client session timed out, have not heard from server in 26679ms for sessionid 0x10000003d370009
> WARN - 2019-06-03 16:26:34.032; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2a6dc6ad name: ZooKeeperConnection Watcher:192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
> WARN - 2019-06-03 16:26:34.032; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
> products_configs
> WARN - 2019-06-03 16:27:01.683; org.apache.zookeeper.ClientCnxn; Client session timed out, have not heard from server in 26679ms for sessionid 0x10000003d370009
> WARN - 2019-06-03 16:27:01.784; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2a6dc6ad name: ZooKeeperConnection Watcher:192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
> WARN - 2019-06-03 16:27:01.785; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
> ^C[solr@vm-ckan-head ~]$ /opt/solr/bin/solr status
>
> Found 2 Solr nodes:
>
> Solr process 4425 running on port 8983
> {
> "solr_home":"/opt/solr/example/cloud/node1/solr",
> "version":"8.1.1 fcbe46c28cef11bc058779afba09521de1b19bef - ab - 2019-05-22 15:20:01",
> "startTime":"2019-06-03T15:25:43.816Z",
> "uptime":"0 days, 0 hours, 1 minutes, 34 seconds",
> "memory":"55.7 MB (%10.9) of 512 MB",
> "cloud":{
> "ZooKeeper":"192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr",
> "liveNodes":"2",
> "collections":"0"}}
>
>
> Solr process 4605 running on port 7574
> {
> "solr_home":"/opt/solr/example/cloud/node2/solr",
> "version":"8.1.1 fcbe46c28cef11bc058779afba09521de1b19bef - ab - 2019-05-22 15:20:01",
> "startTime":"2019-06-03T15:25:48.925Z",
> "uptime":"0 days, 0 hours, 1 minutes, 30 seconds",
> "memory":"223.7 MB (%43.7) of 512 MB",
> "cloud":{
> "ZooKeeper":"192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr",
> "liveNodes":"2",
> "collections":"0"}}
>
>
> [solr@vm-ckan-head solr]$ bin/solr create -c mycollection -d _default
> WARNING: Using _default configset with data driven schema functionality. NOT RECOMMENDED for production use.
> To turn off: bin/solr config -c mycollection -p 7574 -action set-user-property -property update.autoCreateFields -value false
> WARN - 2019-06-03 16:43:05.394; org.apache.zookeeper.ClientCnxn; Client session timed out, have not heard from server in 26675ms for sessionid 0x300000070300007
> WARN - 2019-06-03 16:43:05.513; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7f69d988 name: ZooKeeperConnection Watcher:192.168.124.125:2181,192.168.124.126:2181,192.168.124.124:2181/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
> WARN - 2019-06-03 16:43:05.513; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>
>
>
> My zoo.cfg per node is:
>
> [root@vm-zookeeper-node1 centos]# cat /opt/apache-zookeeper-3.5.5-bin/conf/zoo.cfg
> # The number of milliseconds of each tick
> tickTime=2000
> # The number of ticks that the initial
> # synchronization phase can take
> initLimit=10
> # The number of ticks that can pass between
> # sending a request and getting an acknowledgement
> syncLimit=5
> # the directory where the snapshot is stored.
> # do not use /tmp for storage, /tmp here is just
> # example sakes.
> dataDir=/var/lib/zookeeper
> # the port at which the clients will connect
> clientPort=2181
> # the maximum number of client connections.
> # increase this if you need to handle more clients
> maxClientCnxns=60
> # Increase max file size in Zookeeper from 1MB (Default) to 10MB
> # For more info see http://lucene.apache.org/solr/guide/7_7/setting-up-an-external-zookeeper-ensemble.html#updating-solr-s-include-files
> jute.maxbuffer=0x9fffff
> #
> # Be sure to read the maintenance section of the
> # administrator guide before turning on autopurge.
> #
> # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
> #
> # The number of snapshots to retain in dataDir
> autopurge.snapRetainCount=5
> # Purge task interval in hours
> # Set to "0" to disable auto purge feature
> autopurge.purgeInterval=1
> # Cluster servers
> # vm-zookeeper-head
> server.1=192.168.124.125:2888:3888
> # vm-zookeeper-node1
> server.2=192.168.124.126:2888:3888
> # vm-zookeeper-node2
> server.3=192.168.124.124:2888:3888
>
> 4lw.commands.whitelist=*
>
>
>
>
> Any help appreciated
>
> Kind regards
>
> Paul
>
> Paul B. Isaac’s
> Head of Engineering & Information Management
> MSc, MIEEE, MIET, MBCS, MLPI, and IISP(Affiliate)
>
> Bristol is Open
>
> T: +44(0)7930310318
> E: paul.isaacs@bristolisopen.com
>
> www.bristolisopen.com <https://www.bristolisopen.com/>
> @bristolisopen
>
> IMPORTANT NOTICE: Privileged and/or confidential information may be contained in this message and any attachments ("this Email"). If you are not the intended addressee (or responsible for the delivery of this Email), you may not copy or deliver this Email to anyone and you should instead destroy it and are requested to notify the sender of your receipt of the Email immediately. No warranty is given that this Email is free from viruses and/or that this Email or any reply is secure from interception/corruption. Any opinions, recommendations and other information which do not relate to official business of Bristol is Open Ltd are included in this Email on the basis that they are personal to the sender and are neither given nor endorsed by Bristol is Open Ltd.
>
> Bristol is Open Ltd (Co Reg No: 9302408), P.O. Box 3176, Bristol. BS3 9FS.
>
>
>
>