You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/09/23 00:49:50 UTC
[JENKINS] Lucene-Solr-8.x-MacOSX (64bit/jdk-14.0.1) - Build # 1517
- Still unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/1517/
Java: 64bit/jdk-14.0.1 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv: 1) Thread[id=8224, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestCloudJSONFacetSKGEquiv] at java.base@14.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:157)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv:
1) Thread[id=8224, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestCloudJSONFacetSKGEquiv]
at java.base@14.0.1/java.lang.Thread.sleep(Native Method)
at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:157)
at __randomizedtesting.SeedInfo.seed([273DE1BFB4555CD6]:0)
Build Log:
[...truncated 14646 lines...]
[junit4] Suite: org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv
[junit4] 2> 1044134 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 1044134 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKGEquiv_273DE1BFB4555CD6-001/data-dir-77-001
[junit4] 2> 1044134 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1044136 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 1044136 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1044136 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKGEquiv_273DE1BFB4555CD6-001/tempDir-001
[junit4] 2> 1044137 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1044138 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 1044138 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1044140 WARN (ZkTestServer Run Thread) [ ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
[junit4] 2> 1044240 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port: 63946
[junit4] 2> 1044240 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:63946
[junit4] 2> 1044240 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:63946
[junit4] 2> 1044240 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 63946
[junit4] 2> 1044243 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1044251 INFO (zkConnectionManagerCallback-6561-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1044251 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1044257 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1044262 INFO (zkConnectionManagerCallback-6563-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1044262 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1044264 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1044268 INFO (zkConnectionManagerCallback-6565-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1044268 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1044384 WARN (jetty-launcher-6566-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 1044384 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1044384 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1044384 INFO (jetty-launcher-6566-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
[junit4] 2> 1044391 INFO (jetty-launcher-6566-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1044391 INFO (jetty-launcher-6566-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1044391 INFO (jetty-launcher-6566-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1044392 INFO (jetty-launcher-6566-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a6409d7{/solr,null,AVAILABLE}
[junit4] 2> 1044392 INFO (jetty-launcher-6566-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5712d35b{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:63951}
[junit4] 2> 1044392 INFO (jetty-launcher-6566-thread-1) [ ] o.e.j.s.Server Started @1044512ms
[junit4] 2> 1044392 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63951}
[junit4] 2> 1044393 ERROR (jetty-launcher-6566-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1044393 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1044393 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.7.0
[junit4] 2> 1044393 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1044393 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
[junit4] 2> 1044393 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-09-23T00:10:28.523309Z
[junit4] 2> 1044394 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1044399 INFO (zkConnectionManagerCallback-6568-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1044400 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1044402 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1044411 WARN (jetty-launcher-6566-thread-1-SendThread(127.0.0.1:63946)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100085ee2660003.
[junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100085ee2660003, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
[junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100085ee2660003, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> 1044587 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1044588 WARN (jetty-launcher-6566-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2aba4f5d[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1044588 WARN (jetty-launcher-6566-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2aba4f5d[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1044595 WARN (jetty-launcher-6566-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@41095370[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1044595 WARN (jetty-launcher-6566-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@41095370[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1044597 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63946/solr
[junit4] 2> 1044599 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1044605 INFO (zkConnectionManagerCallback-6578-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1044605 INFO (jetty-launcher-6566-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1044714 INFO (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1044718 INFO (zkConnectionManagerCallback-6580-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1044718 INFO (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1045909 INFO (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:63951_solr
[junit4] 2> 1045916 INFO (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.c.Overseer Overseer (id=72066797656211461-127.0.0.1:63951_solr-n_0000000000) starting
[junit4] 2> 1045948 INFO (OverseerStateUpdate-72066797656211461-127.0.0.1:63951_solr-n_0000000000) [n:127.0.0.1:63951_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:63951_solr
[junit4] 2> 1045948 INFO (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63951_solr
[junit4] 2> 1045967 INFO (OverseerStateUpdate-72066797656211461-127.0.0.1:63951_solr-n_0000000000) [n:127.0.0.1:63951_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1045984 INFO (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1045986 WARN (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1046035 INFO (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1046098 INFO (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63951.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73248fbd
[junit4] 2> 1046132 INFO (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63951.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73248fbd
[junit4] 2> 1046132 INFO (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63951.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73248fbd
[junit4] 2> 1046150 INFO (jetty-launcher-6566-thread-1) [n:127.0.0.1:63951_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKGEquiv_273DE1BFB4555CD6-001/tempDir-001/node1
[junit4] 2> 1046200 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=1
[junit4] 2> 1046202 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1046223 INFO (zkConnectionManagerCallback-6597-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1046223 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1046255 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1046266 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:63946/solr ready
[junit4] 2> 1050110 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params property.schema=schema_latest.xml&property.config=solrconfig-tlog.xml&collection.configName=org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_config-set&name=org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1050155 INFO (OverseerThreadFactory-6587-thread-1-processing-n:127.0.0.1:63951_solr) [n:127.0.0.1:63951_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection
[junit4] 2> 1050350 INFO (OverseerStateUpdate-72066797656211461-127.0.0.1:63951_solr-n_0000000000) [n:127.0.0.1:63951_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:63951/solr",
[junit4] 2> "node_name":"127.0.0.1:63951_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1050572 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_config-set&newCollection=true&collection=org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection&version=2&replicaType=NRT&property.schema=schema_latest.xml&property.config=solrconfig-tlog.xml&coreNodeName=core_node2&name=org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 1050573 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1050639 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
[junit4] 2> 1050656 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=example
[junit4] 2> 1050750 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema example/1.6 with uniqueid field id
[junit4] 2> 1050980 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1' using configuration from configset org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_config-set, trusted=true
[junit4] 2> 1050982 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63951.solr.core.org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection.shard1.replica_n1' (registry 'solr.core.org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73248fbd
[junit4] 2> 1050982 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKGEquiv_273DE1BFB4555CD6-001/tempDir-001/node1/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKGEquiv_273DE1BFB4555CD6-001/tempDir-001/node1/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1/data/]
[junit4] 2> 1050987 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=31, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1051005 WARN (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1051085 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1051086 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1051089 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1051089 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1051091 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=100.7763671875, floorSegmentMB=1.87890625, forceMergeDeletesPctAllowed=17.91561946261877, segmentsPerTier=50.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.19211994741885913, deletesPctAllowed=32.32364955829368
[junit4] 2> 1051097 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_config-set
[junit4] 2> 1051101 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_config-set
[junit4] 2> 1051102 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 1051102 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1678581259548229632
[junit4] 2> 1051109 INFO (searcherExecutor-6599-thread-1-processing-n:127.0.0.1:63951_solr x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 1051138 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 1051138 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/leaders/shard1
[junit4] 2> 1051174 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1051174 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1051174 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:63951/solr/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1/
[junit4] 2> 1051176 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1051178 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:63951/solr/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1051178 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/leaders/shard1/leader after winning as /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/leader_elect/shard1/election/72066797656211461-core_node2-n_0000000000
[junit4] 2> 1051197 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:63951/solr/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1/ shard1
[junit4] 2> 1051361 INFO (zkCallback-6579-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1051367 INFO (zkCallback-6579-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1051381 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1051406 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_config-set&newCollection=true&collection=org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection&version=2&replicaType=NRT&property.schema=schema_latest.xml&property.config=solrconfig-tlog.xml&coreNodeName=core_node2&name=org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=834
[junit4] 2> 1051429 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1051535 INFO (zkCallback-6579-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1051535 INFO (zkCallback-6579-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1051535 INFO (zkCallback-6579-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1051544 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={property.schema=schema_latest.xml&property.config=solrconfig-tlog.xml&collection.configName=org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_config-set&name=org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1434
[junit4] 2> 1051545 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection failOnTimeout: true timeout (sec):
[junit4] 1> replica:core_node2 rstate:active live:true
[junit4] 1> no one is recoverying
[junit4] 1> replica:core_node2 rstate:active live:true
[junit4] 1> no one is recoverying
[junit4] 1> replica:core_node2 rstate:active live:true
[junit4] 1> no one is recoverying
[junit4] 1> replica:core_node2 rstate:active live:true
[junit4] 1> no one is recoverying
[junit4] 2> 1051561 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection
[junit4] 2> 1051591 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/terms/shard1 to Terms{values={core_node2=1}, version=1}
[junit4] 2> 1051591 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0 (1678581260043157504)]} 0 20
[junit4] 2> 1051598 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1678581260065177600)]} 0 5
[junit4] 2> 1051602 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2 (1678581260071469056)]} 0 1
[junit4] 2> 1051604 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[3 (1678581260074614784)]} 0 1
[junit4] 2> 1051608 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[4 (1678581260077760512)]} 0 1
[junit4] 2> 1051613 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[5 (1678581260081954816)]} 0 3
[junit4] 2> 1051617 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[6 (1678581260088246272)]} 0 0
[junit4] 2> 1051620 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[7 (1678581260091392000)]} 0 0
[junit4] 2> 1051623 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[8 (1678581260094537728)]} 0 0
[junit4] 2> 1051626 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[9 (1678581260097683456)]} 0 0
[junit4] 2> 1051629 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[10 (1678581260099780608)]} 0 0
[junit4] 2> 1051631 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[11 (1678581260102926336)]} 0 0
[junit4] 2> 1051635 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[12 (1678581260106072064)]} 0 0
[junit4] 2> 1051638 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[13 (1678581260110266368)]} 0 1
[junit4] 2> 1051642 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[14 (1678581260114460672)]} 0 1
[junit4] 2> 1051645 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[15 (1678581260116557824)]} 0 0
[junit4] 2> 1051647 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[16 (1678581260119703552)]} 0 0
[junit4] 2> 1051660 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[17 (1678581260123897856)]} 0 9
[junit4] 2> 1051668 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[18 (1678581260140675072)]} 0 0
[junit4] 2> 1051671 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[19 (1678581260143820800)]} 0 0
[junit4] 2> 1051673 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[20 (1678581260146966528)]} 0 0
[junit4] 2> 1051675 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[21 (1678581260149063680)]} 0 0
[junit4] 2> 1051678 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[22 (1678581260151160832)]} 0 1
[junit4] 2> 1051680 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[23 (1678581260153257984)]} 0 0
[junit4] 2> 1051681 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[24 (1678581260155355136)]} 0 0
[junit4] 2> 1051683 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[25 (1678581260157452288)]} 0 0
[junit4] 2> 1051686 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[26 (1678581260159549440)]} 0 0
[junit4] 2> 1051689 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[27 (1678581260162695168)]} 0 2
[junit4] 2> 1051692 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[28 (1678581260166889472)]} 0 0
[junit4] 2> 1051695 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[29 (1678581260168986624)]} 0 0
[junit4] 2> 1051699 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[30 (1678581260173180928)]} 0 1
[junit4] 2> 1051702 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[31 (1678581260176326656)]} 0 1
[junit4] 2> 1051704 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[32 (1678581260179472384)]} 0 0
[junit4] 2> 1051707 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[33 (1678581260181569536)]} 0 0
[junit4] 2> 1051709 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[34 (1678581260184715264)]} 0 0
[junit4] 2> 1051712 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[35 (1678581260187860992)]} 0 0
[junit4] 2> 1051714 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[36 (1678581260189958144)]} 0 0
[junit4] 2> 1051717 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[37 (1678581260192055296)]} 0 0
[junit4] 2> 1051720 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[38 (1678581260195201024)]} 0 0
[junit4] 2> 1051725 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[39 (1678581260200443904)]} 0 0
[junit4] 2> 1051727 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[40 (1678581260202541056)]} 0 0
[junit4] 2> 1051729 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[41 (1678581260204638208)]} 0 0
[junit4] 2> 1051733 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[42 (1678581260209881088)]} 0 0
[junit4] 2> 1051739 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[43 (1678581260216172544)]} 0 0
[junit4] 2> 1051741 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[44 (1678581260218269696)]} 0 0
[junit4] 2> 1051744 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[45 (1678581260220366848)]} 0 0
[junit4] 2> 1051746 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[45 (1678581260222464000)]} 0 0
[junit4] 2> 1051749 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[46 (1678581260226658304)]} 0 0
[junit4] 2> 1051752 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[47 (1678581260228755456)]} 0 0
[junit4] 2> 1051754 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[48 (1678581260231901184)]} 0 0
[junit4] 2> 1051757 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[49 (1678581260233998336)]} 0 0
[junit4] 2> 1051761 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[50 (1678581260238192640)]} 0 1
[junit4] 2> 1051764 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[51 (1678581260242386944)]} 0 0
[junit4] 2> 1051767 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[52 (1678581260244484096)]} 0 0
[junit4] 2> 1051771 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[53 (1678581260248678400)]} 0 0
[junit4] 2> 1051777 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[54 (1678581260254969856)]} 0 2
[junit4] 2> 1051781 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[54 (1678581260260212736)]} 0 0
[junit4] 2> 1051788 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[55 (1678581260266504192)]} 0 1
[junit4] 2> 1051798 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[56 (1678581260276989952)]} 0 0
[junit4] 2> 1051806 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[57 (1678581260286427136)]} 0 0
[junit4] 2> 1051810 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[58 (1678581260290621440)]} 0 0
[junit4] 2> 1051815 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[59 (1678581260294815744)]} 0 2
[junit4] 2> 1051827 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[60 (1678581260307398656)]} 0 1
[junit4] 2> 1051830 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[61 (1678581260311592960)]} 0 0
[junit4] 2> 1051837 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[62 (1678581260317884416)]} 0 0
[junit4] 2> 1051839 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[63 (1678581260321030144)]} 0 0
[junit4] 2> 1051845 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[64 (1678581260327321600)]} 0 0
[junit4] 2> 1051848 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[65 (1678581260329418752)]} 0 0
[junit4] 2> 1051851 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[66 (1678581260332564480)]} 0 0
[junit4] 2> 1051854 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[67 (1678581260336758784)]} 0 0
[junit4] 2> 1051856 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[68 (1678581260338855936)]} 0 0
[junit4] 2> 1051861 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[68 (1678581260343050240)]} 0 0
[junit4] 2> 1051867 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[69 (1678581260350390272)]} 0 1
[junit4] 2> 1051873 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[70 (1678581260356681728)]} 0 0
[junit4] 2> 1051880 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[71 (1678581260362973184)]} 0 1
[junit4] 2> 1051883 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[72 (1678581260366118912)]} 0 0
[junit4] 2> 1051886 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[73 (1678581260369264640)]} 0 0
[junit4] 2> 1051898 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[74 (1678581260381847552)]} 0 0
[junit4] 2> 1051908 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[75 (1678581260392333312)]} 0 3
[junit4] 2> 1051912 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[76 (1678581260397576192)]} 0 0
[junit4] 2> 1051916 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[77 (1678581260400721920)]} 0 1
[junit4] 2> 1051925 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[78 (1678581260411207680)]} 0 0
[junit4] 2> 1051928 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[79 (1678581260413304832)]} 0 0
[junit4] 2> 1051931 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[80 (1678581260416450560)]} 0 0
[junit4] 2> 1051938 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[81 (1678581260424839168)]} 0 0
[junit4] 2> 1051943 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[82 (1678581260429033472)]} 0 1
[junit4] 2> 1051954 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[83 (1678581260440567808)]} 0 2
[junit4] 2> 1051964 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[84 (1678581260451053568)]} 0 1
[junit4] 2> 1051972 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[85 (1678581260460490752)]} 0 0
[junit4] 2> 1051977 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[86 (1678581260465733632)]} 0 2
[junit4] 2> 1051995 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[87 (1678581260483559424)]} 0 7
[junit4] 2> 1052007 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[88 (1678581260494045184)]} 0 4
[junit4] 2> 1052022 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[89 (1678581260506628096)]} 0 6
[junit4] 2> 1052037 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[90 (1678581260527599616)]} 0 2
[junit4] 2> 1052053 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[91 (1678581260540182528)]} 0 9
[junit4] 2> 1052058 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[92 (1678581260550668288)]} 0 0
[junit4] 2> 1052065 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[93 (1678581260556959744)]} 0 2
[junit4] 2> 1052070 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[94 (1678581260563251200)]} 0 0
[junit4] 2> 1052081 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[95 (1678581260573736960)]} 0 0
[junit4] 2> 1052085 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[96 (1678581260578979840)]} 0 0
[junit4] 2> 1052097 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[97 (1678581260589465600)]} 0 2
[junit4] 2> 1052104 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[98 (1678581260597854208)]} 0 0
[junit4] 2> 1052117 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[99 (1678581260612534272)]} 0 0
[junit4] 2> 1052127 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[100 (1678581260621971456)]} 0 0
[junit4] 2> 1052145 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[101 (1678581260640845824)]} 0 1
[junit4] 2> 1052148 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[102 (1678581260645040128)]} 0 1
[junit4] 2> 1052150 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[103 (1678581260647137280)]} 0 0
[junit4] 2> 1052154 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[104 (1678581260651331584)]} 0 0
[junit4] 2> 1052161 INFO (OverseerCollectionConfigSetProcessor-72066797656211461-127.0.0.1:63951_solr-n_0000000000) [n:127.0.0.1:63951_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1052166 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[105 (1678581260661817344)]} 0 2
[junit4] 2> 1052174 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[106 (1678581260672303104)]} 0 0
[junit4] 2> 1052184 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[107 (1678581260681740288)]} 0 0
[junit4] 2> 1052186 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[107 (1678581260684886016)]} 0 0
[junit4] 2> 1052200 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[108 (1678581260696420352)]} 0 3
[junit4] 2> 1052209 INFO (qtp1507141137-8256) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[109 (1678581260709003264)]} 0 0
[junit4] 2> 1052216 INFO (qtp1507141137-8255) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[110 (1678581260714246144)]} 0 2
[junit4] 2> 1052237 INFO (qtp1507141137-8257) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[111 (1678581260737314816)]} 0 0
[junit4] 2> 1052241 INFO (qtp1507141137-8254) [n:127.0.0.1:63951_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection s:shard1 r:core_node2 x:org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection_shard1_replica_n1] weba
[...truncated too long message...]
rg.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> 1075760 INFO (jetty-closer-6604-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72066797656211461-127.0.0.1:63951_solr-n_0000000000) closing
[junit4] 2> 1075764 INFO (jetty-closer-6604-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@5712d35b{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 1075765 INFO (jetty-closer-6604-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3a6409d7{/solr,null,UNAVAILABLE}
[junit4] 2> 1075765 INFO (jetty-closer-6604-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1075767 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1075770 WARN (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker-SendThread(127.0.0.1:63946)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100085ee2660000.
[junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100085ee2660000, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
[junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100085ee2660000, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> 1075998 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/terms/shard1
[junit4] 2> 2 /solr/aliases.json
[junit4] 2> 2 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv_collection/state.json
[junit4] 2> 2 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/overseer/queue
[junit4] 2> 4 /solr/collections
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/live_nodes
[junit4] 2>
[junit4] 2> 1076011 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:63946
[junit4] 2> 1076011 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:63946
[junit4] 2> 1076011 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 63946
[junit4] 2> 1076012 INFO (SUITE-TestCloudJSONFacetSKGEquiv-seed#[273DE1BFB4555CD6]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Sep 23, 2020 12:11:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Sep 23, 2020 12:11:10 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv:
[junit4] 2> 1) Thread[id=8224, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestCloudJSONFacetSKGEquiv]
[junit4] 2> at java.base@14.0.1/java.lang.Thread.sleep(Native Method)
[junit4] 2> at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:157)
[junit4] 2> Sep 23, 2020 12:11:10 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=8224, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestCloudJSONFacetSKGEquiv]
[junit4] 2> 1086139 ERROR (SessionTracker) [ ] o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : SessionTracker
[junit4] 2> => java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.base/java.lang.Thread.sleep(Native Method)
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method) ~[?:?]
[junit4] 2> at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:157) [zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> Sep 23, 2020 12:11:10 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene87), sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=ewo, timezone=Asia/Katmandu
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14.0.1 (64-bit)/cpus=6,threads=1,free=310893288,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestWaitForStateWithJettyShutdowns, CoreAdminCreateDiscoverTest, BasicFunctionalityTest, TestFreeTextSuggestions, SignificantTermsQParserPluginTest, TestDistributedStatsComponentCardinality, MultiDestinationAuditLoggerTest, SolrCmdDistributorTest, TestUseDocValuesAsStored2, TestStressRecovery, SuggestComponentContextFilterQueryTest, TestSuggestSpellingConverter, TestLRUStatsCache, PeerSyncWithIndexFingerprintCachingTest, DocumentAnalysisRequestHandlerTest, FullSolrCloudDistribCmdsTest, SolrCloudReportersTest, TestContainerPlugin, SystemLogListenerTest, SharedFSAutoReplicaFailoverTest, TestLuceneIndexBackCompat, NestedAtomicUpdateTest, TestRandomFlRTGCloud, UpdateLogTest, DeleteShardTest, TestSolrDeletionPolicy2, BasicAuthStandaloneTest, TestReloadDeadlock, TestInPlaceUpdatesStandalone, TestDistributedSearch, IndexBasedSpellCheckerTest, OverseerStatusTest, ZkCollectionPropsCachingTest, TestReloadAndDeleteDocs, HdfsBasicDistributedZk2Test, CursorMarkTest, ConcurrentDeleteAndCreateCollectionTest, TestSolrCloudSnapshots, TestConfigOverlay, HighlighterMaxOffsetTest, ChaosMonkeySafeLeaderTest, TestSolrJ, RAMDirectoryFactoryTest, DirectUpdateHandlerTest, TestSchemaSimilarityResource, DistributedFacetSimpleRefinementLongTailTest, MultiThreadedOCPTest, TestUnifiedSolrHighlighterWithoutStoredId, DocExpirationUpdateProcessorFactoryTest, TestSnapshotCloudManager, TestLazyCores, ClusterStateMockUtilTest, TestSolrQueryResponse, DocValuesMissingTest, TestSimNodeLostTrigger, IndexSchemaRuntimeFieldTest, TestCSVResponseWriter, SolrCoreTest, TestTlogReplayVsRecovery, TestSubQueryTransformerCrossCore, TestQueryTypes, UtilsToolTest, TestFieldCacheVsDocValues, TestDistributedMap, ResponseLogComponentTest, TestExceedMaxTermLength, SolrMetricsIntegrationTest, TestLegacyBM25SimilarityFactory, RankFieldTest, SuggesterWFSTTest, TestPKIAuthenticationPlugin, SplitByPrefixTest, TestCloudSchemaless, TestManagedSynonymFilterFactory, TestBulkSchemaAPI, AuthToolTest, TestCloudJSONFacetSKGEquiv]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestCloudJSONFacetSKGEquiv -Dtests.seed=273DE1BFB4555CD6 -Dtests.slow=true -Dtests.locale=ewo -Dtests.timezone=Asia/Katmandu -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | TestCloudJSONFacetSKGEquiv (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv:
[junit4] > 1) Thread[id=8224, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestCloudJSONFacetSKGEquiv]
[junit4] > at java.base@14.0.1/java.lang.Thread.sleep(Native Method)
[junit4] > at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:157)
[junit4] > at __randomizedtesting.SeedInfo.seed([273DE1BFB4555CD6]:0)
[junit4] Completed [407/919 (1!)] on J1 in 42.28s, 7 tests, 1 error <<< FAILURES!
[...truncated 46762 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/1517/consoleText
[repro] Revision: 08dcd24b17b6caa7bd49452dd30a66cfafbaaf89
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC"
[repro] Repro line: ant test -Dtestcase=TestCloudJSONFacetSKGEquiv -Dtests.seed=273DE1BFB4555CD6 -Dtests.slow=true -Dtests.locale=ewo -Dtests.timezone=Asia/Katmandu -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestCloudJSONFacetSKGEquiv
[repro] ant compile-test
[...truncated 3454 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestCloudJSONFacetSKGEquiv" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC" -Dtests.seed=273DE1BFB4555CD6 -Dtests.slow=true -Dtests.locale=ewo -Dtests.timezone=Asia/Katmandu -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 111 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv
[repro] Exiting with code 0
[...truncated 93 lines...]
[JENKINS] Lucene-Solr-8.x-MacOSX (64bit/jdk-14.0.1) - Build # 1518
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/1518/
Java: 64bit/jdk-14.0.1 -XX:+UseCompressedOops -XX:+UseG1GC
3 tests failed.
FAILED: org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitMixedReplicaTypesLink
Error Message:
Error from server at http://127.0.0.1:55215: SPLITSHARD failed to invoke SPLIT core admin command
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55215: SPLITSHARD failed to invoke SPLIT core admin command
at __randomizedtesting.SeedInfo.seed([AC0F76B9B1BEA3D2:9061BFE01466084B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:390)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:360)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1173)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
at org.apache.solr.cloud.api.collections.ShardSplitTest.doSplitMixedReplicaTypes(ShardSplitTest.java:378)
at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitMixedReplicaTypesLink(ShardSplitTest.java:356)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:832)
FAILED: org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitMixedReplicaTypesLink
Error Message:
Error from server at http://127.0.0.1:55164: SPLITSHARD failed to invoke SPLIT core admin command
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55164: SPLITSHARD failed to invoke SPLIT core admin command
at __randomizedtesting.SeedInfo.seed([AC0F76B9B1BEA3D2:9061BFE01466084B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:390)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:360)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1173)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
at org.apache.solr.cloud.api.collections.ShardSplitTest.doSplitMixedReplicaTypes(ShardSplitTest.java:378)
at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitMixedReplicaTypesLink(ShardSplitTest.java:356)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:832)
FAILED: org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitMixedReplicaTypesLink
Error Message:
Timeout waiting to see state for collection=testSplitMixedReplicaTypes_link :DocCollection(testSplitMixedReplicaTypes_link//collections/testSplitMixedReplicaTypes_link/state.json/23)={ "pullReplicas":"2", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node5":{ "core":"testSplitMixedReplicaTypes_link_shard1_replica_n1", "base_url":"http://127.0.0.1:57320", "node_name":"127.0.0.1:57320_", "state":"active", "type":"NRT"}, "core_node6":{ "core":"testSplitMixedReplicaTypes_link_shard1_replica_n2", "base_url":"http://127.0.0.1:57389", "node_name":"127.0.0.1:57389_", "state":"active", "type":"NRT", "leader":"true"}, "core_node7":{ "core":"testSplitMixedReplicaTypes_link_shard1_replica_p3", "base_url":"http://127.0.0.1:57375", "node_name":"127.0.0.1:57375_", "state":"active", "type":"PULL"}, "core_node8":{ "core":"testSplitMixedReplicaTypes_link_shard1_replica_p4", "base_url":"http://127.0.0.1:57381", "node_name":"127.0.0.1:57381_", "state":"active", "type":"PULL"}}}, "shard1_0":{ "parent":"shard1", "shard_parent_node":"127.0.0.1:57389_", "range":"80000000-ffffffff", "state":"recovery", "shard_parent_zk_session":"72068108516982799", "replicas":{ "core_node11":{ "core":"testSplitMixedReplicaTypes_link_shard1_0_replica_n9", "base_url":"http://127.0.0.1:57389", "node_name":"127.0.0.1:57389_", "state":"active", "type":"NRT", "leader":"true"}, "core_node13":{ "core":"testSplitMixedReplicaTypes_link_shard1_0_replica_n0", "base_url":"http://127.0.0.1:57381", "node_name":"127.0.0.1:57381_", "state":"active", "type":"NRT"}, "core_node14":{ "core":"testSplitMixedReplicaTypes_link_shard1_0_replica_p0", "base_url":"http://127.0.0.1:57389", "node_name":"127.0.0.1:57389_", "state":"active", "type":"PULL"}, "core_node15":{ "core":"testSplitMixedReplicaTypes_link_shard1_0_replica_p1", "base_url":"http://127.0.0.1:57320", "node_name":"127.0.0.1:57320_", "state":"active", "type":"PULL"}}, "stateTimestamp":"1600839921994767188"}, "shard1_1":{ "parent":"shard1", "shard_parent_node":"127.0.0.1:57389_", "range":"0-7fffffff", "state":"recovery", "shard_parent_zk_session":"72068108516982799", "replicas":{ "core_node12":{ "core":"testSplitMixedReplicaTypes_link_shard1_1_replica_n10", "base_url":"http://127.0.0.1:57389", "node_name":"127.0.0.1:57389_", "state":"active", "type":"NRT", "leader":"true"}, "core_node16":{ "core":"testSplitMixedReplicaTypes_link_shard1_1_replica_n0", "base_url":"http://127.0.0.1:57375", "node_name":"127.0.0.1:57375_", "state":"recovering", "type":"NRT"}, "core_node17":{ "core":"testSplitMixedReplicaTypes_link_shard1_1_replica_p0", "base_url":"http://127.0.0.1:57406", "node_name":"127.0.0.1:57406_", "state":"recovering", "type":"PULL"}, "core_node18":{ "core":"testSplitMixedReplicaTypes_link_shard1_1_replica_p1", "base_url":"http://127.0.0.1:57381", "node_name":"127.0.0.1:57381_", "state":"recovering", "type":"PULL"}}, "stateTimestamp":"1600839921994549197"}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"5", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.util.concurrent.TimeoutException: Timeout waiting to see state for collection=testSplitMixedReplicaTypes_link :DocCollection(testSplitMixedReplicaTypes_link//collections/testSplitMixedReplicaTypes_link/state.json/23)={
"pullReplicas":"2",
"replicationFactor":"2",
"shards":{
"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node5":{
"core":"testSplitMixedReplicaTypes_link_shard1_replica_n1",
"base_url":"http://127.0.0.1:57320",
"node_name":"127.0.0.1:57320_",
"state":"active",
"type":"NRT"},
"core_node6":{
"core":"testSplitMixedReplicaTypes_link_shard1_replica_n2",
"base_url":"http://127.0.0.1:57389",
"node_name":"127.0.0.1:57389_",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node7":{
"core":"testSplitMixedReplicaTypes_link_shard1_replica_p3",
"base_url":"http://127.0.0.1:57375",
"node_name":"127.0.0.1:57375_",
"state":"active",
"type":"PULL"},
"core_node8":{
"core":"testSplitMixedReplicaTypes_link_shard1_replica_p4",
"base_url":"http://127.0.0.1:57381",
"node_name":"127.0.0.1:57381_",
"state":"active",
"type":"PULL"}}},
"shard1_0":{
"parent":"shard1",
"shard_parent_node":"127.0.0.1:57389_",
"range":"80000000-ffffffff",
"state":"recovery",
"shard_parent_zk_session":"72068108516982799",
"replicas":{
"core_node11":{
"core":"testSplitMixedReplicaTypes_link_shard1_0_replica_n9",
"base_url":"http://127.0.0.1:57389",
"node_name":"127.0.0.1:57389_",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node13":{
"core":"testSplitMixedReplicaTypes_link_shard1_0_replica_n0",
"base_url":"http://127.0.0.1:57381",
"node_name":"127.0.0.1:57381_",
"state":"active",
"type":"NRT"},
"core_node14":{
"core":"testSplitMixedReplicaTypes_link_shard1_0_replica_p0",
"base_url":"http://127.0.0.1:57389",
"node_name":"127.0.0.1:57389_",
"state":"active",
"type":"PULL"},
"core_node15":{
"core":"testSplitMixedReplicaTypes_link_shard1_0_replica_p1",
"base_url":"http://127.0.0.1:57320",
"node_name":"127.0.0.1:57320_",
"state":"active",
"type":"PULL"}},
"stateTimestamp":"1600839921994767188"},
"shard1_1":{
"parent":"shard1",
"shard_parent_node":"127.0.0.1:57389_",
"range":"0-7fffffff",
"state":"recovery",
"shard_parent_zk_session":"72068108516982799",
"replicas":{
"core_node12":{
"core":"testSplitMixedReplicaTypes_link_shard1_1_replica_n10",
"base_url":"http://127.0.0.1:57389",
"node_name":"127.0.0.1:57389_",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node16":{
"core":"testSplitMixedReplicaTypes_link_shard1_1_replica_n0",
"base_url":"http://127.0.0.1:57375",
"node_name":"127.0.0.1:57375_",
"state":"recovering",
"type":"NRT"},
"core_node17":{
"core":"testSplitMixedReplicaTypes_link_shard1_1_replica_p0",
"base_url":"http://127.0.0.1:57406",
"node_name":"127.0.0.1:57406_",
"state":"recovering",
"type":"PULL"},
"core_node18":{
"core":"testSplitMixedReplicaTypes_link_shard1_1_replica_p1",
"base_url":"http://127.0.0.1:57381",
"node_name":"127.0.0.1:57381_",
"state":"recovering",
"type":"PULL"}},
"stateTimestamp":"1600839921994549197"}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"5",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([AC0F76B9B1BEA3D2:9061BFE01466084B]:0)
at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1766)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.waitForState(BaseCloudSolrClient.java:414)
at org.apache.solr.cloud.api.collections.ShardSplitTest.doSplitMixedReplicaTypes(ShardSplitTest.java:381)
at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitMixedReplicaTypesLink(ShardSplitTest.java:356)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:832)
Build Log:
[...truncated 15490 lines...]
[junit4] Suite: org.apache.solr.cloud.api.collections.ShardSplitTest
[junit4] 2> 1247997 INFO (SUITE-ShardSplitTest-seed#[AC0F76B9B1BEA3D2]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 1247998 INFO (SUITE-ShardSplitTest-seed#[AC0F76B9B1BEA3D2]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001/data-dir-153-001
[junit4] 2> 1247998 INFO (SUITE-ShardSplitTest-seed#[AC0F76B9B1BEA3D2]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1247999 INFO (SUITE-ShardSplitTest-seed#[AC0F76B9B1BEA3D2]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776") w/ MAC_OS_X supressed clientAuth
[junit4] 2> 1247999 INFO (SUITE-ShardSplitTest-seed#[AC0F76B9B1BEA3D2]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1247999 INFO (SUITE-ShardSplitTest-seed#[AC0F76B9B1BEA3D2]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] IGNOR/A 0.00s J4 | ShardSplitTest.test
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] 2> 1248004 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1248005 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 1248005 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1248007 WARN (ZkTestServer Run Thread) [ ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
[junit4] 2> 1248115 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer start zk server on port: 54880
[junit4] 2> 1248115 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:54880
[junit4] 2> 1248115 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:54880
[junit4] 2> 1248115 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 54880
[junit4] 2> 1248120 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1248126 INFO (zkConnectionManagerCallback-13304-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1248126 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1248132 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1248136 INFO (zkConnectionManagerCallback-13306-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1248136 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1248141 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1248144 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1248148 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1248153 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1248156 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1248160 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1248162 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1248166 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1248169 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1248172 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1248174 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1248177 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 1248687 WARN (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 1248687 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1248687 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1248687 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
[junit4] 2> 1248692 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1248692 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1248692 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1248693 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@559a2193{/,null,AVAILABLE}
[junit4] 2> 1248694 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@70a614a0{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:54901}
[junit4] 2> 1248694 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.s.Server Started @1248757ms
[junit4] 2> 1248694 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001/tempDir-001/control/data, hostPort=54901, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001/control-001/cores}
[junit4] 2> 1248695 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1248695 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1248695 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.7.0
[junit4] 2> 1248695 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1248695 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
[junit4] 2> 1248695 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-09-23T05:39:54.303582Z
[junit4] 2> 1248697 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1248707 INFO (zkConnectionManagerCallback-13308-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1248709 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1248713 WARN (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]-SendThread(127.0.0.1:54880)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100098c7acd0002.
[junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100098c7acd0002, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
[junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100098c7acd0002, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> 1248817 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1248818 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001/control-001/solr.xml
[junit4] 2> 1248824 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1248824 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1248828 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@43ca03e0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1248970 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 1248972 WARN (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6668e48f[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1248972 WARN (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6668e48f[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1248978 WARN (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3dad6f2[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1248978 WARN (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3dad6f2[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1248980 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54880/solr
[junit4] 2> 1248981 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1248987 INFO (zkConnectionManagerCallback-13318-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1248987 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1248991 WARN (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]-SendThread(127.0.0.1:54880)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100098c7acd0003.
[junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100098c7acd0003, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
[junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100098c7acd0003, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> 1249105 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1249109 INFO (zkConnectionManagerCallback-13320-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1249110 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1249457 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54901_
[junit4] 2> 1249459 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.c.Overseer Overseer (id=72068092998254596-127.0.0.1:54901_-n_0000000000) starting
[junit4] 2> 1249474 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1249475 INFO (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:54901_
[junit4] 2> 1249475 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54901_
[junit4] 2> 1249477 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0 #Completed tasks: 0
[junit4] 2> 1249477 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
[junit4] 2> 1249477 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 1249477 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
[junit4] 2> 1249477 INFO (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
[junit4] 2> 1249478 INFO (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1249485 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1249486 WARN (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1249506 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1249528 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43ca03e0
[junit4] 2> 1249540 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43ca03e0
[junit4] 2> 1249540 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43ca03e0
[junit4] 2> 1249541 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [n:127.0.0.1:54901_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001/control-001/cores
[junit4] 2> 1249559 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1249564 INFO (zkConnectionManagerCallback-13337-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1249564 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1249583 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1249600 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54880/solr ready
[junit4] 2> 1249607 INFO (qtp1816914279-21333) [n:127.0.0.1:54901_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:54901_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1249639 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Got 1 tasks from work-queue : [[org.apache.solr.cloud.OverseerTaskQueue$QueueEvent@2e684ecf]]
[junit4] 2> 1249639 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000000] as running
[junit4] 2> 1249639 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id: /overseer/collection-queue-work/qn-0000000000 message: {
[junit4] 2> "name":"control_collection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"1",
[junit4] 2> "createNodeSet":"127.0.0.1:54901_",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 1249640 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Runner processing /overseer/collection-queue-work/qn-0000000000
[junit4] 2> 1249640 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
[junit4] 2> "name":"control_collection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"1",
[junit4] 2> "createNodeSet":"127.0.0.1:54901_",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 1249647 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1 #Completed tasks: 0
[junit4] 2> 1249647 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 1249647 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 1249647 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
[junit4] 2> 1249647 INFO (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 1249648 INFO (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1249658 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.OverseerCollectionMessageHandler creating collections conf node /collections/control_collection
[junit4] 2> 1249662 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.CreateCollectionCmd Check for collection zkNode: control_collection
[junit4] 2> 1249680 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.CreateCollectionCmd Collection zkNode exists
[junit4] 2> 1249693 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"control_collection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"1",
[junit4] 2> "createNodeSet":"127.0.0.1:54901_",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 1249693 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1249704 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/control_collection/state.json
[junit4] 2> 1249800 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.CreateCollectionCmd Creating SolrCores for new collection control_collection, shardNames [shard1] , message : {
[junit4] 2> "name":"control_collection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"1",
[junit4] 2> "createNodeSet":"127.0.0.1:54901_",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 1249813 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.CreateCollectionCmd Creating core control_collection_shard1_replica_n1 as part of shard shard1 of collection control_collection on 127.0.0.1:54901_
[junit4] 2> 1249819 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1249820 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ x:control_collection_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1249841 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54901",
[junit4] 2> "node_name":"127.0.0.1:54901_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1249842 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54901",
[junit4] 2> "node_name":"127.0.0.1:54901_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 1249846 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:54901",
[junit4] 2> "node_name":"127.0.0.1:54901_",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}
[junit4] 2> 1249846 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(control_collection//collections/control_collection/state.json/0)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node2":{
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:54901",
[junit4] 2> "node_name":"127.0.0.1:54901_",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 1249948 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/control_collection/state.json version: 0
[junit4] 2> 1250867 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
[junit4] 2> 1250878 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 1250965 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1251019 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 1251020 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43ca03e0
[junit4] 2> 1251020 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1251023 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=59.419921875, floorSegmentMB=1.896484375, forceMergeDeletesPctAllowed=27.308742645990083, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=20.67390706482939
[junit4] 2> 1251047 WARN (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1251093 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1251093 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1251094 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1251094 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1251095 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8247298080477342]
[junit4] 2> 1251098 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1251099 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1251099 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 1251100 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1678601980957687808
[junit4] 2> 1251102 INFO (searcherExecutor-13339-thread-1-processing-n:127.0.0.1:54901_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 1251109 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 1251109 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
[junit4] 2> 1251117 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1251117 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1251117 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:54901/control_collection_shard1_replica_n1/
[junit4] 2> 1251117 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1251118 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:54901/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1251118 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72068092998254596-core_node2-n_0000000000
[junit4] 2> 1251122 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:54901/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1251124 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:54901",
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "state":"active"} current state version: 0
[junit4] 2> 1251229 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/control_collection/state.json version: 1
[junit4] 2> 1251230 INFO (zkCallback-13319-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1251230 INFO (zkCallback-13319-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1251232 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1251235 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54901",
[junit4] 2> "node_name":"127.0.0.1:54901_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1251235 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54901",
[junit4] 2> "node_name":"127.0.0.1:54901_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 1251235 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:54901",
[junit4] 2> "node_name":"127.0.0.1:54901_",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"}
[junit4] 2> 1251235 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(control_collection//collections/control_collection/state.json/2)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node2":{
[junit4] 2> "core":"control_collection_shard1_replica_n1",
[junit4] 2> "base_url":"http://127.0.0.1:54901",
[junit4] 2> "node_name":"127.0.0.1:54901_",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"}}}}}
[junit4] 2> 1251235 INFO (qtp1816914279-21332) [n:127.0.0.1:54901_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1416
[junit4] 2> 1251236 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.CreateCollectionCmd Finished create command on all shards for collection: control_collection
[junit4] 2> 1251236 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Completed task:[/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 1251238 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000000] as completed.
[junit4] 2> 1251238 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
[junit4] 2> 1251238 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 1251238 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: [/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 1251238 INFO (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000000]
[junit4] 2> 1251238 DEBUG (OverseerThreadFactory-13327-thread-1-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Message id: /overseer/collection-queue-work/qn-0000000000 complete, response: {success={127.0.0.1:54901_={responseHeader={status=0,QTime=1416},core=control_collection_shard1_replica_n1}}}
[junit4] 2> 1251239 INFO (qtp1816914279-21333) [n:127.0.0.1:54901_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1251337 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/control_collection/state.json version: 2
[junit4] 2> 1251338 INFO (zkCallback-13319-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1251339 INFO (zkCallback-13319-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1251339 INFO (zkCallback-13319-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1251341 INFO (qtp1816914279-21333) [n:127.0.0.1:54901_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:54901_&wt=javabin&version=2} status=0 QTime=1734
[junit4] 2> 1251342 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection
[junit4] 2> 1251349 WARN (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]-SendThread(127.0.0.1:54880)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100098c7acd0005.
[junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100098c7acd0005, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
[junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100098c7acd0005, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> 1251453 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1251456 INFO (zkConnectionManagerCallback-13348-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1251456 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1251459 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1251462 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54880/solr ready
[junit4] 2> 1251462 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1251464 INFO (qtp1816914279-21333) [n:127.0.0.1:54901_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1251472 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Got 1 tasks from work-queue : [[org.apache.solr.cloud.OverseerTaskQueue$QueueEvent@2e684ed1]]
[junit4] 2> 1251472 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000002] as running
[junit4] 2> 1251472 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id: /overseer/collection-queue-work/qn-0000000002 message: {
[junit4] 2> "name":"collection1",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "createNodeSet":"",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 1251472 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Runner processing /overseer/collection-queue-work/qn-0000000002
[junit4] 2> 1251472 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
[junit4] 2> "name":"collection1",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "createNodeSet":"",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 1251473 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1 #Completed tasks: 1
[junit4] 2> 1251474 INFO (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1251474 INFO (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1251475 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000002]
[junit4] 2> 1251475 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 1251475 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection1
[junit4] 2> 1251475 DEBUG (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
[junit4] 2> 1251475 INFO (OverseerCollectionConfigSetProcessor-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000002]
[junit4] 2> 1251477 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.CreateCollectionCmd Check for collection zkNode: collection1
[junit4] 2> 1251479 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.CreateCollectionCmd Collection zkNode exists
[junit4] 2> 1251482 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"collection1",
[junit4] 2> "fromApi":"true",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "createNodeSet":"",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 1251482 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1251586 DEBUG (OverseerStateUpdate-72068092998254596-127.0.0.1:54901_-n_0000000000) [n:127.0.0.1:54901_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 1251694 WARN (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1251695 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.a.c.CreateCollectionCmd Finished create command for collection: collection1
[junit4] 2> 1251695 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Completed task:[/overseer/collection-queue-work/qn-0000000002]
[junit4] 2> 1251696 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000002] as completed.
[junit4] 2> 1251696 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
[junit4] 2> 1251696 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
[junit4] 2> 1251696 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor CompletedTasks: [/overseer/collection-queue-work/qn-0000000002]
[junit4] 2> 1251696 INFO (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000002]
[junit4] 2> 1251696 DEBUG (OverseerThreadFactory-13327-thread-2-processing-n:127.0.0.1:54901_) [n:127.0.0.1:54901_ ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Message id: /overseer/collection-queue-work/qn-0000000002 complete, response: {}
[junit4] 2> 1251700 INFO (qtp1816914279-21333) [n:127.0.0.1:54901_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1251704 INFO (qtp1816914279-21333) [n:127.0.0.1:54901_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=240
[junit4] 2> 1251706 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 1251706 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 1251707 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 1251707 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 1251708 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 1251708 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 1251708 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=4
[junit4] 2> 1252040 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001/shard-1-001 of type NRT for shard2
[junit4] 2> 1252041 WARN (closeThreadPool-13349-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 1252042 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1252042 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1252042 INFO (closeThreadPool-13349-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
[junit4] 2> 1252045 INFO (closeThreadPool-13349-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1252045 INFO (closeThreadPool-13349-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1252045 INFO (closeThreadPool-13349-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1252045 INFO (closeThreadPool-13349-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2e03e6bf{/,null,AVAILABLE}
[junit4] 2> 1252048 INFO (closeThreadPool-13349-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@177379fb{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:54957}
[junit4] 2> 1252048 INFO (closeThreadPool-13349-thread-1) [ ] o.e.j.s.Server Started @1252111ms
[junit4] 2> 1252048 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001/tempDir-001/jetty1, hostPort=54957, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001/shard-1-001/cores, replicaType=NRT}
[junit4] 2> 1252049 ERROR (closeThreadPool-13349-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1252049 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1252049 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.7.0
[junit4] 2> 1252049 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1252049 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
[junit4] 2> 1252049 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-09-23T05:39:57.657299Z
[junit4] 2> 1252051 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1252060 INFO (zkConnectionManagerCallback-13351-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252060 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1252069 WARN (closeThreadPool-13349-thread-1-SendThread(127.0.0.1:54880)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100098c7acd0007.
[junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100098c7acd0007, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
[junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100098c7acd0007, likely server has closed socket
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> 1252180 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1252180 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001/shard-1-001/solr.xml
[junit4] 2> 1252184 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1252184 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1252185 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@43ca03e0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1252318 INFO (closeThreadPool-13349-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 1252322 WARN (closeThreadPool-13349-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@40396cdc[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1252322 WARN (clos
[...truncated too long message...]
tCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
[junit4] 2> 615237 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/collections/testSplitMixedReplicaTypes_link/terms/shard1
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 5 /solr/packages.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2> 5 /solr/collections/collection1/terms/shard1
[junit4] 2> 5 /solr/collections/collection1/terms/shard2
[junit4] 2> 4 /solr/collections/testSplitMixedReplicaTypes_link/terms/shard1_0
[junit4] 2> 4 /solr/collections/collection1/collectionprops.json
[junit4] 2> 3 /solr/collections/testSplitMixedReplicaTypes_link/terms/shard1_1
[junit4] 2> 2 /solr/collections/control_collection/terms/shard1
[junit4] 2> 2 /solr/collections/testSplitMixedReplicaTypes_link/collectionprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 153 /solr/collections/testSplitMixedReplicaTypes_link/state.json
[junit4] 2> 91 /solr/collections/collection1/state.json
[junit4] 2> 12 /solr/collections/control_collection/state.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 2 /solr/overseer_elect/election/72068264489254921-127.0.0.1:55215_-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 78 /solr/overseer/queue
[junit4] 2> 36 /solr/live_nodes
[junit4] 2> 20 /solr/overseer/collection-queue-work
[junit4] 2> 13 /solr/collections
[junit4] 2>
[junit4] 2> 615255 INFO (TEST-ShardSplitTest.testSplitMixedReplicaTypesLink-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:55172
[junit4] 2> 615255 INFO (TEST-ShardSplitTest.testSplitMixedReplicaTypesLink-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:55172
[junit4] 2> 615255 INFO (TEST-ShardSplitTest.testSplitMixedReplicaTypesLink-seed#[AC0F76B9B1BEA3D2]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 55172
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testSplitMixedReplicaTypesLink -Dtests.seed=AC0F76B9B1BEA3D2 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=asa-TZ -Dtests.timezone=US/Pacific-New -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 107s J2 | ShardSplitTest.testSplitMixedReplicaTypesLink <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55215: SPLITSHARD failed to invoke SPLIT core admin command
[junit4] > at __randomizedtesting.SeedInfo.seed([AC0F76B9B1BEA3D2:9061BFE01466084B]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
[junit4] > at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:390)
[junit4] > at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:360)
[junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1173)
[junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
[junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
[junit4] > at org.apache.solr.cloud.api.collections.ShardSplitTest.doSplitMixedReplicaTypes(ShardSplitTest.java:378)
[junit4] > at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitMixedReplicaTypesLink(ShardSplitTest.java:356)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:832)
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_AC0F76B9B1BEA3D2-001
[junit4] 2> Sep 23, 2020 6:25:17 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene87): {rnd_b=FST50, a_t=PostingsFormat(name=LuceneFixedGap), _root_=PostingsFormat(name=MockRandom), foo_s=PostingsFormat(name=LuceneFixedGap), id=FST50}, docValues:{_version_=DocValuesFormat(name=Lucene80), a_i=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=1974, maxMBSortInHeap=5.131625807323575, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=asa-TZ, timezone=US/Pacific-New
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14.0.1 (64-bit)/cpus=6,threads=1,free=54406704,total=346030080
[junit4] 2> NOTE: All tests run in this JVM: [ShardSplitTest]
[junit4] Completed [2/5 (2!)] on J2 in 613.74s, 11 tests, 1 error, 3 skipped <<< FAILURES!
[...truncated 66 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/lucene/common-build.xml:1599: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/lucene/common-build.xml:1126: There were test failures: 5 suites, 55 tests, 2 errors, 15 ignored (15 assumptions) [seed: AC0F76B9B1BEA3D2]
Total time: 10 minutes 55 seconds
[repro] Setting last failure code to 256
[repro] Failures w/original seeds:
[repro] 2/5 failed: org.apache.solr.cloud.api.collections.ShardSplitTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Archiving artifacts
[Java] Sleeping for 5 seconds due to JENKINS-32191...
[Java] Parsing console log (workspace: '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX')
[Java] Successfully parsed console log
[Java] -> found 112 issues (skipped 103 duplicates)
[Java] Post processing issues on 'MacOSX VBOX' with source code encoding 'UTF-8'
[Java] Creating SCM blamer to obtain author and commit information for affected files
[Java] Creating SCM miner to obtain statistics for affected repository files
[Java] Resolving file names for all issues in source directory '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX'
[Java] -> resolved paths in source directory (53 found, 0 not found)
[Java] Resolving module names from module definitions (build.xml, pom.xml, or Manifest.mf files)
[Java] -> resolved module names for 112 issues
[Java] Resolving package names (or namespaces) by parsing the affected files
[Java] -> resolved package names of 53 affected files
[Java] No filter has been set, publishing all 112 issues
[Java] Creating fingerprints for all affected code blocks to track issues over different builds
[Java] -> created fingerprints for 112 issues (skipped 0 issues)
[Java] Copying affected files to Jenkins' build folder '/home/jenkins/jobs/Lucene-Solr-8.x-MacOSX/builds/1518/files-with-issues'
[Java] -> 53 copied, 0 not in workspace, 0 not-found, 0 with I/O error
[Java] Using reference build 'Lucene-Solr-8.x-MacOSX #1517' to compute new, fixed, and outstanding issues
[Java] Issues delta (vs. reference build): outstanding: 112, new: 0, fixed: 0
[Java] No quality gates have been set - skipping
[Java] Health report is disabled - skipping
[Java] Created analysis result for 112 issues (found 0 new issues, fixed 0 issues)
[Java] Attaching ResultAction with ID 'java' to run 'Lucene-Solr-8.x-MacOSX #1518'.
[Checks API] No suitable checks publisher found.
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Recording test results
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
[Checks API] No suitable checks publisher found.
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2