You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/02/17 19:50:30 UTC
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1376
- Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1376/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseParallelGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest: 1) Thread[id=12022, name=qtp4096703-12022, state=TIMED_WAITING, group=TGRP-ManagedSchemaRoundRobinCloudTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest:
1) Thread[id=12022, name=qtp4096703-12022, state=TIMED_WAITING, group=TGRP-ManagedSchemaRoundRobinCloudTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([51E92835D5C5A575]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=12022, name=qtp4096703-12022, state=TIMED_WAITING, group=TGRP-ManagedSchemaRoundRobinCloudTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=12022, name=qtp4096703-12022, state=TIMED_WAITING, group=TGRP-ManagedSchemaRoundRobinCloudTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([51E92835D5C5A575]:0)
Build Log:
[...truncated 13125 lines...]
[junit4] Suite: org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/init-core-data-001
[junit4] 2> 1145072 WARN (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[51E92835D5C5A575]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=238 numCloses=238
[junit4] 2> 1145072 INFO (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[51E92835D5C5A575]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1145074 INFO (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[51E92835D5C5A575]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1145074 INFO (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[51E92835D5C5A575]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1145074 INFO (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[51E92835D5C5A575]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001
[junit4] 2> 1145074 INFO (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[51E92835D5C5A575]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1145074 INFO (Thread-2752) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1145074 INFO (Thread-2752) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1145076 ERROR (Thread-2752) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1145174 INFO (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[51E92835D5C5A575]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:41517
[junit4] 2> 1145177 INFO (zkConnectionManagerCallback-2307-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1145179 INFO (jetty-launcher-2304-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1145179 INFO (jetty-launcher-2304-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1145183 INFO (jetty-launcher-2304-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1145183 INFO (jetty-launcher-2304-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1145183 INFO (jetty-launcher-2304-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1145183 INFO (jetty-launcher-2304-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1145183 INFO (jetty-launcher-2304-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1145184 INFO (jetty-launcher-2304-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1145184 INFO (jetty-launcher-2304-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18ad203{/solr,null,AVAILABLE}
[junit4] 2> 1145184 INFO (jetty-launcher-2304-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e59092{/solr,null,AVAILABLE}
[junit4] 2> 1145185 INFO (jetty-launcher-2304-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@33c1bc{HTTP/1.1,[http/1.1]}{127.0.0.1:46795}
[junit4] 2> 1145185 INFO (jetty-launcher-2304-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@462c7d{HTTP/1.1,[http/1.1]}{127.0.0.1:39341}
[junit4] 2> 1145185 INFO (jetty-launcher-2304-thread-1) [ ] o.e.j.s.Server Started @1146621ms
[junit4] 2> 1145185 INFO (jetty-launcher-2304-thread-2) [ ] o.e.j.s.Server Started @1146621ms
[junit4] 2> 1145185 INFO (jetty-launcher-2304-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46795}
[junit4] 2> 1145185 INFO (jetty-launcher-2304-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39341}
[junit4] 2> 1145185 ERROR (jetty-launcher-2304-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1145185 ERROR (jetty-launcher-2304-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1145185 INFO (jetty-launcher-2304-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1145186 INFO (jetty-launcher-2304-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1145186 INFO (jetty-launcher-2304-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1145186 INFO (jetty-launcher-2304-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1145186 INFO (jetty-launcher-2304-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1145186 INFO (jetty-launcher-2304-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1145186 INFO (jetty-launcher-2304-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-17T19:21:15.869Z
[junit4] 2> 1145186 INFO (jetty-launcher-2304-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-17T19:21:15.869Z
[junit4] 2> 1145187 INFO (zkConnectionManagerCallback-2311-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1145187 INFO (zkConnectionManagerCallback-2310-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1145188 INFO (jetty-launcher-2304-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1145188 INFO (jetty-launcher-2304-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1145195 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10062d9ba640001, likely client has closed socket
[junit4] 2> 1145197 INFO (jetty-launcher-2304-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41517/solr
[junit4] 2> 1145198 INFO (jetty-launcher-2304-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41517/solr
[junit4] 2> 1145199 INFO (zkConnectionManagerCallback-2317-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1145199 INFO (zkConnectionManagerCallback-2319-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1145199 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10062d9ba640004, likely client has closed socket
[junit4] 2> 1145201 INFO (zkConnectionManagerCallback-2321-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1145201 INFO (zkConnectionManagerCallback-2323-thread-1-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1145252 INFO (jetty-launcher-2304-thread-2) [n:127.0.0.1:39341_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1145252 INFO (jetty-launcher-2304-thread-1) [n:127.0.0.1:46795_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1145253 INFO (jetty-launcher-2304-thread-2) [n:127.0.0.1:39341_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39341_solr
[junit4] 2> 1145253 INFO (jetty-launcher-2304-thread-1) [n:127.0.0.1:46795_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46795_solr
[junit4] 2> 1145254 INFO (jetty-launcher-2304-thread-2) [n:127.0.0.1:39341_solr ] o.a.s.c.Overseer Overseer (id=72166281312468998-127.0.0.1:39341_solr-n_0000000000) starting
[junit4] 2> 1145254 INFO (zkCallback-2322-thread-1-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1145273 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1145278 INFO (jetty-launcher-2304-thread-2) [n:127.0.0.1:39341_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39341_solr
[junit4] 2> 1145279 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1145279 INFO (zkCallback-2322-thread-1-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1145401 INFO (jetty-launcher-2304-thread-1) [n:127.0.0.1:46795_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46795.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1145406 INFO (jetty-launcher-2304-thread-2) [n:127.0.0.1:39341_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39341.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1145413 INFO (jetty-launcher-2304-thread-1) [n:127.0.0.1:46795_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46795.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1145414 INFO (jetty-launcher-2304-thread-1) [n:127.0.0.1:46795_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46795.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1145415 INFO (jetty-launcher-2304-thread-1) [n:127.0.0.1:46795_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node1/.
[junit4] 2> 1145421 INFO (jetty-launcher-2304-thread-2) [n:127.0.0.1:39341_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39341.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1145422 INFO (jetty-launcher-2304-thread-2) [n:127.0.0.1:39341_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39341.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1145423 INFO (jetty-launcher-2304-thread-2) [n:127.0.0.1:39341_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node2/.
[junit4] 2> 1145475 INFO (zkConnectionManagerCallback-2329-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1145478 INFO (zkConnectionManagerCallback-2333-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1145479 INFO (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[51E92835D5C5A575]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1145480 INFO (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[51E92835D5C5A575]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41517/solr ready
[junit4] 2> 1145484 INFO (qtp4096703-11956) [n:127.0.0.1:46795_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=cloud-managed&maxShardsPerNode=1&name=managed_coll&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1145486 INFO (OverseerThreadFactory-4355-thread-1-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection managed_coll
[junit4] 2> 1145591 INFO (OverseerStateUpdate-72166281312468998-127.0.0.1:39341_solr-n_0000000000) [n:127.0.0.1:39341_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"managed_coll",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"managed_coll_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39341/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1145593 INFO (OverseerStateUpdate-72166281312468998-127.0.0.1:39341_solr-n_0000000000) [n:127.0.0.1:39341_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"managed_coll",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"managed_coll_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46795/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1145795 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=cloud-managed&newCollection=true&name=managed_coll_shard1_replica_n1&action=CREATE&numShards=2&collection=managed_coll&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1145795 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=cloud-managed&newCollection=true&name=managed_coll_shard2_replica_n2&action=CREATE&numShards=2&collection=managed_coll&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1145796 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1145796 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1145899 INFO (zkCallback-2322-thread-1-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1145899 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1145899 INFO (zkCallback-2322-thread-2-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1145899 INFO (zkCallback-2320-thread-2-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1146807 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1146807 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1146813 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.IndexSchema [managed_coll_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1146813 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema [managed_coll_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1146822 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1146822 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1146822 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'managed_coll_shard2_replica_n2' using configuration from collection managed_coll, trusted=true
[junit4] 2> 1146822 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'managed_coll_shard1_replica_n1' using configuration from collection managed_coll, trusted=true
[junit4] 2> 1146822 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46795.solr.core.managed_coll.shard2.replica_n2' (registry 'solr.core.managed_coll.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1146822 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39341.solr.core.managed_coll.shard1.replica_n1' (registry 'solr.core.managed_coll.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1146822 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1146822 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1146822 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [[managed_coll_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node1/managed_coll_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node1/./managed_coll_shard2_replica_n2/data/]
[junit4] 2> 1146822 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [[managed_coll_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node2/managed_coll_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node2/./managed_coll_shard1_replica_n1/data/]
[junit4] 2> 1146873 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1146873 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1146873 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1146873 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1146875 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1146875 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1146875 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1146875 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1146877 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@16e5586[managed_coll_shard1_replica_n1] main]
[junit4] 2> 1146877 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@870c76[managed_coll_shard2_replica_n2] main]
[junit4] 2> 1146878 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
[junit4] 2> 1146878 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
[junit4] 2> 1146879 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
[junit4] 2> 1146879 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
[junit4] 2> 1146879 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
[junit4] 2> 1146879 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
[junit4] 2> 1146879 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1146879 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1146880 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1146880 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1146880 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592677134565900288
[junit4] 2> 1146881 INFO (searcherExecutor-4360-thread-1-processing-n:127.0.0.1:46795_solr x:managed_coll_shard2_replica_n2 s:shard2 c:managed_coll r:core_node4) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [managed_coll_shard2_replica_n2] Registered new searcher Searcher@870c76[managed_coll_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1146881 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592677134566948864
[junit4] 2> 1146882 INFO (searcherExecutor-4361-thread-1-processing-n:127.0.0.1:39341_solr x:managed_coll_shard1_replica_n1 s:shard1 c:managed_coll r:core_node3) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [managed_coll_shard1_replica_n1] Registered new searcher Searcher@16e5586[managed_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1146885 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1146885 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1146885 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:39341/solr/managed_coll_shard1_replica_n1/
[junit4] 2> 1146885 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1146886 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:39341/solr/managed_coll_shard1_replica_n1/ has no replicas
[junit4] 2> 1146886 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1146888 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:39341/solr/managed_coll_shard1_replica_n1/ shard1
[junit4] 2> 1146889 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1146889 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1146889 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46795/solr/managed_coll_shard2_replica_n2/
[junit4] 2> 1146889 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1146889 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SyncStrategy http://127.0.0.1:46795/solr/managed_coll_shard2_replica_n2/ has no replicas
[junit4] 2> 1146889 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1146891 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46795/solr/managed_coll_shard2_replica_n2/ shard2
[junit4] 2> 1146992 INFO (zkCallback-2320-thread-2-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1146992 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1146992 INFO (zkCallback-2322-thread-2-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1146992 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1147039 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1147042 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1147144 INFO (zkCallback-2322-thread-2-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1147144 INFO (zkCallback-2320-thread-2-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1147144 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1147144 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1147158 INFO (qtp4096703-12020) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=cloud-managed&newCollection=true&name=managed_coll_shard2_replica_n2&action=CREATE&numShards=2&collection=managed_coll&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1362
[junit4] 2> 1147162 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=cloud-managed&newCollection=true&name=managed_coll_shard1_replica_n1&action=CREATE&numShards=2&collection=managed_coll&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1367
[junit4] 2> 1147166 INFO (qtp4096703-11956) [n:127.0.0.1:46795_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1147166 INFO (qtp4096703-11956) [n:127.0.0.1:46795_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=cloud-managed&maxShardsPerNode=1&name=managed_coll&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=1681
[junit4] 2> 1147182 INFO (TEST-ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin-seed#[51E92835D5C5A575]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testAddFieldsRoundRobin
[junit4] 2> 1147192 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.SchemaManager managed schema loaded . version : 0
[junit4] 2> 1147196 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema [managed_coll_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1147199 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147200 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.ZkController Persisted config data to node /configs/cloud-managed/managed-schema
[junit4] 2> 1147200 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
[junit4] 2> 1147200 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
[junit4] 2> 1147201 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 1 from ZooKeeper
[junit4] 2> 1147201 INFO (Thread-2775) [n:127.0.0.1:39341_solr ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard1_replica_n1
[junit4] 2> 1147201 INFO (Thread-2776) [n:127.0.0.1:46795_solr ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard2_replica_n2
[junit4] 2> 1147201 INFO (Thread-2776) [n:127.0.0.1:46795_solr ] o.a.s.c.SolrCore core reload managed_coll_shard2_replica_n2
[junit4] 2> 1147201 INFO (Thread-2775) [n:127.0.0.1:39341_solr ] o.a.s.c.SolrCore core reload managed_coll_shard1_replica_n1
[junit4] 2> 1147202 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.IndexSchema [managed_coll_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1147204 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147205 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 4 ms
[junit4] 2> 1147209 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1147209 INFO (Thread-2775) [n:127.0.0.1:39341_solr ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1147218 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema [managed_coll_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1147218 INFO (Thread-2775) [n:127.0.0.1:39341_solr ] o.a.s.s.IndexSchema [managed_coll_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1147220 INFO (Thread-2775) [n:127.0.0.1:39341_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147220 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147220 INFO (Thread-2775) [n:127.0.0.1:39341_solr ] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard1_replica_n1' using configuration from collection managed_coll
[junit4] 2> 1147220 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard2_replica_n2' using configuration from collection managed_coll
[junit4] 2> 1147258 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39341.solr.core.managed_coll.shard1.replica_n1' (registry 'solr.core.managed_coll.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1147258 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [[managed_coll_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node2/managed_coll_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node2/./managed_coll_shard1_replica_n1/data/]
[junit4] 2> 1147266 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46795.solr.core.managed_coll.shard2.replica_n2' (registry 'solr.core.managed_coll.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1147266 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [[managed_coll_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node1/managed_coll_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node1/./managed_coll_shard2_replica_n2/data/]
[junit4] 2> 1147312 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1147312 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1147314 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1147314 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1147314 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@16884a9[managed_coll_shard1_replica_n1] main]
[junit4] 2> 1147316 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
[junit4] 2> 1147316 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
[junit4] 2> 1147316 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
[junit4] 2> 1147316 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 1 is already the latest
[junit4] 2> 1147316 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@576ad0[managed_coll_shard2_replica_n2] main]
[junit4] 2> 1147317 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1147317 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
[junit4] 2> 1147318 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
[junit4] 2> 1147318 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
[junit4] 2> 1147318 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 1 is already the latest
[junit4] 2> 1147318 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1147319 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592677135026225152
[junit4] 2> 1147320 INFO (searcherExecutor-4370-thread-1-processing-n:127.0.0.1:39341_solr x:managed_coll_shard1_replica_n1 s:shard1 c:managed_coll r:core_node3) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [managed_coll_shard1_replica_n1] Registered new searcher Searcher@16884a9[managed_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1147322 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 1147322 INFO (searcherExecutor-4371-thread-1-processing-n:127.0.0.1:46795_solr x:managed_coll_shard2_replica_n2 s:shard2 c:managed_coll r:core_node4) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [managed_coll_shard2_replica_n2] Registered new searcher Searcher@576ad0[managed_coll_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1147322 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@e4d89e[managed_coll_shard1_replica_n1] main]
[junit4] 2> 1147322 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592677135029370880
[junit4] 2> 1147323 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [managed_coll_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@1037d23
[junit4] 2> 1147323 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.managed_coll.shard1.replica_n1, tag=17005859
[junit4] 2> 1147323 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@175cb80: rootName = solr_39341, domain = solr.core.managed_coll.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.managed_coll.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@1ca3c2d
[junit4] 2> 1147324 INFO (searcherExecutor-4370-thread-1-processing-n:127.0.0.1:39341_solr x:managed_coll_shard1_replica_n1 s:shard1 c:managed_coll r:core_node3) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [managed_coll_shard1_replica_n1] Registered new searcher Searcher@e4d89e[managed_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1147325 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 1147325 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@465d8b[managed_coll_shard2_replica_n2] main]
[junit4] 2> 1147326 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 1 from ZooKeeper
[junit4] 2> 1147327 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ManagedIndexSchema Waiting up to 599 secs for 1 replicas to apply schema update version 1 for collection managed_coll
[junit4] 2> 1147329 INFO (searcherExecutor-4371-thread-1-processing-n:127.0.0.1:46795_solr x:managed_coll_shard2_replica_n2 s:shard2 c:managed_coll r:core_node4) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [managed_coll_shard2_replica_n2] Registered new searcher Searcher@465d8b[managed_coll_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1147329 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.s.IndexSchema [managed_coll_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1147330 INFO (Thread-2775) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.managed_coll.shard1.leader, tag=17005859
[junit4] 2> 1147332 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147332 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 6 ms
[junit4] 2> 1147333 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.S.Request [managed_coll_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1147334 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ManagedIndexSchema Took 8.0ms for 1 replicas to apply schema update version 1 for collection managed_coll
[junit4] 2> 1147334 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.S.Request [managed_coll_shard2_replica_n2] webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=142
[junit4] 2> 1147334 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [managed_coll_shard2_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@1d686e9
[junit4] 2> 1147334 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.managed_coll.shard2.replica_n2, tag=30836457
[junit4] 2> 1147334 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@11843fb: rootName = solr_46795, domain = solr.core.managed_coll.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.managed_coll.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@1ded946
[junit4] 2> 1147334 INFO (Thread-2776) [n:127.0.0.1:46795_solr ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1147341 INFO (Thread-2776) [n:127.0.0.1:46795_solr ] o.a.s.s.IndexSchema [managed_coll_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1147343 INFO (Thread-2776) [n:127.0.0.1:46795_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147343 INFO (Thread-2776) [n:127.0.0.1:46795_solr ] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard2_replica_n2' using configuration from collection managed_coll
[junit4] 2> 1147350 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.managed_coll.shard2.leader, tag=30836457
[junit4] 2> 1147351 INFO (qtp4096703-11966) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.S.Request [managed_coll_shard2_replica_n2] webapp=/solr path=/schema/fields/NumberedField_0 params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1147353 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.SchemaManager managed schema loaded . version : 1
[junit4] 2> 1147355 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.IndexSchema [managed_coll_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1147357 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147358 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.ZkController Persisted config data to node /configs/cloud-managed/managed-schema
[junit4] 2> 1147358 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
[junit4] 2> 1147358 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
[junit4] 2> 1147358 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 2 from ZooKeeper
[junit4] 2> 1147358 INFO (Thread-2777) [n:127.0.0.1:46795_solr ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard2_replica_n2
[junit4] 2> 1147359 INFO (Thread-2778) [n:127.0.0.1:39341_solr ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard1_replica_n1
[junit4] 2> 1147360 INFO (Thread-2778) [n:127.0.0.1:39341_solr ] o.a.s.c.SolrCore core reload managed_coll_shard1_replica_n1
[junit4] 2> 1147360 INFO (Thread-2777) [n:127.0.0.1:46795_solr ] o.a.s.c.SolrCore core reload managed_coll_shard2_replica_n2
[junit4] 2> 1147360 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.s.IndexSchema [managed_coll_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1147361 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147362 INFO (zkCallback-2320-thread-1-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 3 ms
[junit4] 2> 1147372 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1147379 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.IndexSchema [managed_coll_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1147380 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46795.solr.core.managed_coll.shard2.replica_n2' (registry 'solr.core.managed_coll.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1147380 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [[managed_coll_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node1/managed_coll_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node1/./managed_coll_shard2_replica_n2/data/]
[junit4] 2> 1147381 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147381 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard1_replica_n1' using configuration from collection managed_coll
[junit4] 2> 1147434 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39341.solr.core.managed_coll.shard1.replica_n1' (registry 'solr.core.managed_coll.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1147434 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [[managed_coll_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node2/managed_coll_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node2/./managed_coll_shard1_replica_n1/data/]
[junit4] 2> 1147441 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1147442 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1147444 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@4661b0[managed_coll_shard2_replica_n2] main]
[junit4] 2> 1147445 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
[junit4] 2> 1147445 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
[junit4] 2> 1147445 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
[junit4] 2> 1147446 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 2 from ZooKeeper
[junit4] 2> 1147449 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema [managed_coll_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1147451 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147451 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 5 ms
[junit4] 2> 1147452 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1147454 INFO (searcherExecutor-4379-thread-1-processing-n:127.0.0.1:46795_solr x:managed_coll_shard2_replica_n2 s:shard2 c:managed_coll r:core_node4) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [managed_coll_shard2_replica_n2] Registered new searcher Searcher@4661b0[managed_coll_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1147454 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592677135167782912
[junit4] 2> 1147457 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 1147457 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@11fbe3a[managed_coll_shard2_replica_n2] main]
[junit4] 2> 1147457 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [managed_coll_shard2_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@1387570
[junit4] 2> 1147457 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.managed_coll.shard2.replica_n2, tag=20477296
[junit4] 2> 1147457 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1cbd7b3: rootName = solr_46795, domain = solr.core.managed_coll.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.managed_coll.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@1ded946
[junit4] 2> 1147459 INFO (searcherExecutor-4379-thread-1-processing-n:127.0.0.1:46795_solr x:managed_coll_shard2_replica_n2 s:shard2 c:managed_coll r:core_node4) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [managed_coll_shard2_replica_n2] Registered new searcher Searcher@11fbe3a[managed_coll_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1147468 INFO (Thread-2776) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.managed_coll.shard2.leader, tag=20477296
[junit4] 2> 1147476 INFO (Thread-2777) [n:127.0.0.1:46795_solr ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1147484 INFO (Thread-2777) [n:127.0.0.1:46795_solr ] o.a.s.s.IndexSchema [managed_coll_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1147486 INFO (Thread-2777) [n:127.0.0.1:46795_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147486 INFO (Thread-2777) [n:127.0.0.1:46795_solr ] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard2_replica_n2' using configuration from collection managed_coll
[junit4] 2> 1147487 INFO (OverseerCollectionConfigSetProcessor-72166281312468998-127.0.0.1:39341_solr-n_0000000000) [n:127.0.0.1:39341_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1147494 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1147494 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1147496 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@506f41[managed_coll_shard1_replica_n1] main]
[junit4] 2> 1147497 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
[junit4] 2> 1147498 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
[junit4] 2> 1147498 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
[junit4] 2> 1147498 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 2 is already the latest
[junit4] 2> 1147498 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1147509 INFO (searcherExecutor-4380-thread-1-processing-n:127.0.0.1:39341_solr x:managed_coll_shard1_replica_n1 s:shard1 c:managed_coll r:core_node3) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [managed_coll_shard1_replica_n1] Registered new searcher Searcher@506f41[managed_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1147509 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592677135225454592
[junit4] 2> 1147511 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 1147511 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@17bed5b[managed_coll_shard1_replica_n1] main]
[junit4] 2> 1147512 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Waiting up to 599 secs for 1 replicas to apply schema update version 2 for collection managed_coll
[junit4] 2> 1147512 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 2 from ZooKeeper
[junit4] 2> 1147514 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.IndexSchema [managed_coll_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1147516 INFO (searcherExecutor-4380-thread-1-processing-n:127.0.0.1:39341_solr x:managed_coll_shard1_replica_n1 s:shard1 c:managed_coll r:core_node3) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [managed_coll_shard1_replica_n1] Registered new searcher Searcher@17bed5b[managed_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1147516 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147517 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 4 ms
[junit4] 2> 1147517 INFO (qtp4096703-11966) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.S.Request [managed_coll_shard2_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1147518 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Took 5.0ms for 1 replicas to apply schema update version 2 for collection managed_coll
[junit4] 2> 1147518 INFO (Thread-2778) [n:127.0.0.1:39341_solr ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1147518 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.S.Request [managed_coll_shard1_replica_n1] webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=165
[junit4] 2> 1147518 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [managed_coll_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@1b97b07
[junit4] 2> 1147518 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.managed_coll.shard1.replica_n1, tag=28932871
[junit4] 2> 1147518 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@19c2c00: rootName = solr_39341, domain = solr.core.managed_coll.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.managed_coll.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@1ca3c2d
[junit4] 2> 1147523 INFO (Thread-2778) [n:127.0.0.1:39341_solr ] o.a.s.s.IndexSchema [managed_coll_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1147525 INFO (Thread-2778) [n:127.0.0.1:39341_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147525 INFO (Thread-2778) [n:127.0.0.1:39341_solr ] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard1_replica_n1' using configuration from collection managed_coll
[junit4] 2> 1147531 INFO (qtp21316367-11969) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.managed_coll.shard1.leader, tag=28932871
[junit4] 2> 1147533 INFO (qtp21316367-11957) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.S.Request [managed_coll_shard1_replica_n1] webapp=/solr path=/schema/fields/NumberedField_1 params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1147534 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.SchemaManager managed schema loaded . version : 2
[junit4] 2> 1147535 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46795.solr.core.managed_coll.shard2.replica_n2' (registry 'solr.core.managed_coll.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1147535 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [[managed_coll_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node1/managed_coll_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node1/./managed_coll_shard2_replica_n2/data/]
[junit4] 2> 1147536 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema [managed_coll_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1147538 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147538 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
[junit4] 2> 1147539 INFO (zkCallback-2320-thread-2-processing-n:127.0.0.1:46795_solr) [n:127.0.0.1:46795_solr ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
[junit4] 2> 1147538 INFO (qtp4096703-12021) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.ZkController Persisted config data to node /configs/cloud-managed/managed-schema
[junit4] 2> 1147539 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 3 from ZooKeeper
[junit4] 2> 1147540 INFO (Thread-2779) [n:127.0.0.1:46795_solr ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard2_replica_n2
[junit4] 2> 1147540 INFO (Thread-2780) [n:127.0.0.1:39341_solr ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard1_replica_n1
[junit4] 2> 1147541 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.IndexSchema [managed_coll_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1147541 INFO (Thread-2779) [n:127.0.0.1:46795_solr ] o.a.s.c.SolrCore core reload managed_coll_shard2_replica_n2
[junit4] 2> 1147542 INFO (Thread-2780) [n:127.0.0.1:39341_solr ] o.a.s.c.SolrCore core reload managed_coll_shard1_replica_n1
[junit4] 2> 1147543 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147543 INFO (zkCallback-2322-thread-3-processing-n:127.0.0.1:39341_solr) [n:127.0.0.1:39341_solr ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 4 ms
[junit4] 2> 1147558 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39341.solr.core.managed_coll.shard1.replica_n1' (registry 'solr.core.managed_coll.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f8aec
[junit4] 2> 1147558 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [[managed_coll_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node2/managed_coll_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_51E92835D5C5A575-001/tempDir-001/node2/./managed_coll_shard1_replica_n1/data/]
[junit4] 2> 1147586 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1147586 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1147587 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@1536adb[managed_coll_shard2_replica_n2] main]
[junit4] 2> 1147588 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
[junit4] 2> 1147589 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
[junit4] 2> 1147589 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
[junit4] 2> 1147589 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 3 from ZooKeeper
[junit4] 2> 1147592 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema [managed_coll_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1147594 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147594 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 4 ms
[junit4] 2> 1147594 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1147597 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1147597 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1147598 INFO (searcherExecutor-4385-thread-1-processing-n:127.0.0.1:46795_solr x:managed_coll_shard2_replica_n2 s:shard2 c:managed_coll r:core_node4) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [managed_coll_shard2_replica_n2] Registered new searcher Searcher@1536adb[managed_coll_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1147598 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592677135318777856
[junit4] 2> 1147599 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@18ed592[managed_coll_shard1_replica_n1] main]
[junit4] 2> 1147600 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 1147600 INFO (Thread-2777) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@147eec8[managed_coll_shard2_replica_n2] main]
[junit4] 2> 1147600 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
[junit4] 2> 1147600 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
[junit4] 2> 1147600 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
[junit4] 2> 1147601 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 3 from ZooKeeper
[junit4] 2> 1147602 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.IndexSchema [managed_coll_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1147603 INFO (searcherExecutor-4385-thread-1-processing-n:127.0.0.1:46795_solr x:managed_coll_shard2_replica_n2 s:shard2 c:managed_coll r:core_node4) [n:127.0.0.1:46795_solr c:managed_coll s:shard2 r:core_node4 x:managed_coll_shard2_replica_n2] o.a.s.c.SolrCore [managed_coll_shard2_replica_n2] Registered new searcher Searcher@147eec8[managed_coll_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1147609 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1147609 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 8 ms
[junit4] 2> 1147609 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1147611 INFO (Thread-2779) [n:127.0.0.1:46795_solr ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1147612 INFO (searcherExecutor-4389-thread-1-processing-n:127.0.0.1:39341_solr x:managed_coll_shard1_replica_n1 s:shard1 c:managed_coll r:core_node3) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [managed_coll_shard1_replica_n1] Registered new searcher Searcher@18ed592[managed_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1147612 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592677135333457920
[junit4] 2> 1147614 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 1147615 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@f80433[managed_coll_shard1_replica_n1] main]
[junit4] 2> 1147615 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.c.SolrCore [managed_coll_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@10001a4
[junit4] 2> 1147615 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x:managed_coll_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.managed_coll.shard1.replica_n1, tag=16777636
[junit4] 2> 1147615 INFO (Thread-2778) [n:127.0.0.1:39341_solr c:managed_coll s:shard1 r:core_node3 x
[...truncated too long message...]
nt create/delete watches above limit:
[junit4] 2>
[junit4] 2> 27 /solr/configs/cloud-managed/managed-schema
[junit4] 2> 22 /solr/configs/cloud-managed
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/collections/managed_coll/terms/shard2
[junit4] 2> 2 /solr/collections/managed_coll/terms/shard1
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/collections/managed_coll/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2>
[junit4] 2> 1184382 INFO (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[51E92835D5C5A575]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Feb 17, 2018 7:21:55 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Feb 17, 2018 7:22:15 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest:
[junit4] 2> 1) Thread[id=12022, name=qtp4096703-12022, state=TIMED_WAITING, group=TGRP-ManagedSchemaRoundRobinCloudTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Feb 17, 2018 7:22:15 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=12022, name=qtp4096703-12022, state=TIMED_WAITING, group=TGRP-ManagedSchemaRoundRobinCloudTest]
[junit4] 2> Feb 17, 2018 7:22:18 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=12022, name=qtp4096703-12022, state=TIMED_WAITING, group=TGRP-ManagedSchemaRoundRobinCloudTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=true): {}, locale=ar-KW, timezone=Indian/Christmas
[junit4] 2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=2,free=188969304,total=418906112
[junit4] 2> NOTE: All tests run in this JVM: [CoreAdminCreateDiscoverTest, CacheHeaderTest, TestGeoJSONResponseWriter, TestBinaryResponseWriter, DataDrivenBlockJoinTest, SpatialFilterTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestAuthorizationFramework, TestStandardQParsers, TestCoreAdminApis, OverseerCollectionConfigSetProcessorTest, HdfsNNFailoverTest, TestDFRSimilarityFactory, NotRequiredUniqueKeyTest, ClusterStateTest, TestJsonFacetRefinement, TermVectorComponentTest, RegexBoostProcessorTest, MergeStrategyTest, DisMaxRequestHandlerTest, VersionInfoTest, DateMathParserTest, TestCollectionsAPIViaSolrCloudCluster, DateRangeFieldTest, BasicDistributedZk2Test, DeleteInactiveReplicaTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestSchemaResource, SearchRateTriggerTest, AtomicUpdatesTest, TestSerializedLuceneMatchVersion, TestSolrCoreProperties, ConnectionManagerTest, TestQueryTypes, StatelessScriptUpdateProcessorFactoryTest, ZkStateWriterTest, ZkShardTermsTest, DistributedFacetPivotLongTailTest, TestCorePropertiesReload, TestRandomDVFaceting, DistributedFacetPivotWhiteBoxTest, OverseerStatusTest, GraphQueryTest, TestDocBasedVersionConstraints, TestFastWriter, TestNumericTerms32, HdfsLockFactoryTest, TestConfigSetsAPIZkFailure, DistributedSuggestComponentTest, TestSegmentSorting, TestExpandComponent, SearchHandlerTest, TestObjectReleaseTracker, BigEndianAscendingWordDeserializerTest, DirectoryFactoryTest, CurrencyRangeFacetCloudTest, TestCoreDiscovery, TestApiFramework, DirectSolrSpellCheckerTest, TestValueSourceCache, TestSolr4Spatial2, ClassificationUpdateProcessorTest, ShowFileRequestHandlerTest, TestUnifiedSolrHighlighter, TestPushWriter, TestTrackingShardHandlerFactory, MigrateRouteKeyTest, InfoHandlerTest, BaseCdcrDistributedZkTest, CloudMLTQParserTest, TestFieldCacheVsDocValues, TestSolrCloudWithHadoopAuthPlugin, TestShardHandlerFactory, TestTestInjection, IndexSchemaRuntimeFieldTest, TestSuggestSpellingConverter, TestLMJelinekMercerSimilarityFactory, ConvertedLegacyTest, TestSolrXml, ConcurrentDeleteAndCreateCollectionTest, PingRequestHandlerTest, TestBulkSchemaAPI, UniqFieldsUpdateProcessorFactoryTest, TestCloudInspectUtil, CollectionsAPISolrJTest, TestPolicyCloud, TestFreeTextSuggestions, NodeMutatorTest, QueryResultKeyTest, TestRetrieveFieldsOptimizer, TestUtils, TestLeaderInitiatedRecoveryThread, UnloadDistributedZkTest, TestDynamicFieldResource, TestTolerantSearch, TestClusterProperties, TestQuerySenderListener, DocValuesMultiTest, RegexBytesRefFilterTest, ClusterStateUpdateTest, ForceLeaderTest, HLLUtilTest, TestDistributedMissingSort, TestLargeCluster, CleanupOldIndexTest, ResponseLogComponentTest, TestMissingGroups, TestAddFieldRealTimeGet, NoCacheHeaderTest, SolrSlf4jReporterTest, TestFilteredDocIdSet, TestSolrConfigHandlerCloud, ManagedSchemaRoundRobinCloudTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ManagedSchemaRoundRobinCloudTest -Dtests.seed=51E92835D5C5A575 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar-KW -Dtests.timezone=Indian/Christmas -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J2 | ManagedSchemaRoundRobinCloudTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest:
[junit4] > 1) Thread[id=12022, name=qtp4096703-12022, state=TIMED_WAITING, group=TGRP-ManagedSchemaRoundRobinCloudTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([51E92835D5C5A575]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=12022, name=qtp4096703-12022, state=TIMED_WAITING, group=TGRP-ManagedSchemaRoundRobinCloudTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([51E92835D5C5A575]:0)
[junit4] Completed [313/777 (1!)] on J2 in 62.43s, 1 test, 2 errors <<< FAILURES!
[...truncated 45724 lines...]