You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2016/12/31 20:44:15 UTC

[JENKINS] Lucene-Solr-Tests-master - Build # 1577 - Unstable

Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1577/

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest:     1) Thread[id=17425, name=OverseerHdfsCoreFailoverThread-97204035233447942-127.0.0.1:58744_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest: 
   1) Thread[id=17425, name=OverseerHdfsCoreFailoverThread-97204035233447942-127.0.0.1:58744_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([AF8C940784BE92F6]:0)




Build Log:
[...truncated 12672 lines...]
   [junit4] Suite: org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/init-core-data-001
   [junit4]   2> 1683272 INFO  (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[AF8C940784BE92F6]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1683273 INFO  (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[AF8C940784BE92F6]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001
   [junit4]   2> 1683276 INFO  (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[AF8C940784BE92F6]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1683288 INFO  (Thread-4458) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1683288 INFO  (Thread-4458) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1683380 INFO  (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[AF8C940784BE92F6]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:60757
   [junit4]   2> 1683420 INFO  (jetty-launcher-2903-thread-1) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1683425 INFO  (jetty-launcher-2903-thread-2) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1683575 INFO  (jetty-launcher-2903-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4eb22833{/solr,null,AVAILABLE}
   [junit4]   2> 1683575 INFO  (jetty-launcher-2903-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@15c1c31b{HTTP/1.1,[http/1.1]}{127.0.0.1:58284}
   [junit4]   2> 1683575 INFO  (jetty-launcher-2903-thread-1) [    ] o.e.j.s.Server Started @1686970ms
   [junit4]   2> 1683575 INFO  (jetty-launcher-2903-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58284}
   [junit4]   2> 1683575 ERROR (jetty-launcher-2903-thread-1) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1683575 INFO  (jetty-launcher-2903-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 1683575 INFO  (jetty-launcher-2903-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1683575 INFO  (jetty-launcher-2903-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1683575 INFO  (jetty-launcher-2903-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2016-12-31T20:24:29.929Z
   [junit4]   2> 1683577 INFO  (jetty-launcher-2903-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@359e8cfd{/solr,null,AVAILABLE}
   [junit4]   2> 1683577 INFO  (jetty-launcher-2903-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1a07fdb9{HTTP/1.1,[http/1.1]}{127.0.0.1:58744}
   [junit4]   2> 1683577 INFO  (jetty-launcher-2903-thread-2) [    ] o.e.j.s.Server Started @1686972ms
   [junit4]   2> 1683577 INFO  (jetty-launcher-2903-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58744}
   [junit4]   2> 1683577 ERROR (jetty-launcher-2903-thread-2) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1683577 INFO  (jetty-launcher-2903-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 1683577 INFO  (jetty-launcher-2903-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1683577 INFO  (jetty-launcher-2903-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1683578 INFO  (jetty-launcher-2903-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2016-12-31T20:24:29.932Z
   [junit4]   2> 1683589 INFO  (jetty-launcher-2903-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1683598 INFO  (jetty-launcher-2903-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1683609 INFO  (jetty-launcher-2903-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60757/solr
   [junit4]   2> 1683644 INFO  (jetty-launcher-2903-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60757/solr
   [junit4]   2> 1683689 INFO  (jetty-launcher-2903-thread-1) [n:127.0.0.1:58284_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58284_solr
   [junit4]   2> 1683689 INFO  (jetty-launcher-2903-thread-1) [n:127.0.0.1:58284_solr    ] o.a.s.c.Overseer Overseer (id=97204035233447941-127.0.0.1:58284_solr-n_0000000000) starting
   [junit4]   2> 1683708 INFO  (jetty-launcher-2903-thread-2) [n:127.0.0.1:58744_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58744_solr
   [junit4]   2> 1683733 INFO  (zkCallback-2914-thread-1-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1683733 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1683734 INFO  (jetty-launcher-2903-thread-1) [n:127.0.0.1:58284_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58284_solr
   [junit4]   2> 1683735 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1683740 INFO  (zkCallback-2914-thread-1-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1683760 INFO  (jetty-launcher-2903-thread-1) [n:127.0.0.1:58284_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node1/.
   [junit4]   2> 1683785 INFO  (jetty-launcher-2903-thread-2) [n:127.0.0.1:58744_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node2/.
   [junit4]   2> 1684776 INFO  (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[AF8C940784BE92F6]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1684777 INFO  (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[AF8C940784BE92F6]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60757/solr ready
   [junit4]   2> 1684787 INFO  (qtp1797133402-17250) [n:127.0.0.1:58284_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=cloud-managed&maxShardsPerNode=1&name=managed_coll&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1684797 INFO  (OverseerThreadFactory-8185-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.c.CreateCollectionCmd Create collection managed_coll
   [junit4]   2> 1684910 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cloud-managed&newCollection=true&name=managed_coll_shard2_replica1&action=CREATE&numShards=2&collection=managed_coll&shard=shard2&wt=javabin&version=2
   [junit4]   2> 1684910 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cloud-managed&newCollection=true&name=managed_coll_shard1_replica1&action=CREATE&numShards=2&collection=managed_coll&shard=shard1&wt=javabin&version=2
   [junit4]   2> 1685186 INFO  (zkCallback-2914-thread-1-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1685186 INFO  (zkCallback-2913-thread-4-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1685934 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1685939 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1685945 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1685959 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1685960 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1685962 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1685963 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.c.CoreContainer Creating SolrCore 'managed_coll_shard2_replica1' using configuration from collection managed_coll
   [junit4]   2> 1685963 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [[managed_coll_shard2_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node1/managed_coll_shard2_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node1/./managed_coll_shard2_replica1/data/]
   [junit4]   2> 1685964 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'managed_coll_shard1_replica1' using configuration from collection managed_coll
   [junit4]   2> 1685964 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [[managed_coll_shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node2/managed_coll_shard1_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node2/./managed_coll_shard1_replica1/data/]
   [junit4]   2> 1685979 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1685979 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1685986 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1685986 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1685986 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3556d692[managed_coll_shard2_replica1] main]
   [junit4]   2> 1685986 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1685986 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1685987 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
   [junit4]   2> 1685987 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1685987 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1685987 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
   [junit4]   2> 1685987 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
   [junit4]   2> 1685987 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3cb9fd60[managed_coll_shard1_replica1] main]
   [junit4]   2> 1685988 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1685988 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
   [junit4]   2> 1685988 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1685988 INFO  (searcherExecutor-8190-thread-1-processing-n:127.0.0.1:58284_solr x:managed_coll_shard2_replica1 s:shard2 c:managed_coll) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1] Registered new searcher Searcher@3556d692[managed_coll_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1685988 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
   [junit4]   2> 1685988 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555264566556884992
   [junit4]   2> 1685988 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
   [junit4]   2> 1685993 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1685993 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1685993 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1685993 INFO  (searcherExecutor-8191-thread-1-processing-n:127.0.0.1:58744_solr x:managed_coll_shard1_replica1 s:shard1 c:managed_coll) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1] Registered new searcher Searcher@3cb9fd60[managed_coll_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1685993 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1685993 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555264566562127872
   [junit4]   2> 1685995 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:58284/solr/managed_coll_shard2_replica1/
   [junit4]   2> 1685995 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1685995 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:58284/solr/managed_coll_shard2_replica1/ has no replicas
   [junit4]   2> 1685998 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1685998 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1685998 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:58744/solr/managed_coll_shard1_replica1/
   [junit4]   2> 1685999 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1685999 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:58744/solr/managed_coll_shard1_replica1/ has no replicas
   [junit4]   2> 1686000 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:58284/solr/managed_coll_shard2_replica1/ shard2
   [junit4]   2> 1686001 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:58744/solr/managed_coll_shard1_replica1/ shard1
   [junit4]   2> 1686102 INFO  (zkCallback-2914-thread-1-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1686102 INFO  (zkCallback-2913-thread-2-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1686152 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1686152 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1686154 INFO  (qtp1797133402-17248) [n:127.0.0.1:58284_solr c:managed_coll s:shard2  x:managed_coll_shard2_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=cloud-managed&newCollection=true&name=managed_coll_shard2_replica1&action=CREATE&numShards=2&collection=managed_coll&shard=shard2&wt=javabin&version=2} status=0 QTime=1244
   [junit4]   2> 1686155 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1  x:managed_coll_shard1_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=cloud-managed&newCollection=true&name=managed_coll_shard1_replica1&action=CREATE&numShards=2&collection=managed_coll&shard=shard1&wt=javabin&version=2} status=0 QTime=1244
   [junit4]   2> 1686159 INFO  (qtp1797133402-17250) [n:127.0.0.1:58284_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1686160 INFO  (OverseerCollectionConfigSetProcessor-97204035233447941-127.0.0.1:58284_solr-n_0000000000) [n:127.0.0.1:58284_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1686259 INFO  (zkCallback-2914-thread-1-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1686259 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/managed_coll/state.json] for collection [managed_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1687159 INFO  (qtp1797133402-17250) [n:127.0.0.1:58284_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=cloud-managed&maxShardsPerNode=1&name=managed_coll&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=2372
   [junit4]   2> 1687181 INFO  (TEST-ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin-seed#[AF8C940784BE92F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAddFieldsRoundRobin
   [junit4]   2> 1687183 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.SchemaManager managed schema loaded . version : 0 
   [junit4]   2> 1687185 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687187 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687188 INFO  (zkCallback-2914-thread-1-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1687188 INFO  (zkCallback-2914-thread-1-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 1 from ZooKeeper
   [junit4]   2> 1687189 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1687189 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.ZkController Persisted config data to node /configs/cloud-managed/managed-schema 
   [junit4]   2> 1687189 INFO  (zkCallback-2914-thread-1-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1687191 INFO  (zkCallback-2914-thread-1-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687193 INFO  (zkCallback-2914-thread-1-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 4 ms
   [junit4]   2> 1687193 INFO  (Thread-4477) [n:127.0.0.1:58284_solr    ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard2_replica1
   [junit4]   2> 1687194 INFO  (Thread-4477) [n:127.0.0.1:58284_solr    ] o.a.s.c.SolrCore core reload managed_coll_shard2_replica1
   [junit4]   2> 1687198 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1687201 INFO  (Thread-4478) [n:127.0.0.1:58744_solr    ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard1_replica1
   [junit4]   2> 1687204 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687207 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687208 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard2_replica1' using configuration from collection managed_coll
   [junit4]   2> 1687208 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [[managed_coll_shard2_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node1/managed_coll_shard2_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node1/./managed_coll_shard2_replica1/data/]
   [junit4]   2> 1687217 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1687217 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1687217 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@518b16f6[managed_coll_shard2_replica1] main]
   [junit4]   2> 1687218 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
   [junit4]   2> 1687218 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
   [junit4]   2> 1687218 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
   [junit4]   2> 1687218 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Current schema version 1 is already the latest
   [junit4]   2> 1687218 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1687221 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555264567849779200
   [junit4]   2> 1687221 INFO  (searcherExecutor-8200-thread-1-processing-n:127.0.0.1:58284_solr x:managed_coll_shard2_replica1 s:shard2 c:managed_coll r:core_node2) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1] Registered new searcher Searcher@518b16f6[managed_coll_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687224 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1687224 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4a951671[managed_coll_shard2_replica1] main]
   [junit4]   2> 1687224 INFO  (searcherExecutor-8200-thread-1-processing-n:127.0.0.1:58284_solr x:managed_coll_shard2_replica1 s:shard2 c:managed_coll r:core_node2) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1] Registered new searcher Searcher@4a951671[managed_coll_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687228 INFO  (Thread-4477) [n:127.0.0.1:58284_solr    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1687228 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ManagedIndexSchema Waiting up to 599 secs for 1 replicas to apply schema update version 1 for collection managed_coll
   [junit4]   2> 1687229 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 1 from ZooKeeper
   [junit4]   2> 1687230 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687231 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687231 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 2 ms
   [junit4]   2> 1687233 INFO  (qtp1629057392-17263) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.S.Request [managed_coll_shard1_replica1]  webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1687234 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ManagedIndexSchema Took 5.0ms for 1 replicas to apply schema update version 1 for collection managed_coll
   [junit4]   2> 1687234 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.S.Request [managed_coll_shard2_replica1]  webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=51
   [junit4]   2> 1687234 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2c67318f
   [junit4]   2> 1687235 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.managed_coll.shard2.replica1
   [junit4]   2> 1687235 INFO  (qtp1797133402-17253) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.S.Request [managed_coll_shard2_replica1]  webapp=/solr path=/schema/fields/NumberedField_0 params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1687237 INFO  (Thread-4477) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687239 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.SchemaManager managed schema loaded . version : 1 
   [junit4]   2> 1687239 INFO  (Thread-4477) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687240 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1687241 INFO  (Thread-4477) [n:127.0.0.1:58284_solr    ] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard2_replica1' using configuration from collection managed_coll
   [junit4]   2> 1687242 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687242 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [[managed_coll_shard2_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node1/managed_coll_shard2_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node1/./managed_coll_shard2_replica1/data/]
   [junit4]   2> 1687243 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1687243 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.ZkController Persisted config data to node /configs/cloud-managed/managed-schema 
   [junit4]   2> 1687243 INFO  (zkCallback-2913-thread-2-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1687245 INFO  (zkCallback-2913-thread-2-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 2 from ZooKeeper
   [junit4]   2> 1687246 INFO  (zkCallback-2913-thread-2-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687248 INFO  (zkCallback-2913-thread-2-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687248 INFO  (zkCallback-2913-thread-2-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 3 ms
   [junit4]   2> 1687249 INFO  (Thread-4479) [n:127.0.0.1:58744_solr    ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard1_replica1
   [junit4]   2> 1687252 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1687252 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1687252 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@665ae037[managed_coll_shard2_replica1] main]
   [junit4]   2> 1687253 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1687254 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
   [junit4]   2> 1687254 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
   [junit4]   2> 1687254 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
   [junit4]   2> 1687255 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 2 from ZooKeeper
   [junit4]   2> 1687256 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687257 INFO  (Thread-4480) [n:127.0.0.1:58284_solr    ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard2_replica1
   [junit4]   2> 1687258 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687258 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 3 ms
   [junit4]   2> 1687258 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1687258 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555264567888576512
   [junit4]   2> 1687258 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1687259 INFO  (Thread-4479) [n:127.0.0.1:58744_solr    ] o.a.s.c.SolrCore core reload managed_coll_shard1_replica1
   [junit4]   2> 1687270 INFO  (searcherExecutor-8205-thread-1-processing-n:127.0.0.1:58284_solr x:managed_coll_shard2_replica1 s:shard2 c:managed_coll r:core_node2) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1] Registered new searcher Searcher@665ae037[managed_coll_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687270 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1687270 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@cb6ac63[managed_coll_shard2_replica1] main]
   [junit4]   2> 1687271 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6eff07cb
   [junit4]   2> 1687271 INFO  (searcherExecutor-8205-thread-1-processing-n:127.0.0.1:58284_solr x:managed_coll_shard2_replica1 s:shard2 c:managed_coll r:core_node2) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1] Registered new searcher Searcher@cb6ac63[managed_coll_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687271 INFO  (Thread-4477) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.managed_coll.shard2.replica1
   [junit4]   2> 1687270 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687272 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard1_replica1' using configuration from collection managed_coll
   [junit4]   2> 1687272 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [[managed_coll_shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node2/managed_coll_shard1_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node2/./managed_coll_shard1_replica1/data/]
   [junit4]   2> 1687279 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1687279 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1687279 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b310f0a[managed_coll_shard1_replica1] main]
   [junit4]   2> 1687280 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
   [junit4]   2> 1687280 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
   [junit4]   2> 1687281 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
   [junit4]   2> 1687281 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Current schema version 2 is already the latest
   [junit4]   2> 1687281 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1687282 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555264567913742336
   [junit4]   2> 1687282 INFO  (searcherExecutor-8209-thread-1-processing-n:127.0.0.1:58744_solr x:managed_coll_shard1_replica1 s:shard1 c:managed_coll r:core_node1) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1] Registered new searcher Searcher@1b310f0a[managed_coll_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687285 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1687285 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@ca4143c[managed_coll_shard1_replica1] main]
   [junit4]   2> 1687285 INFO  (searcherExecutor-8209-thread-1-processing-n:127.0.0.1:58744_solr x:managed_coll_shard1_replica1 s:shard1 c:managed_coll r:core_node1) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1] Registered new searcher Searcher@ca4143c[managed_coll_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687285 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ManagedIndexSchema Waiting up to 599 secs for 1 replicas to apply schema update version 2 for collection managed_coll
   [junit4]   2> 1687285 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 2 from ZooKeeper
   [junit4]   2> 1687287 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1687288 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.S.Request [managed_coll_shard2_replica1]  webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1687288 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ManagedIndexSchema Took 3.0ms for 1 replicas to apply schema update version 2 for collection managed_coll
   [junit4]   2> 1687288 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687288 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.S.Request [managed_coll_shard1_replica1]  webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=51
   [junit4]   2> 1687288 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 3 ms
   [junit4]   2> 1687289 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@637a9409
   [junit4]   2> 1687289 INFO  (Thread-4479) [n:127.0.0.1:58744_solr    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1687289 INFO  (qtp1629057392-17265) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.managed_coll.shard1.replica1
   [junit4]   2> 1687290 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.S.Request [managed_coll_shard1_replica1]  webapp=/solr path=/schema/fields/NumberedField_1 params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1687291 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.SchemaManager managed schema loaded . version : 2 
   [junit4]   2> 1687294 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687295 INFO  (Thread-4479) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1687296 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687298 INFO  (Thread-4479) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687298 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.ZkController Persisted config data to node /configs/cloud-managed/managed-schema 
   [junit4]   2> 1687298 INFO  (Thread-4479) [n:127.0.0.1:58744_solr    ] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard1_replica1' using configuration from collection managed_coll
   [junit4]   2> 1687298 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1687299 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [[managed_coll_shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node2/managed_coll_shard1_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node2/./managed_coll_shard1_replica1/data/]
   [junit4]   2> 1687299 INFO  (Thread-4481) [n:127.0.0.1:58284_solr    ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard2_replica1
   [junit4]   2> 1687299 INFO  (Thread-4482) [n:127.0.0.1:58744_solr    ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard1_replica1
   [junit4]   2> 1687300 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1687305 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 3 from ZooKeeper
   [junit4]   2> 1687306 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1687308 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687309 INFO  (Thread-4481) [n:127.0.0.1:58284_solr    ] o.a.s.c.SolrCore core reload managed_coll_shard2_replica1
   [junit4]   2> 1687309 INFO  (Thread-4482) [n:127.0.0.1:58744_solr    ] o.a.s.c.SolrCore core reload managed_coll_shard1_replica1
   [junit4]   2> 1687315 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 10 ms
   [junit4]   2> 1687315 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1687315 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1687315 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b6b53d7[managed_coll_shard1_replica1] main]
   [junit4]   2> 1687316 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
   [junit4]   2> 1687317 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
   [junit4]   2> 1687317 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
   [junit4]   2> 1687317 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 3 from ZooKeeper
   [junit4]   2> 1687318 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1687320 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687320 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 2 ms
   [junit4]   2> 1687320 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1687320 INFO  (searcherExecutor-8214-thread-1-processing-n:127.0.0.1:58744_solr x:managed_coll_shard1_replica1 s:shard1 c:managed_coll r:core_node1) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1] Registered new searcher Searcher@2b6b53d7[managed_coll_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687321 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1687325 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555264567958831104
   [junit4]   2> 1687327 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1687327 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@70454cea[managed_coll_shard1_replica1] main]
   [junit4]   2> 1687327 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2641fd83
   [junit4]   2> 1687327 INFO  (searcherExecutor-8214-thread-1-processing-n:127.0.0.1:58744_solr x:managed_coll_shard1_replica1 s:shard1 c:managed_coll r:core_node1) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1] Registered new searcher Searcher@70454cea[managed_coll_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687328 INFO  (Thread-4479) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.managed_coll.shard1.replica1
   [junit4]   2> 1687333 INFO  (Thread-4482) [n:127.0.0.1:58744_solr    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1687337 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687338 INFO  (Thread-4482) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1687340 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687340 INFO  (Thread-4482) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687341 INFO  (Thread-4482) [n:127.0.0.1:58744_solr    ] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard1_replica1' using configuration from collection managed_coll
   [junit4]   2> 1687341 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard2_replica1' using configuration from collection managed_coll
   [junit4]   2> 1687341 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [[managed_coll_shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node2/managed_coll_shard1_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node2/./managed_coll_shard1_replica1/data/]
   [junit4]   2> 1687342 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [[managed_coll_shard2_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node1/managed_coll_shard2_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node1/./managed_coll_shard2_replica1/data/]
   [junit4]   2> 1687349 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1687349 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1687349 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@42f4ad22[managed_coll_shard1_replica1] main]
   [junit4]   2> 1687350 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
   [junit4]   2> 1687350 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
   [junit4]   2> 1687350 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
   [junit4]   2> 1687350 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Current schema version 3 is already the latest
   [junit4]   2> 1687350 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1687350 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555264567985045504
   [junit4]   2> 1687353 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1687353 INFO  (searcherExecutor-8218-thread-1-processing-n:127.0.0.1:58744_solr x:managed_coll_shard1_replica1 s:shard1 c:managed_coll r:core_node1) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1] Registered new searcher Searcher@42f4ad22[managed_coll_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687353 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@73496892[managed_coll_shard1_replica1] main]
   [junit4]   2> 1687353 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@31f7eb17
   [junit4]   2> 1687353 INFO  (Thread-4482) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.managed_coll.shard1.replica1
   [junit4]   2> 1687354 INFO  (searcherExecutor-8218-thread-1-processing-n:127.0.0.1:58744_solr x:managed_coll_shard1_replica1 s:shard1 c:managed_coll r:core_node1) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1] Registered new searcher Searcher@73496892[managed_coll_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687357 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1687357 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1687357 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2ba1b78e[managed_coll_shard2_replica1] main]
   [junit4]   2> 1687358 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
   [junit4]   2> 1687358 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
   [junit4]   2> 1687358 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
   [junit4]   2> 1687359 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Current schema version 3 is already the latest
   [junit4]   2> 1687359 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1687359 INFO  (searcherExecutor-8219-thread-1-processing-n:127.0.0.1:58284_solr x:managed_coll_shard2_replica1 s:shard2 c:managed_coll r:core_node2) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1] Registered new searcher Searcher@2ba1b78e[managed_coll_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687359 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555264567994482688
   [junit4]   2> 1687362 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1687362 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3e3bb48f[managed_coll_shard2_replica1] main]
   [junit4]   2> 1687362 INFO  (searcherExecutor-8219-thread-1-processing-n:127.0.0.1:58284_solr x:managed_coll_shard2_replica1 s:shard2 c:managed_coll r:core_node2) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1] Registered new searcher Searcher@3e3bb48f[managed_coll_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687362 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 3 from ZooKeeper
   [junit4]   2> 1687364 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687365 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ManagedIndexSchema Waiting up to 599 secs for 1 replicas to apply schema update version 3 for collection managed_coll
   [junit4]   2> 1687366 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687366 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 3 ms
   [junit4]   2> 1687370 INFO  (qtp1629057392-17261) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.S.Request [managed_coll_shard1_replica1]  webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=3&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1687373 INFO  (Thread-4481) [n:127.0.0.1:58284_solr    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1687376 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ManagedIndexSchema Took 11.0ms for 1 replicas to apply schema update version 3 for collection managed_coll
   [junit4]   2> 1687376 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.S.Request [managed_coll_shard2_replica1]  webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=85
   [junit4]   2> 1687390 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@202478bc
   [junit4]   2> 1687390 INFO  (qtp1797133402-17254) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.managed_coll.shard2.replica1
   [junit4]   2> 1687391 INFO  (qtp1797133402-17252) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.S.Request [managed_coll_shard2_replica1]  webapp=/solr path=/schema/fields/NumberedField_2 params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1687392 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.SchemaManager managed schema loaded . version : 3 
   [junit4]   2> 1687393 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1687393 INFO  (Thread-4481) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687395 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687396 INFO  (Thread-4481) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687396 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.ZkController Persisted config data to node /configs/cloud-managed/managed-schema 
   [junit4]   2> 1687396 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1687397 INFO  (Thread-4481) [n:127.0.0.1:58284_solr    ] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard2_replica1' using configuration from collection managed_coll
   [junit4]   2> 1687397 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/cloud-managed/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1687397 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [[managed_coll_shard2_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node1/managed_coll_shard2_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node1/./managed_coll_shard2_replica1/data/]
   [junit4]   2> 1687397 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 4 from ZooKeeper
   [junit4]   2> 1687398 INFO  (Thread-4483) [n:127.0.0.1:58744_solr    ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard1_replica1
   [junit4]   2> 1687398 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687400 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687401 INFO  (zkCallback-2913-thread-1-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 4 ms
   [junit4]   2> 1687401 INFO  (Thread-4484) [n:127.0.0.1:58284_solr    ] o.a.s.c.SolrCore config update listener called for core managed_coll_shard2_replica1
   [junit4]   2> 1687405 INFO  (Thread-4483) [n:127.0.0.1:58744_solr    ] o.a.s.c.SolrCore core reload managed_coll_shard1_replica1
   [junit4]   2> 1687405 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1687405 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1687405 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5018ca7c[managed_coll_shard2_replica1] main]
   [junit4]   2> 1687407 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1687408 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
   [junit4]   2> 1687409 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
   [junit4]   2> 1687409 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
   [junit4]   2> 1687409 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 4 from ZooKeeper
   [junit4]   2> 1687410 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687412 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687412 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 3 ms
   [junit4]   2> 1687412 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1687412 INFO  (searcherExecutor-8227-thread-1-processing-n:127.0.0.1:58284_solr x:managed_coll_shard2_replica1 s:shard2 c:managed_coll r:core_node2) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1] Registered new searcher Searcher@5018ca7c[managed_coll_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687412 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555264568050057216
   [junit4]   2> 1687414 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1687415 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1687415 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3c0bc1b8[managed_coll_shard2_replica1] main]
   [junit4]   2> 1687415 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@202b8da3
   [junit4]   2> 1687415 INFO  (Thread-4481) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.managed_coll.shard2.replica1
   [junit4]   2> 1687415 INFO  (searcherExecutor-8227-thread-1-processing-n:127.0.0.1:58284_solr x:managed_coll_shard2_replica1 s:shard2 c:managed_coll r:core_node2) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.SolrCore [managed_coll_shard2_replica1] Registered new searcher Searcher@3c0bc1b8[managed_coll_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687416 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687416 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.CoreContainer Reloading SolrCore 'managed_coll_shard1_replica1' using configuration from collection managed_coll
   [junit4]   2> 1687417 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [[managed_coll_shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node2/managed_coll_shard1_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.schema.ManagedSchemaRoundRobinCloudTest_AF8C940784BE92F6-001/tempDir-001/node2/./managed_coll_shard1_replica1/data/]
   [junit4]   2> 1687424 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1687424 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1687424 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@637c2a19[managed_coll_shard1_replica1] main]
   [junit4]   2> 1687424 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cloud-managed
   [junit4]   2> 1687425 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cloud-managed
   [junit4]   2> 1687425 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cloud-managed/managed-schema
   [junit4]   2> 1687429 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Current schema version 4 is already the latest
   [junit4]   2> 1687429 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1687430 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555264568068931584
   [junit4]   2> 1687432 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1687432 INFO  (searcherExecutor-8231-thread-1-processing-n:127.0.0.1:58744_solr x:managed_coll_shard1_replica1 s:shard1 c:managed_coll r:core_node1) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1] Registered new searcher Searcher@637c2a19[managed_coll_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687433 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@60abf1dc[managed_coll_shard1_replica1] main]
   [junit4]   2> 1687433 INFO  (searcherExecutor-8231-thread-1-processing-n:127.0.0.1:58744_solr x:managed_coll_shard1_replica1 s:shard1 c:managed_coll r:core_node1) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1] Registered new searcher Searcher@60abf1dc[managed_coll_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1687433 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ManagedIndexSchema Waiting up to 599 secs for 1 replicas to apply schema update version 4 for collection managed_coll
   [junit4]   2> 1687438 INFO  (qtp1797133402-17247) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.c.S.Request [managed_coll_shard2_replica1]  webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=4&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1687439 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.s.ManagedIndexSchema Took 5.0ms for 1 replicas to apply schema update version 4 for collection managed_coll
   [junit4]   2> 1687439 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.S.Request [managed_coll_shard1_replica1]  webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=47
   [junit4]   2> 1687439 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.SolrCore [managed_coll_shard1_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6967a800
   [junit4]   2> 1687439 INFO  (qtp1629057392-17258) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.managed_coll.shard1.replica1
   [junit4]   2> 1687439 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 4 from ZooKeeper
   [junit4]   2> 1687440 INFO  (qtp1629057392-17259) [n:127.0.0.1:58744_solr c:managed_coll s:shard1 r:core_node1 x:managed_coll_shard1_replica1] o.a.s.c.S.Request [managed_coll_shard1_replica1]  webapp=/solr path=/schema/fields/NumberedField_3 params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1687441 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema [managed_coll_shard1_replica1] Schema name=minimal
   [junit4]   2> 1687443 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687443 INFO  (zkCallback-2914-thread-2-processing-n:127.0.0.1:58744_solr) [n:127.0.0.1:58744_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 3 ms
   [junit4]   2> 1687444 INFO  (qtp1797133402-17253) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.SchemaManager managed schema loaded . version : 4 
   [junit4]   2> 1687444 INFO  (Thread-4483) [n:127.0.0.1:58744_solr    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1687445 INFO  (qtp1797133402-17253) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema [managed_coll_shard2_replica1] Schema name=minimal
   [junit4]   2> 1687447 INFO  (qtp1797133402-17253) [n:127.0.0.1:58284_solr c:managed_coll s:shard2 r:core_node2 x:managed_coll_shard2_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1687449 INFO  (zkCallback-2913-thread-2-processing-n:127.0.0.1:58284_solr) [n:127.0.0.1:58284_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChang

[...truncated too long message...]

8744_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:58744_solr
   [junit4]   2> 1689475 INFO  (Thread-4458) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60757 60757
   [junit4]   2> 1689477 WARN  (Thread-4458) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	26	/solr/configs/cloud-managed/managed-schema
   [junit4]   2> 	22	/solr/configs/cloud-managed
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/collections/managed_coll/state.json
   [junit4]   2> 	2	/solr/configs/cloud-managed/managed-schema
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/overseer/queue
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 	3	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 1689478 INFO  (SUITE-ManagedSchemaRoundRobinCloudTest-seed#[AF8C940784BE92F6]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Dec 31, 2016 8:24:35 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> Dec 31, 2016 8:24:55 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest: 
   [junit4]   2>    1) Thread[id=17425, name=OverseerHdfsCoreFailoverThread-97204035233447942-127.0.0.1:58744_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Dec 31, 2016 8:24:55 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=17425, name=OverseerHdfsCoreFailoverThread-97204035233447942-127.0.0.1:58744_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]   2> Dec 31, 2016 8:24:55 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1654, maxMBSortInHeap=6.743203171192441, sim=RandomSimilarity(queryNorm=true): {}, locale=es-CU, timezone=Asia/Macau
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=1,free=172456504,total=531628032
   [junit4]   2> NOTE: All tests run in this JVM: [SimpleMLTQParserTest, TestConfigSetProperties, TestDefaultStatsCache, TestClusterProperties, SSLMigrationTest, InfoHandlerTest, TestSimpleTrackingShardHandler, TestConfigReload, TestReloadAndDeleteDocs, HdfsTlogReplayBufferedWhileIndexingTest, TestSQLHandlerNonCloud, TermVectorComponentTest, TestFieldResource, UpdateRequestProcessorFactoryTest, DOMUtilTest, HighlighterTest, TestHashPartitioner, ZkStateWriterTest, EnumFieldTest, TestDistributedGrouping, TestLockTree, TestDocBasedVersionConstraints, ShufflingReplicaListTransformerTest, ClassificationUpdateProcessorFactoryTest, TestCoreContainer, TestSchemaManager, TestCursorMarkWithoutUniqueKey, TestPKIAuthenticationPlugin, OverseerCollectionConfigSetProcessorTest, BigEndianAscendingWordDeserializerTest, CachingDirectoryFactoryTest, MergeStrategyTest, TermsComponentTest, DocValuesTest, BlockDirectoryTest, TestWordDelimiterFilterFactory, CollectionsAPIAsyncDistributedZkTest, TestSolrCloudWithDelegationTokens, TestSolrQueryParserResource, TestFilteredDocIdSet, TestLegacyFieldCache, WrapperMergePolicyFactoryTest, AnalyticsMergeStrategyTest, HdfsChaosMonkeyNothingIsSafeTest, ShardRoutingTest, RulesTest, TestMiniSolrCloudClusterSSL, AliasIntegrationTest, TestFieldCacheReopen, HdfsNNFailoverTest, DistribJoinFromCollectionTest, TestUpdate, TestFreeTextSuggestions, TestNonDefinedSimilarityFactory, TestRandomRequestDistribution, TestAuthenticationFramework, DistributedSuggestComponentTest, HighlighterMaxOffsetTest, TimeZoneUtilsTest, ExplicitHLLTest, TestManagedSynonymFilterFactory, FileUtilsTest, TestFieldCacheSortRandom, TestAddFieldRealTimeGet, DistanceUnitsTest, CdcrUpdateLogTest, TestBackupRepositoryFactory, TestSolrCLIRunExample, HdfsRestartWhileUpdatingTest, AlternateDirectoryTest, IndexBasedSpellCheckerTest, CloneFieldUpdateProcessorFactoryTest, TestSolrDynamicMBean, TestMacros, TestStressCloudBlindAtomicUpdates, DirectSolrSpellCheckerTest, TestCloudPivotFacet, BaseCdcrDistributedZkTest, TestElisionMultitermQuery, ParsingFieldUpdateProcessorsTest, TestDynamicFieldCollectionResource, VersionInfoTest, TestExactStatsCache, TestCustomStream, IndexSchemaTest, ReplicationFactorTest, SimplePostToolTest, HdfsLockFactoryTest, JvmMetricsTest, TestInfoStreamLogging, SuggesterFSTTest, TestFiltering, OpenCloseCoreStressTest, ClusterStateUpdateTest, BasicFunctionalityTest, VMParamsZkACLAndCredentialsProvidersTest, DirectSolrConnectionTest, ZkControllerTest, TestMissingGroups, BJQParserTest, DistributedMLTComponentTest, TestMinMaxOnMultiValuedField, SpatialFilterTest, HttpSolrCallGetCoreTest, MultiThreadedOCPTest, ShardRoutingCustomTest, DeleteStatusTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, TestReplicationHandler, TestDistributedSearch, SolrCoreTest, SolrCmdDistributorTest, ConvertedLegacyTest, TestBadConfig, TestIndexSearcher, CurrencyFieldOpenExchangeTest, SolrIndexSplitterTest, TestExtendedDismaxParser, TestTrie, TestCSVLoader, WordBreakSolrSpellCheckerTest, TestPseudoReturnFields, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, StandardRequestHandlerTest, TestQueryTypes, XmlUpdateRequestHandlerTest, TestIndexingPerformance, TestSolrQueryParser, LoggingHandlerTest, TestCSVResponseWriter, TestAnalyzedSuggestions, TestComponentsName, TestQuerySenderListener, ResponseLogComponentTest, BadComponentTest, TestSolrDeletionPolicy2, SampleTest, TestBinaryField, TestSearchPerf, OutputWriterTest, TestFuzzyAnalyzedSuggestions, TestPostingsSolrHighlighter, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, PluginInfoTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, AssignTest, AsyncCallRequestStatusResponseTest, CollectionsAPISolrJTest, DocValuesNotIndexedTest, LeaderFailureAfterFreshStartTest, LeaderInitiatedRecoveryOnShardRestartTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerStatusTest, PeerSyncReplicationTest, TestConfigSetsAPIExclusivity, TestConfigSetsAPIZkFailure, TestDeleteCollectionOnDownNodes, TestExclusionRuleCollectionAccess, TestLeaderElectionWithEmptyReplica, TestOnReconnectListenerSupport, TestRandomFlRTGCloud, TestRequestForwarding, TestSSLRandomization, TestSegmentSorting, TestShortCircuitedRequests, TestSizeLimitedDistributedMap, TlogReplayBufferedWhileIndexingTest, HdfsBasicDistributedZkTest, HdfsCollectionsAPIDistributedZkTest, HdfsRecoverLeaseTest, RuleEngineTest, ExitableDirectoryReaderTest, QueryResultKeyTest, TestConfigSetImmutable, TestImplicitCoreProperties, TestSolrConfigHandler, TestSolrCoreSnapshots, RequestLoggingTest, TestHdfsBackupRestoreCore, TestReplicationHandlerBackup, TestSolrConfigHandlerCloud, DistributedQueryComponentCustomSortTest, TestExpandComponent, TestPivotHelperCode, TestTrackingShardHandlerFactory, SolrCoreMetricManagerTest, SolrMetricReporterTest, SolrGraphiteReporterTest, SolrJmxReporterTest, TestMacroExpander, TestBinaryResponseWriter, TestCustomDocTransformer, TestExportWriter, TestGeoJSONResponseWriter, TestRawResponseWriter, TestChildDocTransformer, TestManagedResourceStorage, TestRestManager, TestCopyFieldCollectionResource, TestDynamicFieldResource, TestFieldTypeResource, TestSchemaNameResource, TestSchemaVersionResource, TestSolrQueryParserDefaultOperatorResource, TestUniqueKeyFieldResource, TestManagedStopFilterFactory, ChangedSchemaMergeTest, DocValuesMissingTest, ManagedSchemaRoundRobinCloudTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ManagedSchemaRoundRobinCloudTest -Dtests.seed=AF8C940784BE92F6 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=es-CU -Dtests.timezone=Asia/Macau -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J1 | ManagedSchemaRoundRobinCloudTest (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.schema.ManagedSchemaRoundRobinCloudTest: 
   [junit4]    >    1) Thread[id=17425, name=OverseerHdfsCoreFailoverThread-97204035233447942-127.0.0.1:58744_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([AF8C940784BE92F6]:0)
   [junit4] Completed [624/673 (1!)] on J1 in 26.37s, 1 test, 1 error <<< FAILURES!

[...truncated 62556 lines...]