You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/03/24 17:09:29 UTC
[JENKINS-Experimental-GC] Lucene-Solr-master-Linux
(64bit/jdk-13.0.2) - Build # 26107 - Failure!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/26107/
Java: 64bit/jdk-13.0.2 -XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseShenandoahGC -XX:ShenandoahCodeRootsStyle=1
1 tests failed.
FAILED: org.apache.solr.search.facet.TestCloudJSONFacetSKG.testRandom
Error Message:
Java heap space
Stack Trace:
java.lang.OutOfMemoryError: Java heap space
at __randomizedtesting.SeedInfo.seed([D1F70FAC65F86ABA:A3BB2AA3D498DCC9]:0)
at java.base/java.util.Arrays.copyOf(Arrays.java:3746)
at java.base/java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:227)
at java.base/java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:808)
at java.base/java.lang.StringBuilder.append(StringBuilder.java:239)
at org.apache.solr.common.util.NamedList.toString(NamedList.java:410)
at java.base/java.lang.String.valueOf(String.java:3352)
at java.base/java.lang.StringBuilder.append(StringBuilder.java:166)
at org.apache.solr.common.util.NamedList.toString(NamedList.java:408)
at java.base/java.lang.StringConcatHelper.stringOf(StringConcatHelper.java:439)
at java.base/java.lang.invoke.DirectMethodHandle$Holder.invokeStatic(DirectMethodHandle$Holder)
at java.base/java.lang.invoke.LambdaForm$MH/0x00007f8ef51038b0.invoke(LambdaForm$MH)
at java.base/java.lang.invoke.Invokers$Holder.linkToTargetMethod(Invokers$Holder)
at org.apache.solr.search.facet.TestCloudJSONFacetSKG.assertFacetSKGsAreCorrect(TestCloudJSONFacetSKG.java:371)
at org.apache.solr.search.facet.TestCloudJSONFacetSKG.assertFacetSKGsAreCorrect(TestCloudJSONFacetSKG.java:349)
at org.apache.solr.search.facet.TestCloudJSONFacetSKG.testRandom(TestCloudJSONFacetSKG.java:274)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
Build Log:
[...truncated 15576 lines...]
[junit4] Suite: org.apache.solr.search.facet.TestCloudJSONFacetSKG
[junit4] 2> 1171610 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/solr/configsets/_default/conf'
[junit4] 2> 1171610 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1171610 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKG_D1F70FAC65F86ABA-001/data-dir-138-001
[junit4] 2> 1171610 WARN (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
[junit4] 2> 1171610 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1171611 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 1171612 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKG_D1F70FAC65F86ABA-001/tempDir-001
[junit4] 2> 1171612 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1171625 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1171625 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1171725 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:43881
[junit4] 2> 1171725 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:43881
[junit4] 2> 1171725 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:43881
[junit4] 2> 1171726 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 43881
[junit4] 2> 1171753 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1171797 INFO (zkConnectionManagerCallback-10458-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1171797 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1171882 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1171884 INFO (zkConnectionManagerCallback-10460-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1171884 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1171903 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1171944 INFO (zkConnectionManagerCallback-10462-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1171944 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1172160 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1172160 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 1172160 INFO (jetty-launcher-10463-thread-1) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
[junit4] 2> 1172163 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1172163 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 1172164 INFO (jetty-launcher-10463-thread-2) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
[junit4] 2> 1172281 INFO (jetty-launcher-10463-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1172281 INFO (jetty-launcher-10463-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1172281 INFO (jetty-launcher-10463-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1172294 INFO (jetty-launcher-10463-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3b57b5a5{/solr,null,AVAILABLE}
[junit4] 2> 1172345 INFO (jetty-launcher-10463-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1172345 INFO (jetty-launcher-10463-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1172345 INFO (jetty-launcher-10463-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1172351 INFO (jetty-launcher-10463-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@27a17a1f{/solr,null,AVAILABLE}
[junit4] 2> 1172373 INFO (jetty-launcher-10463-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@18a9b1c5{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:35253}
[junit4] 2> 1172373 INFO (jetty-launcher-10463-thread-2) [ ] o.e.j.s.Server Started @1172394ms
[junit4] 2> 1172373 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35253}
[junit4] 2> 1172374 ERROR (jetty-launcher-10463-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1172374 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1172374 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 1172374 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1172374 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr
[junit4] 2> 1172374 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-03-24T17:02:31.661336Z
[junit4] 2> 1172392 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1172417 INFO (jetty-launcher-10463-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3569cec6{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:42091}
[junit4] 2> 1172417 INFO (jetty-launcher-10463-thread-1) [ ] o.e.j.s.Server Started @1172438ms
[junit4] 2> 1172417 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42091}
[junit4] 2> 1172418 ERROR (jetty-launcher-10463-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1172418 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1172418 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 1172418 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1172418 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr
[junit4] 2> 1172418 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-03-24T17:02:31.705307Z
[junit4] 2> 1172433 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1172448 INFO (zkConnectionManagerCallback-10465-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1172448 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1172468 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1172484 INFO (zkConnectionManagerCallback-10467-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1172484 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1172521 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1172634 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1172635 WARN (jetty-launcher-10463-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7e9bb7cd[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1172635 WARN (jetty-launcher-10463-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7e9bb7cd[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1172678 WARN (jetty-launcher-10463-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@71da0f73[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1172678 WARN (jetty-launcher-10463-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@71da0f73[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1172679 INFO (jetty-launcher-10463-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43881/solr
[junit4] 2> 1172689 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1172702 INFO (zkConnectionManagerCallback-10474-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1172702 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1172735 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1172743 WARN (jetty-launcher-10463-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4ac15d01[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1172743 WARN (jetty-launcher-10463-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4ac15d01[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1172761 WARN (jetty-launcher-10463-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@21b5f36f[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1172761 WARN (jetty-launcher-10463-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@21b5f36f[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1172762 INFO (jetty-launcher-10463-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43881/solr
[junit4] 2> 1172781 INFO (jetty-launcher-10463-thread-2) [n:127.0.0.1:35253_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1172789 INFO (zkConnectionManagerCallback-10483-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1172789 INFO (jetty-launcher-10463-thread-2) [n:127.0.0.1:35253_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1172802 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42091_solr
[junit4] 2> 1172803 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.c.Overseer Overseer (id=72103095763337221-127.0.0.1:42091_solr-n_0000000000) starting
[junit4] 2> 1172809 INFO (jetty-launcher-10463-thread-2) [n:127.0.0.1:35253_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35253_solr
[junit4] 2> 1172811 INFO (jetty-launcher-10463-thread-2) [n:127.0.0.1:35253_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1172811 WARN (jetty-launcher-10463-thread-2) [n:127.0.0.1:35253_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1172815 INFO (OverseerStateUpdate-72103095763337221-127.0.0.1:42091_solr-n_0000000000) [n:127.0.0.1:42091_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:42091_solr
[junit4] 2> 1172815 INFO (OverseerStateUpdate-72103095763337221-127.0.0.1:42091_solr-n_0000000000) [n:127.0.0.1:42091_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1172848 INFO (zkCallback-10482-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1172859 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:42091_solr as DOWN
[junit4] 2> 1172861 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 1172861 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42091_solr
[junit4] 2> 1172864 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1172864 WARN (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1172866 INFO (zkCallback-10482-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1172866 INFO (jetty-launcher-10463-thread-2) [n:127.0.0.1:35253_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1172873 INFO (zkCallback-10473-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1172901 INFO (jetty-launcher-10463-thread-2) [n:127.0.0.1:35253_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35253.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b3a15b9
[junit4] 2> 1172907 INFO (jetty-launcher-10463-thread-2) [n:127.0.0.1:35253_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35253.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b3a15b9
[junit4] 2> 1172907 INFO (jetty-launcher-10463-thread-2) [n:127.0.0.1:35253_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35253.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b3a15b9
[junit4] 2> 1172908 INFO (jetty-launcher-10463-thread-2) [n:127.0.0.1:35253_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKG_D1F70FAC65F86ABA-001/tempDir-001/node2/.
[junit4] 2> 1172910 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1172930 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42091.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b3a15b9
[junit4] 2> 1172945 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42091.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b3a15b9
[junit4] 2> 1172945 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42091.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b3a15b9
[junit4] 2> 1172948 INFO (jetty-launcher-10463-thread-1) [n:127.0.0.1:42091_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKG_D1F70FAC65F86ABA-001/tempDir-001/node1/.
[junit4] 2> 1172993 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
[junit4] 2> 1173025 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1173037 INFO (zkConnectionManagerCallback-10494-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1173037 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1173039 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1173040 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43881/solr ready
[junit4] 2> 1173435 INFO (qtp307354293-34882) [n:127.0.0.1:35253_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params property.schema=schema_latest.xml&property.config=solrconfig-tlog.xml&collection.configName=org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set&name=org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1173462 INFO (OverseerThreadFactory-10010-thread-1-processing-n:127.0.0.1:42091_solr) [n:127.0.0.1:42091_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection
[junit4] 2> 1173572 INFO (OverseerStateUpdate-72103095763337221-127.0.0.1:42091_solr-n_0000000000) [n:127.0.0.1:42091_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:42091/solr",
[junit4] 2> "node_name":"127.0.0.1:42091_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1173573 INFO (OverseerStateUpdate-72103095763337221-127.0.0.1:42091_solr-n_0000000000) [n:127.0.0.1:42091_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:35253/solr",
[junit4] 2> "node_name":"127.0.0.1:35253_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1173832 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set&newCollection=true&collection=org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection&version=2&replicaType=NRT&property.schema=schema_latest.xml&property.config=solrconfig-tlog.xml&coreNodeName=core_node4&name=org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2&action=CREATE&numShards=2&shard=shard2&wt=javabin
[junit4] 2> 1173832 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 1173850 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set&newCollection=true&collection=org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection&version=2&replicaType=NRT&property.schema=schema_latest.xml&property.config=solrconfig-tlog.xml&coreNodeName=core_node3&name=org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin
[junit4] 2> 1173875 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1173881 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1173902 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.s.IndexSchema Schema name=example
[junit4] 2> 1173902 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=example
[junit4] 2> 1174220 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.s.IndexSchema Loaded schema example/1.6 with uniqueid field id
[junit4] 2> 1174225 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema example/1.6 with uniqueid field id
[junit4] 2> 1174249 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2' using configuration from configset org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set, trusted=true
[junit4] 2> 1174249 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35253.solr.core.org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection.shard2.replica_n2' (registry 'solr.core.org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b3a15b9
[junit4] 2> 1174249 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.SolrCore [[org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKG_D1F70FAC65F86ABA-001/tempDir-001/node2/./org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKG_D1F70FAC65F86ABA-001/tempDir-001/node2/./org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2/data/]
[junit4] 2> 1174256 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1' using configuration from configset org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set, trusted=true
[junit4] 2> 1174256 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42091.solr.core.org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection.shard1.replica_n1' (registry 'solr.core.org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b3a15b9
[junit4] 2> 1174256 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKG_D1F70FAC65F86ABA-001/tempDir-001/node1/./org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKG_D1F70FAC65F86ABA-001/tempDir-001/node1/./org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1/data/]
[junit4] 2> 1174258 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1174260 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1174263 WARN (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 1174278 WARN (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 1174338 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1174338 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1174339 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1174339 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1174340 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=32, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8683043466060765]
[junit4] 2> 1174340 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@52c6743a[org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] main]
[junit4] 2> 1174347 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set
[junit4] 2> 1174347 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set
[junit4] 2> 1174348 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1174348 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1662065682557173760
[junit4] 2> 1174350 INFO (searcherExecutor-10018-thread-1-processing-n:127.0.0.1:42091_solr x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] Registered new searcher Searcher@52c6743a[org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1174353 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/terms/shard1 to Terms{values={core_node3=0}, version=0}
[junit4] 2> 1174353 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/leaders/shard1
[junit4] 2> 1174356 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1174356 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1174356 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:42091/solr/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1/
[junit4] 2> 1174356 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1174356 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy https://127.0.0.1:42091/solr/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1174356 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/leaders/shard1/leader after winning as /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/leader_elect/shard1/election/72103095763337221-core_node3-n_0000000000
[junit4] 2> 1174358 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1174358 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1174358 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:42091/solr/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1/ shard1
[junit4] 2> 1174395 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1174395 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1174396 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=32, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8683043466060765]
[junit4] 2> 1174397 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@30738619[org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] main]
[junit4] 2> 1174399 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set
[junit4] 2> 1174399 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set
[junit4] 2> 1174400 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1174400 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1662065682611699712
[junit4] 2> 1174403 INFO (searcherExecutor-10017-thread-1-processing-n:127.0.0.1:35253_solr x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.SolrCore [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] Registered new searcher Searcher@30738619[org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1174404 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/terms/shard2 to Terms{values={core_node4=0}, version=0}
[junit4] 2> 1174404 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/leaders/shard2
[junit4] 2> 1174406 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1174406 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1174406 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:35253/solr/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2/
[junit4] 2> 1174407 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1174407 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.SyncStrategy https://127.0.0.1:35253/solr/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2/ has no replicas
[junit4] 2> 1174407 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/leaders/shard2/leader after winning as /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/leader_elect/shard2/election/72103095763337222-core_node4-n_0000000000
[junit4] 2> 1174408 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:35253/solr/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2/ shard2
[junit4] 2> 1174514 INFO (zkCallback-10482-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1174514 INFO (zkCallback-10473-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1174516 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1174516 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1174520 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set&newCollection=true&collection=org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection&version=2&replicaType=NRT&property.schema=schema_latest.xml&property.config=solrconfig-tlog.xml&coreNodeName=core_node3&name=org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin} status=0 QTime=670
[junit4] 2> 1174520 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set&newCollection=true&collection=org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection&version=2&replicaType=NRT&property.schema=schema_latest.xml&property.config=solrconfig-tlog.xml&coreNodeName=core_node4&name=org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2&action=CREATE&numShards=2&shard=shard2&wt=javabin} status=0 QTime=689
[junit4] 2> 1174521 INFO (zkCallback-10482-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1174523 INFO (qtp307354293-34882) [n:127.0.0.1:35253_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1174528 INFO (zkCallback-10473-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1174630 INFO (zkCallback-10473-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1174630 INFO (zkCallback-10473-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1174630 INFO (zkCallback-10482-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1174630 INFO (zkCallback-10473-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1174630 INFO (zkCallback-10482-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1174630 INFO (qtp307354293-34882) [n:127.0.0.1:35253_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={property.schema=schema_latest.xml&property.config=solrconfig-tlog.xml&collection.configName=org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set&name=org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=1195
[junit4] 2> 1174631 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection failOnTimeout:true timeout (sec):330
[junit4] 2> 1174645 INFO (zkCallback-10482-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/state.json] for collection [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection] has occurred - updating... (live nodes size: [2])
[junit4] 1> replica:core_node3 rstate:active live:true
[junit4] 1> replica:core_node3 rstate:active live:true
[junit4] 1> replica:core_node4 rstate:active live:true
[junit4] 1> replica:core_node4 rstate:active live:true
[junit4] 1> no one is recoverying
[junit4] 1> no one is recoverying
[junit4] 1> replica:core_node3 rstate:active live:true
[junit4] 1> replica:core_node4 rstate:active live:true
[junit4] 1> no one is recoverying
[junit4] 1> replica:core_node3 rstate:active live:true
[junit4] 1> replica:core_node4 rstate:active live:true
[junit4] 1> no one is recoverying
[junit4] 2> 1174657 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection
[junit4] 2> 1174671 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/terms/shard1 to Terms{values={core_node3=1}, version=1}
[junit4] 2> 1174671 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0 (1662065682893766656)]} 0 3
[junit4] 2> 1174681 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1662065682906349568)]} 0 2
[junit4] 2> 1174685 INFO (qtp307354293-34892) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/terms/shard2 to Terms{values={core_node4=1}, version=1}
[junit4] 2> 1174685 INFO (qtp307354293-34892) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2 (1662065682908446720)]} 0 2
[junit4] 2> 1174687 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[3 (1662065682911592448)]} 0 1
[junit4] 2> 1174690 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[4 (1662065682915786752)]} 0 2
[junit4] 2> 1174692 INFO (qtp307354293-34882) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[5 (1662065682917883904)]} 0 0
[junit4] 2> 1174693 INFO (qtp307354293-34892) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[6 (1662065682918932480)]} 0 0
[junit4] 2> 1174694 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[7 (1662065682918932481)]} 0 0
[junit4] 2> 1174695 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[8 (1662065682919981056)]} 0 0
[junit4] 2> 1174697 INFO (qtp307354293-34882) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[9 (1662065682923126784)]} 0 0
[junit4] 2> 1174698 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[10 (1662065682924175360)]} 0 0
[junit4] 2> 1174699 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[11 (1662065682924175361)]} 0 0
[junit4] 2> 1174699 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[12 (1662065682925223936)]} 0 0
[junit4] 2> 1174700 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[13 (1662065682925223937)]} 0 0
[junit4] 2> 1174700 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[14 (1662065682926272512)]} 0 0
[junit4] 2> 1174701 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[15 (1662065682926272513)]} 0 0
[junit4] 2> 1174701 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[15 (1662065682927321088)]} 0 0
[junit4] 2> 1174701 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[16 (1662065682927321089)]} 0 0
[junit4] 2> 1174702 INFO (qtp307354293-34892) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[17 (1662065682928369664)]} 0 0
[junit4] 2> 1174703 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[18 (1662065682928369665)]} 0 0
[junit4] 2> 1174703 INFO (qtp307354293-34882) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[19 (1662065682929418240)]} 0 0
[junit4] 2> 1174704 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[20 (1662065682930466816)]} 0 0
[junit4] 2> 1174704 INFO (qtp307354293-34892) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[21 (1662065682930466816)]} 0 0
[junit4] 2> 1174705 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[22 (1662065682931515392)]} 0 0
[junit4] 2> 1174709 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[23 (1662065682934661120)]} 0 0
[junit4] 2> 1174710 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[24 (1662065682936758272)]} 0 0
[junit4] 2> 1174722 INFO (qtp307354293-34882) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[25 (1662065682948292608)]} 0 0
[junit4] 2> 1174724 INFO (qtp307354293-34892) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[26 (1662065682950389760)]} 0 0
[junit4] 2> 1174725 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[27 (1662065682952486912)]} 0 0
[junit4] 2> 1174726 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[28 (1662065682953535488)]} 0 0
[junit4] 2> 1174727 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[29 (1662065682954584064)]} 0 0
[junit4] 2> 1174728 INFO (qtp307354293-34882) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[30 (1662065682955632640)]} 0 0
[junit4] 2> 1174730 INFO (qtp307354293-34892) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[31 (1662065682957729792)]} 0 0
[junit4] 2> 1174731 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[32 (1662065682958778368)]} 0 0
[junit4] 2> 1174732 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[33 (1662065682959826944)]} 0 0
[junit4] 2> 1174733 INFO (qtp307354293-34882) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[33 (1662065682960875520)]} 0 0
[junit4] 2> 1174734 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[34 (1662065682961924096)]} 0 0
[junit4] 2> 1174735 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[35 (1662065682962972672)]} 0 0
[junit4] 2> 1174736 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[36 (1662065682962972673)]} 0 0
[junit4] 2> 1174736 INFO (qtp307354293-34892) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[37 (1662065682964021248)]} 0 0
[junit4] 2> 1174737 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[38 (1662065682965069824)]} 0 0
[junit4] 2> 1174738 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[39 (1662065682966118400)]} 0 0
[junit4] 2> 1174750 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[40 (1662065682977652736)]} 0 0
[junit4] 2> 1174752 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[41 (1662065682979749888)]} 0 0
[junit4] 2> 1174753 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[42 (1662065682981847040)]} 0 0
[junit4] 2> 1174754 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[43 (1662065682982895616)]} 0 0
[junit4] 2> 1174755 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[44 (1662065682983944192)]} 0 0
[junit4] 2> 1174756 INFO (qtp307354293-34882) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[45 (1662065682984992768)]} 0 0
[junit4] 2> 1174757 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[46 (1662065682986041344)]} 0 0
[junit4] 2> 1174758 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[47 (1662065682987089920)]} 0 0
[junit4] 2> 1174760 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[48 (1662065682988138496)]} 0 0
[junit4] 2> 1174761 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[49 (1662065682989187072)]} 0 0
[junit4] 2> 1174762 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[50 (1662065682991284224)]} 0 0
[junit4] 2> 1174779 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[51 (1662065683008061440)]} 0 0
[junit4] 2> 1174780 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[52 (1662065683009110016)]} 0 0
[junit4] 2> 1174782 INFO (qtp307354293-34892) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[53 (1662065683012255744)]} 0 0
[junit4] 2> 1174783 INFO (qtp1066509750-34889) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[54 (1662065683013304320)]} 0 0
[junit4] 2> 1174784 INFO (qtp1066509750-34891) [n:127.0.0.1:42091_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard1 r:core_node3 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[55 (1662065683014352896)]} 0 0
[junit4] 2> 1174795 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[56 (1662065683025887232)]} 0 0
[junit4] 2> 1174836 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1662065683068878848,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1174836 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1f27c313 commitCommandVersion:1662065683068878848
[junit4] 2> 1174842 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@645cd2f0[org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] main]
[junit4] 2> 1174843 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1174845 INFO (searcherExecutor-10017-thread-1-processing-n:127.0.0.1:35253_solr x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.c.SolrCore [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] Registered new searcher Searcher@645cd2f0[org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C23/1:[diagnostics={timestamp=1585069354128, java.vendor=AdoptOpenJDK, os=Linux, os.version=5.3.0-42-generic, java.runtime.version=13.0.2+8, os.arch=amd64, source=flush, lucene.version=9.0.0, java.vm.version=13.0.2+8, java.version=13.0.2}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=1)))}
[junit4] 2> 1174845 INFO (qtp307354293-34884) [n:127.0.0.1:35253_solr c:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection s:shard2 r:core_node4 x:org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=TOLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:42091/solr/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection_shard1_replica_n1/&commit_end_point=leaders&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 9
[junit4] 2> 1174846 INFO (qtp1066509750-34889) [n:127.0
[...truncated too long message...]
egistry solr.jvm / com.codahale.metrics.MetricRegistry@695c2cfa
[junit4] 2> 1189144 INFO (jetty-closer-10497-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1189144 INFO (jetty-closer-10497-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@68d103f8: rootName = solr_35253, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@11009608
[junit4] 2> 1189144 INFO (jetty-closer-10497-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1189165 INFO (closeThreadPool-10504-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72103095763337221-127.0.0.1:42091_solr-n_0000000000) closing
[junit4] 2> 1189201 INFO (zkCallback-10482-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1189301 INFO (jetty-closer-10497-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72103095763337221-127.0.0.1:42091_solr-n_0000000000) closing
[junit4] 2> 1189304 INFO (jetty-closer-10497-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@3569cec6{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:0}
[junit4] 2> 1189304 INFO (jetty-closer-10497-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@27a17a1f{/solr,null,UNAVAILABLE}
[junit4] 2> 1189304 INFO (jetty-closer-10497-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1189417 INFO (jetty-closer-10497-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@18a9b1c5{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:0}
[junit4] 2> 1189418 INFO (jetty-closer-10497-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3b57b5a5{/solr,null,UNAVAILABLE}
[junit4] 2> 1189418 INFO (jetty-closer-10497-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1189426 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1189642 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/terms/shard1
[junit4] 2> 3 /solr/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/terms/shard2
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 2 /solr/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/collectionprops.json
[junit4] 2> 2 /solr/packages.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/configs/org.apache.solr.search.facet.TestCloudJSONFacetSKG_config-set
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 25 /solr/collections/org.apache.solr.search.facet.TestCloudJSONFacetSKG_collection/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 17 /solr/overseer/queue
[junit4] 2> 8 /solr/live_nodes
[junit4] 2> 6 /solr/collections
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 1189645 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:43881
[junit4] 2> 1189645 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:43881
[junit4] 2> 1189645 INFO (SUITE-TestCloudJSONFacetSKG-seed#[D1F70FAC65F86ABA]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 43881
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.search.facet.TestCloudJSONFacetSKG_D1F70FAC65F86ABA-001
[junit4] 2> Mar 24, 2020 5:02:48 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@153cfe41), locale=en-VG, timezone=America/Louisville
[junit4] 2> NOTE: Linux 5.3.0-42-generic amd64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=16,threads=1,free=335487792,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [SSLMigrationTest, BooleanFieldTest, NestedShardedAtomicUpdateTest, SolrCoreTest, BasicFunctionalityTest, TestJsonFacets, AddReplicaTest, ReplaceNodeNoTargetTest, TestClusterStateMutator, DistributedSuggestComponentTest, TestAuthenticationFramework, TestSolrConfigHandlerCloud, TestSolrCloudWithSecureImpersonation, DistribCursorPagingTest, CloudExitableDirectoryReaderTest, TestCopyFieldCollectionResource, TestCloudManagedSchema, TestRetrieveFieldsOptimizer, TestSolrDeletionPolicy1, HLLUtilTest, TestHashPartitioner, TestConfigSetsAPI, TestQueryTypes, StatsComponentTest, TestSegmentSorting, TestPerFieldSimilarity, TestExportTool, TestQuerySenderListener, TestSolrTestCaseJ4, TestSolrCloudSnapshots, TestSimDistribStateManager, TestDistributedStatsComponentCardinality, TestFuzzyAnalyzedSuggestions, JavabinLoaderTest, ZkFailoverTest, TestSolrCoreParser, TestMultiWordSynonyms, DirectUpdateHandlerTest, TestCloudPivotFacet, TestManagedSchemaAPI, DistributedExpandComponentTest, TestTolerantUpdateProcessorCloud, TestJsonRequest, SolrCoreMetricManagerTest, XmlInterpolationTest, TestNumericRangeQuery32, SchemaVersionSpecificBehaviorTest, SortSpecParsingTest, TestDeprecatedFilters, CollectionsAPISolrJTest, MultiDestinationAuditLoggerTest, SolrJmxReporterTest, ChaosMonkeyNothingIsSafeTest, PeerSyncWithLeaderAndIndexFingerprintCachingTest, CircularListTest, MergeStrategyTest, SpellingQueryConverterTest, MissingSegmentRecoveryTest, TestStressLucene, DocValuesMissingTest, TestSubQueryTransformerCrossCore, OverseerRolesTest, DistributedFacetPivotWhiteBoxTest, TestBlobHandler, HdfsSyncSliceTest, MinimalSchemaTest, AtomicUpdateRemovalJavabinTest, HdfsChaosMonkeyNothingIsSafeTest, TestInPlaceUpdatesDistrib, TemplateUpdateProcessorTest, SolrIndexMetricsTest, TransactionLogTest, SuggesterWFSTTest, BigEndianAscendingWordDeserializerTest, TestGraphMLResponseWriter, HttpPartitionWithTlogReplicasTest, LegacyCloudClusterPropTest, MetricsHistoryIntegrationTest, MetricsHistoryWithAuthIntegrationTest, PackageManagerCLITest, RecoveryZkTest, SolrXmlInZkTest, SplitShardTest, TestDynamicFieldNamesIndexCorrectly, TestPrepRecovery, TestRebalanceLeaders, CollectionsAPIDistributedZkTest, NodeLostTriggerIntegrationTest, NodeMarkersRegistrationTest, ScheduledTriggerTest, SearchRateTriggerIntegrationTest, SearchRateTriggerTest, TriggerSetPropertiesIntegrationTest, TestSimTriggerIntegration, AlternateDirectoryTest, BlobRepositoryCloudTest, ByteBuffersDirectoryFactoryTest, ConfigureRecoveryStrategyTest, CoreSorterTest, DirectoryFactoryTest, ExitableDirectoryReaderTest, HdfsDirectoryFactoryTest, ResourceLoaderTest, SOLR749Test, TestConfigOverlay, TestConfigSetImmutable, TestCoreDiscovery, TestCustomStream, DocumentAnalysisRequestHandlerTest, JsonLoaderTest, PingRequestHandlerTest, XmlUpdateRequestHandlerTest, XsltUpdateRequestHandlerTest, AutoscalingHistoryHandlerTest, MetricsConfigTest, SimpleFacetsTest, SmileWriterTest, TestFieldTypeCollectionResource, TestSchemaVersionResource, TestManagedSynonymGraphFilterFactory, OpenExchangeRatesOrgProviderTest, PrimitiveFieldTypeTest, ResolveAnalyzerByNameTest, TestBulkSchemaConcurrent, TestStandardQParsers, TestSurroundQueryParser, TestTrieFacet, DistributedFacetSimpleRefinementLongTailTest, TestCloudJSONFacetSKG]
[junit4] Completed [801/907 (1!)] on J1 in 18.97s, 2 tests, 1 error <<< FAILURES!
[...truncated 369 lines...]
[junit4] JVM J1: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20200324_164259_24617992830030477300464.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: Java heap space
[junit4] Dumping heap to /home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps/java_pid20682.hprof ...
[junit4] Heap dump file created [203122302 bytes in 1.397 secs]
[junit4] <<< JVM J1: EOF ----
[...truncated 9589 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:635: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:587: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid20682.hprof
Total time: 38 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-11.0.6) - Build #
26108 - Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/26108/
Java: 64bit/jdk-11.0.6 -XX:-UseCompressedOops -XX:+UseG1GC
2 tests failed.
FAILED: org.apache.solr.cloud.SystemCollectionCompatTest.testBackCompat
Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:38615/solr/.system]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:38615/solr/.system]
at __randomizedtesting.SeedInfo.seed([DEC1D494FB86B66B:AE34773D9B4E1F1D]:0)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:345)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1143)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:906)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at org.apache.solr.cloud.SystemCollectionCompatTest.setupSystemCollection(SystemCollectionCompatTest.java:118)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:976)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occurred while waiting response from server at: https://127.0.0.1:38615/solr/.system
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:676)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
... 43 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:168)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:140)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:448)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:68)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1103)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:823)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:157)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:564)
... 47 more
FAILED: org.apache.solr.cloud.SystemCollectionCompatTest.testBackCompat
Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:41145/solr/.system]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:41145/solr/.system]
at __randomizedtesting.SeedInfo.seed([DEC1D494FB86B66B:AE34773D9B4E1F1D]:0)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:345)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1143)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:906)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at org.apache.solr.cloud.SystemCollectionCompatTest.setupSystemCollection(SystemCollectionCompatTest.java:118)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:976)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occurred while waiting response from server at: https://127.0.0.1:41145/solr/.system
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:676)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
... 43 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:168)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:140)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:448)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:68)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1103)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:823)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:157)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:564)
... 47 more
Build Log:
[...truncated 14559 lines...]
[junit4] Suite: org.apache.solr.cloud.SystemCollectionCompatTest
[junit4] 2> 591054 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/solr/configsets/_default/conf'
[junit4] 2> 591054 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 591054 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/data-dir-66-001
[junit4] 2> 591054 WARN (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=33 numCloses=33
[junit4] 2> 591054 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 591055 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 591055 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/tempDir-001
[junit4] 2> 591056 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 591056 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 591056 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 591156 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:43987
[junit4] 2> 591156 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:43987
[junit4] 2> 591156 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:43987
[junit4] 2> 591156 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 43987
[junit4] 2> 591157 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 591159 INFO (zkConnectionManagerCallback-4307-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 591159 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 591160 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 591161 INFO (zkConnectionManagerCallback-4309-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 591161 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 591161 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 591162 INFO (zkConnectionManagerCallback-4311-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 591162 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 591267 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 591267 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 591267 INFO (jetty-launcher-4312-thread-1) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.6+10
[junit4] 2> 591267 INFO (jetty-launcher-4312-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 591267 INFO (jetty-launcher-4312-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 591267 INFO (jetty-launcher-4312-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 591268 INFO (jetty-launcher-4312-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1bbdbe0f{/solr,null,AVAILABLE}
[junit4] 2> 591268 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 591268 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 591268 INFO (jetty-launcher-4312-thread-2) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.6+10
[junit4] 2> 591268 INFO (jetty-launcher-4312-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 591268 INFO (jetty-launcher-4312-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 591268 INFO (jetty-launcher-4312-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 591268 INFO (jetty-launcher-4312-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6564223a{/solr,null,AVAILABLE}
[junit4] 2> 591268 INFO (jetty-launcher-4312-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2545bf13{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:41145}
[junit4] 2> 591268 INFO (jetty-launcher-4312-thread-1) [ ] o.e.j.s.Server Started @591292ms
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41145}
[junit4] 2> 591269 ERROR (jetty-launcher-4312-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-03-24T18:51:09.048269Z
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5319731{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:42957}
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-2) [ ] o.e.j.s.Server Started @591292ms
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42957}
[junit4] 2> 591269 ERROR (jetty-launcher-4312-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr
[junit4] 2> 591269 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-03-24T18:51:09.048646Z
[junit4] 2> 591271 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 591271 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 591272 INFO (zkConnectionManagerCallback-4316-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 591272 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 591272 INFO (zkConnectionManagerCallback-4314-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 591272 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 591272 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 591272 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 591384 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 591385 WARN (jetty-launcher-4312-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@41a37b7e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 591385 WARN (jetty-launcher-4312-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@41a37b7e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 591386 WARN (jetty-launcher-4312-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@c5c0228[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 591386 WARN (jetty-launcher-4312-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@c5c0228[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 591387 INFO (jetty-launcher-4312-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43987/solr
[junit4] 2> 591387 INFO (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 591388 INFO (zkConnectionManagerCallback-4323-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 591388 INFO (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 591420 INFO (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42957_solr
[junit4] 2> 591420 INFO (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.c.Overseer Overseer (id=72103522919186437-127.0.0.1:42957_solr-n_0000000000) starting
[junit4] 2> 591422 INFO (OverseerStateUpdate-72103522919186437-127.0.0.1:42957_solr-n_0000000000) [n:127.0.0.1:42957_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:42957_solr
[junit4] 2> 591422 INFO (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42957_solr
[junit4] 2> 591423 INFO (zkCallback-4322-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 591423 INFO (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 591424 WARN (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 591431 INFO (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 591446 INFO (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42957.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@228baa76
[junit4] 2> 591453 INFO (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42957.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@228baa76
[junit4] 2> 591453 INFO (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42957.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@228baa76
[junit4] 2> 591454 INFO (jetty-launcher-4312-thread-2) [n:127.0.0.1:42957_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/tempDir-001/node2/.
[junit4] 2> 591484 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 591485 WARN (jetty-launcher-4312-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@570cd9a[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 591485 WARN (jetty-launcher-4312-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@570cd9a[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 591486 WARN (jetty-launcher-4312-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7bac96f0[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 591486 WARN (jetty-launcher-4312-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7bac96f0[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 591487 INFO (jetty-launcher-4312-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43987/solr
[junit4] 2> 591487 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 591488 INFO (zkConnectionManagerCallback-4334-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 591488 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 591490 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 591492 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:41145_solr as DOWN
[junit4] 2> 591492 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 591492 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41145_solr
[junit4] 2> 591493 INFO (zkCallback-4322-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 591493 INFO (zkCallback-4333-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 591493 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 591493 WARN (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 591499 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 591508 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41145.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@228baa76
[junit4] 2> 591513 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41145.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@228baa76
[junit4] 2> 591513 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41145.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@228baa76
[junit4] 2> 591514 INFO (jetty-launcher-4312-thread-1) [n:127.0.0.1:41145_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/tempDir-001/node1/.
[junit4] 2> 591526 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
[junit4] 2> 591526 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 591527 INFO (zkConnectionManagerCallback-4343-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 591527 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 591528 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 591528 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43987/solr ready
[junit4] 2> 591543 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[DEC1D494FB86B66B]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBackCompat
[junit4] 2> 591544 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[DEC1D494FB86B66B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 591545 INFO (zkConnectionManagerCallback-4348-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 591545 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[DEC1D494FB86B66B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 591546 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[DEC1D494FB86B66B]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 591546 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[DEC1D494FB86B66B]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43987/solr ready
[junit4] 2> 591558 INFO (qtp264895553-14961) [n:127.0.0.1:42957_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 591560 INFO (qtp264895553-14961) [n:127.0.0.1:42957_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 591568 INFO (qtp264895553-14963) [n:127.0.0.1:42957_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params maxShardsPerNode=2&name=.system&nrtReplicas=2&action=CREATE&numShards=1&createNodeSet=127.0.0.1:41145_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 591573 INFO (OverseerThreadFactory-4130-thread-2-processing-n:127.0.0.1:42957_solr) [n:127.0.0.1:42957_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection .system
[junit4] 2> 591573 INFO (OverseerCollectionConfigSetProcessor-72103522919186437-127.0.0.1:42957_solr-n_0000000000) [n:127.0.0.1:42957_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 591675 WARN (OverseerThreadFactory-4130-thread-2-processing-n:127.0.0.1:42957_solr) [n:127.0.0.1:42957_solr ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 2 on collection .system is higher than the number of Solr instances currently live or live and part of your createNodeSet(1). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 591678 INFO (OverseerStateUpdate-72103522919186437-127.0.0.1:42957_solr-n_0000000000) [n:127.0.0.1:42957_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41145/solr",
[junit4] 2> "node_name":"127.0.0.1:41145_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 591679 INFO (OverseerStateUpdate-72103522919186437-127.0.0.1:42957_solr-n_0000000000) [n:127.0.0.1:42957_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41145/solr",
[junit4] 2> "node_name":"127.0.0.1:41145_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 591889 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr x:.system_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 591889 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 591895 WARN (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrConfig You should not use LATEST as luceneMatchVersion property: if you use this setting, and then Solr upgrades to a newer release of Lucene, sizable changes may happen. If precise back compatibility is important then you should instead explicitly specify an actual Lucene version.
[junit4] 2> 591895 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 591895 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 591902 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 591902 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 591904 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=_system collection or core
[junit4] 2> 591904 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=_system collection or core
[junit4] 2> 591907 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 591907 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 591908 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
[junit4] 2> 591908 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
[junit4] 2> 591909 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from configset .system, trusted=true
[junit4] 2> 591909 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41145.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@228baa76
[junit4] 2> 591909 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/tempDir-001/node1/./.system_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/tempDir-001/node1/./.system_shard1_replica_n1/data/]
[junit4] 2> 591910 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
[junit4] 2> 591911 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n2' using configuration from configset .system, trusted=true
[junit4] 2> 591912 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41145.solr.core..system.shard1.replica_n2' (registry 'solr.core..system.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@228baa76
[junit4] 2> 591912 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [[.system_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/tempDir-001/node1/./.system_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/tempDir-001/node1/./.system_shard1_replica_n2/data/]
[junit4] 2> 591941 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 591941 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 591942 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs;
[junit4] 2> 591942 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 591943 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@87e4665[.system_shard1_replica_n1] main]
[junit4] 2> 591943 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 591944 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 591944 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 591944 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 591944 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 591944 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1662072515170664448
[junit4] 2> 591946 INFO (searcherExecutor-4144-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@87e4665[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 591946 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 591946 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 591947 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/.system/terms/shard1 to Terms{values={core_node3=0}, version=0}
[junit4] 2> 591947 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/.system/leaders/shard1
[junit4] 2> 591947 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs;
[junit4] 2> 591947 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 591964 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 591965 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@f63eff[.system_shard1_replica_n2] main]
[junit4] 2> 591966 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 591966 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 591966 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 591967 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
[junit4] 2> 591968 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=_system collection or core
[junit4] 2> 591971 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 591971 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 4 ms
[junit4] 2> 591971 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 591971 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1662072515198976000
[junit4] 2> 591973 INFO (searcherExecutor-4145-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@f63eff[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 591973 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/.system/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
[junit4] 2> 591973 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/.system/leaders/shard1
[junit4] 2> 592465 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 592465 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 592466 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:41145/solr/.system_shard1_replica_n1/
[junit4] 2> 592466 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n1 url=https://127.0.0.1:41145/solr START replicas=[https://127.0.0.1:41145/solr/.system_shard1_replica_n2/] nUpdates=100
[junit4] 2> 592466 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n1 url=https://127.0.0.1:41145/solr DONE. We have no versions. sync failed.
[junit4] 2> 592474 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 592475 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 592475 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 592475 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/.system/leaders/shard1/leader after winning as /collections/.system/leader_elect/shard1/election/72103522919186438-core_node3-n_0000000000
[junit4] 2> 592476 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:41145/solr/.system_shard1_replica_n1/ shard1
[junit4] 2> 592579 INFO (zkCallback-4333-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 592579 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 592582 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=692
[junit4] 2> 592682 INFO (zkCallback-4333-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 592682 INFO (zkCallback-4333-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 592976 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1086
[junit4] 2> 592977 INFO (qtp264895553-14963) [n:127.0.0.1:42957_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 593076 INFO (zkCallback-4333-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 593076 INFO (zkCallback-4333-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 593076 INFO (zkCallback-4322-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 593077 INFO (qtp264895553-14963) [n:127.0.0.1:42957_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={maxShardsPerNode=2&name=.system&nrtReplicas=2&action=CREATE&numShards=1&createNodeSet=127.0.0.1:41145_solr&wt=javabin&version=2} status=0 QTime=1508
[junit4] 2> 593077 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[DEC1D494FB86B66B]) [ ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: .system
[junit4] 2> 593088 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/.system/terms/shard1 to Terms{values={core_node3=1, core_node4=1}, version=2}
[junit4] 2> 593101 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [.system_shard1_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:41145/solr/.system_shard1_replica_n1/&wt=javabin&version=2}{add=[1710de25c89Tc1v1l21z3xid3s5h7o3eorz3c (1662072516368138240)]} 0 1
[junit4] 2> 593102 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [.system_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1710de25c89Tc1v1l21z3xid3s5h7o3eorz3c (1662072516368138240)]} 0 16
[junit4] 2> 593103 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1662072516385964032,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 593103 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5b1acf19 commitCommandVersion:1662072516385964032
[junit4] 2> 593104 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1662072516387012608,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 593104 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3df4af64 commitCommandVersion:1662072516387012608
[junit4] 2> 593108 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7c4db07e[.system_shard1_replica_n2] main]
[junit4] 2> 593108 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6cbdc31d[.system_shard1_replica_n1] main]
[junit4] 2> 593109 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 593109 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 593109 INFO (searcherExecutor-4144-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@6cbdc31d[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1:[diagnostics={os.version=5.3.0-42-generic, java.runtime.version=11.0.6+10, os.arch=amd64, source=flush, lucene.version=9.0.0, java.vm.version=11.0.6+10, java.version=11.0.6, timestamp=1585075870884, java.vendor=AdoptOpenJDK, os=Linux}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
[junit4] 2> 593110 INFO (searcherExecutor-4145-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@7c4db07e[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1:[diagnostics={os.version=5.3.0-42-generic, java.runtime.version=11.0.6+10, os.arch=amd64, source=flush, lucene.version=9.0.0, java.vm.version=11.0.6+10, java.version=11.0.6, timestamp=1585075870885, java.vendor=AdoptOpenJDK, os=Linux}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
[junit4] 2> 593111 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [.system_shard1_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:41145/solr/.system_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 6
[junit4] 2> 593111 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [.system_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=.system:5&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 8
[junit4] 2> 593121 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=true&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593122 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=true&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593124 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593127 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.SchemaManager managed schema loaded . version : 1
[junit4] 2> 593129 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=_system collection or core
[junit4] 2> 593132 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 593133 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ZkController Persisted config data to node /configs/.system/schema.xml.bak
[junit4] 2> 593133 INFO (Thread-2686) [ ] o.a.s.c.SolrCore config update listener called for core .system_shard1_replica_n1
[junit4] 2> 593134 INFO (Thread-2686) [ ] o.a.s.c.SolrCore core reload .system_shard1_replica_n1
[junit4] 2> 593136 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 593143 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=_system collection or core
[junit4] 2> 593146 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 593146 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.CoreContainer Reloading SolrCore '.system_shard1_replica_n1' using configuration from configset .system
[junit4] 2> 593178 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41145.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@228baa76
[junit4] 2> 593178 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/tempDir-001/node1/./.system_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/tempDir-001/node1/./.system_shard1_replica_n1/data/]
[junit4] 2> 593203 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs;
[junit4] 2> 593203 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 593204 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5c108dd1[.system_shard1_replica_n1] main]
[junit4] 2> 593205 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 593205 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 593205 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 593206 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593206 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 593208 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 593209 INFO (searcherExecutor-4154-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@5c108dd1[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1:[diagnostics={os.version=5.3.0-42-generic, java.runtime.version=11.0.6+10, os.arch=amd64, source=flush, lucene.version=9.0.0, java.vm.version=11.0.6+10, java.version=11.0.6, timestamp=1585075870884, java.vendor=AdoptOpenJDK, os=Linux}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
[junit4] 2> 593209 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4bfc2bab[.system_shard1_replica_n1] main]
[junit4] 2> 593211 INFO (searcherExecutor-4154-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@4bfc2bab[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1:[diagnostics={os.version=5.3.0-42-generic, java.runtime.version=11.0.6+10, os.arch=amd64, source=flush, lucene.version=9.0.0, java.vm.version=11.0.6+10, java.version=11.0.6, timestamp=1585075870884, os=Linux, java.vendor=AdoptOpenJDK}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
[junit4] 2> 593213 INFO (Thread-2686) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 593213 INFO (qtp800969827-14974) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Waiting up to 599 secs for 1 replicas to apply schema update version 2 for collection .system
[junit4] 2> 593219 INFO (Thread-2686) [ ] o.a.s.s.IndexSchema Schema name=_system collection or core
[junit4] 2> 593221 INFO (Thread-2686) [ ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 593221 INFO (Thread-2686) [ ] o.a.s.c.CoreContainer Reloading SolrCore '.system_shard1_replica_n1' using configuration from configset .system
[junit4] 2> 593231 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593232 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593232 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 593232 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593233 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593233 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593233 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593233 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593234 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593234 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593234 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593235 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593235 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593235 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593235 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593235 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593236 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593236 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593236 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593236 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593237 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593237 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593237 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593237 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593238 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593239 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593239 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593239 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593239 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593239 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593239 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593239 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593240 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593240 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593240 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593241 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593241 INFO (Thread-2686) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41145.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@228baa76
[junit4] 2> 593241 INFO (Thread-2686) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/tempDir-001/node1/./.system_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001/tempDir-001/node1/./.system_shard1_replica_n1/data/]
[junit4] 2> 593241 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593241 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593241 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593242 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593242 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593242 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593242 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593244 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593245 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593246 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593246 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593246 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593247 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593247 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593247 INFO (qtp800969827-14970) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593247 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593248 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 593248 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 593248 INFO (qtp800969827-14973) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 593248 ERROR (managedSchemaExecutor-4158-thread-1-processing-n:127.0.0.1:41145_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:41145/solr/.system_shard1_replica_n2/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 593249 INFO (qtp800969827-14971) [n:127.0.0.1:41145_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before return
[...truncated too long message...]
1 r:core_node4) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.s.ManagedIndexSchema Failed to get /schema/zkversion from https://127.0.0.1:38615/solr/.system_shard1_replica_n1/ due to: java.util.concurrent.ExecutionException: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:38615/solr/.system_shard1_replica_n1
[junit4] 2> 145614 WARN (managedSchemaExecutor-37-thread-1-processing-n:127.0.0.1:38615_solr x:.system_shard1_replica_n3 c:.system s:shard1 r:core_node4) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.s.ManagedIndexSchema Failed to get /schema/zkversion from https://127.0.0.1:38615/solr/.system_shard1_replica_n1/ due to: java.util.concurrent.ExecutionException: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:38615/solr/.system_shard1_replica_n1
[junit4] 2> 146638 WARN (managedSchemaExecutor-37-thread-1-processing-n:127.0.0.1:38615_solr x:.system_shard1_replica_n3 c:.system s:shard1 r:core_node4) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.s.ManagedIndexSchema Failed to get /schema/zkversion from https://127.0.0.1:38615/solr/.system_shard1_replica_n1/ due to: java.util.concurrent.ExecutionException: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:38615/solr/.system_shard1_replica_n1
[junit4] 2> 147666 WARN (managedSchemaExecutor-37-thread-1-processing-n:127.0.0.1:38615_solr x:.system_shard1_replica_n3 c:.system s:shard1 r:core_node4) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.s.ManagedIndexSchema Failed to get /schema/zkversion from https://127.0.0.1:38615/solr/.system_shard1_replica_n1/ due to: java.util.concurrent.ExecutionException: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:38615/solr/.system_shard1_replica_n1
[junit4] 2> 148139 INFO (httpUriRequest-341743-thread-1-processing-x:.system_shard1_replica_n3 r:core_node4 n:127.0.0.1:38615_solr https:////127.0.0.1:38615//solr//.system_shard1_replica_n1 c:.system s:shard1) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.h.i.e.RetryExec I/O exception (java.net.SocketException) caught when processing request to {s}->https://127.0.0.1:38615: Socket closed
[junit4] 2> 148139 INFO (httpUriRequest-341743-thread-1-processing-x:.system_shard1_replica_n3 r:core_node4 n:127.0.0.1:38615_solr https:////127.0.0.1:38615//solr//.system_shard1_replica_n1 c:.system s:shard1) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.h.i.e.RetryExec Retrying request to {s}->https://127.0.0.1:38615
[junit4] 2> 148141 WARN (qtp2089059441-155) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.s.ManagedIndexSchema Core core_node4 was interrupted waiting for schema version 2 to propagate to 1 replicas for collection .system
[junit4] 2> 148141 INFO (qtp2089059441-155) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.s.ManagedIndexSchema Took 135210.0ms for 1 replicas to apply schema update version 2 for collection .system
[junit4] 2> 148141 INFO (qtp2089059441-155) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.c.S.Request [.system_shard1_replica_n3] webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=135903
[junit4] 2> 148141 INFO (qtp2089059441-155) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.c.SolrCore [.system_shard1_replica_n3] CLOSING SolrCore org.apache.solr.core.SolrCore@7cd73ef5
[junit4] 2> 148142 WARN (qtp2089059441-155) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.m.SolrMetricManager Interrupted while trying to obtain lock to modify reporters registry: solr.core..system.shard1.replica_n3
[junit4] 2> 148142 INFO (qtp2089059441-155) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=SolrCore@7cd73ef5
[junit4] 2> 148142 INFO (qtp2089059441-155) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() .
[junit4] 2> 148142 INFO (qtp2089059441-155) [n:127.0.0.1:38615_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@44a9a2f9 commitCommandVersion:0
[junit4] 2> 148146 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 148350 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 7 /solr/collections/.system/terms/shard1
[junit4] 2> 4 /solr/configs/.system/managed-schema
[junit4] 2> 2 /solr/configs/.system
[junit4] 2> 2 /solr/packages.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/collections/.system/collectionprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 21 /solr/collections/.system/state.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 6 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 23 /solr/overseer/queue
[junit4] 2> 18 /solr/collections
[junit4] 2> 12 /solr/live_nodes
[junit4] 2> 11 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 148353 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:40591
[junit4] 2> 148353 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:40591
[junit4] 2> 148353 INFO (SUITE-SystemCollectionCompatTest-seed#[DEC1D494FB86B66B]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 40591
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.SystemCollectionCompatTest_DEC1D494FB86B66B-001
[junit4] 2> Mar 24, 2020 7:19:23 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene84): {id=PostingsFormat(name=LuceneVarGapFixedInterval), type=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{timestamp_l=DocValuesFormat(name=Lucene80), _version_=DocValuesFormat(name=Asserting), time_l=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1768, maxMBSortInHeap=6.394579787829574, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@29196753), locale=ms, timezone=Egypt
[junit4] 2> NOTE: Linux 5.3.0-42-generic amd64/AdoptOpenJDK 11.0.6 (64-bit)/cpus=16,threads=2,free=409368536,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [SystemCollectionCompatTest]
[junit4] Completed [5/5 (1!)] on J2 in 147.75s, 1 test, 1 error <<< FAILURES!
[...truncated 13 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1516: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1043: There were test failures: 5 suites, 5 tests, 1 error [seed: DEC1D494FB86B66B]
Total time: 2 minutes 48 seconds
[repro] Setting last failure code to 256
[repro] Failures w/original seeds:
[repro] 1/5 failed: org.apache.solr.cloud.SystemCollectionCompatTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
No credentials specified
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=674aba6a8519ed390d57bdb7a42a88f426ce3ffa, workspace=/home/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #26106
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2