You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/07/06 07:15:24 UTC
[JENKINS] Lucene-Solr-8.6-MacOSX (64bit/jdk-13.0.2) - Build # 97 -
Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/97/
Java: 64bit/jdk-13.0.2 -XX:+UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testTaskTimeout
Error Message:
did not finish processing event in time
Stack Trace:
java.lang.AssertionError: did not finish processing event in time
at __randomizedtesting.SeedInfo.seed([FBEA37AD555BE23D:FEB70F47C83320AA]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testTaskTimeout(ExecutePlanActionTest.java:317)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:830)
FAILED: junit.framework.TestSuite.org.apache.solr.util.TestSolrCLIRunExample
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.util.TestSolrCLIRunExample: 1) Thread[id=11671, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSolrCLIRunExample] at java.base@13.0.2/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.util.TestSolrCLIRunExample:
1) Thread[id=11671, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSolrCLIRunExample]
at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
at __randomizedtesting.SeedInfo.seed([FBEA37AD555BE23D]:0)
Build Log:
[...truncated 14836 lines...]
[junit4] Suite: org.apache.solr.util.TestSolrCLIRunExample
[junit4] 2> 908039 INFO (SUITE-TestSolrCLIRunExample-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 908040 INFO (SUITE-TestSolrCLIRunExample-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.util.TestSolrCLIRunExample_FBEA37AD555BE23D-001/data-dir-70-001
[junit4] 2> 908040 WARN (SUITE-TestSolrCLIRunExample-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 908040 INFO (SUITE-TestSolrCLIRunExample-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 908041 INFO (SUITE-TestSolrCLIRunExample-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776") w/ MAC_OS_X supressed clientAuth
[junit4] 2> 908041 INFO (SUITE-TestSolrCLIRunExample-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 908044 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testInteractiveSolrCloudExampleWithAutoScalingPolicy
[junit4] 2> 908149 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.util.TestSolrCLIRunExample_FBEA37AD555BE23D-001/tempDir-002
[junit4] 2> 908150 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 908151 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 908151 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 908253 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer start zk server on port: 49468
[junit4] 2> 908254 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:49468
[junit4] 2> 908254 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:49468
[junit4] 2> 908254 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 49468
[junit4] 2> 908262 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 908270 INFO (zkConnectionManagerCallback-7120-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 908270 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 908285 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 908292 INFO (zkConnectionManagerCallback-7122-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 908293 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 908300 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 908308 INFO (zkConnectionManagerCallback-7124-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 908310 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 908422 WARN (jetty-launcher-7125-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 908422 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=49465, binding port=49465)
[junit4] 2> 908422 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 49465 try number 2 ...
[junit4] 2> 908422 INFO (jetty-launcher-7125-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 908425 INFO (jetty-launcher-7125-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 908425 INFO (jetty-launcher-7125-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 908425 INFO (jetty-launcher-7125-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 908426 INFO (jetty-launcher-7125-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2facd6b4{/solr,null,AVAILABLE}
[junit4] 2> 908426 INFO (jetty-launcher-7125-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@9f64f11{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 908426 INFO (jetty-launcher-7125-thread-1) [ ] o.e.j.s.Server Started @??????ms
[junit4] 2> 908426 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49465}
[junit4] 2> 908426 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 908426 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.6.0
[junit4] 2> 908426 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port 49465
[junit4] 2> 908426 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 908426 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-06T06:33:43.497404Z
[junit4] 2> 908426 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 908434 INFO (zkConnectionManagerCallback-7127-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 908434 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 908436 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 908440 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@3b153e15, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 908992 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 909001 WARN (jetty-launcher-7125-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@66bf78a9[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 909001 WARN (jetty-launcher-7125-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@66bf78a9[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 909010 WARN (jetty-launcher-7125-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@628e4e6a[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 909010 WARN (jetty-launcher-7125-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@628e4e6a[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 909011 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49468/solr
[junit4] 2> 909018 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 909019 INFO (zkConnectionManagerCallback-7138-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 909019 INFO (jetty-launcher-7125-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 909140 INFO (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 909143 INFO (zkConnectionManagerCallback-7140-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 909144 INFO (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 909813 INFO (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader localhost:49465_solr
[junit4] 2> 909820 INFO (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.c.Overseer Overseer (id=72226373762547717-localhost:49465_solr-n_0000000000) starting
[junit4] 2> 909888 INFO (OverseerStateUpdate-72226373762547717-localhost:49465_solr-n_0000000000) [n:localhost:49465_solr ] o.a.s.c.Overseer Starting to work on the main queue : localhost:49465_solr
[junit4] 2> 909892 INFO (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/localhost:49465_solr
[junit4] 2> 909897 INFO (OverseerStateUpdate-72226373762547717-localhost:49465_solr-n_0000000000) [n:localhost:49465_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 909914 INFO (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 909915 WARN (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 909957 INFO (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 909995 INFO (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b153e15
[junit4] 2> 910006 INFO (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b153e15
[junit4] 2> 910006 INFO (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b153e15
[junit4] 2> 910009 INFO (jetty-launcher-7125-thread-1) [n:localhost:49465_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.util.TestSolrCLIRunExample_FBEA37AD555BE23D-001/tempDir-002/node1
[junit4] 2> 910030 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=1
[junit4] 2> 910031 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 910036 INFO (zkConnectionManagerCallback-7157-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 910036 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 910044 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 910048 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:49468/solr ready
[junit4] 2> 910060 INFO (qtp120693127-11296) [n:localhost:49465_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=json} status=0 QTime=4
[junit4] 2> 910063 INFO (qtp120693127-11297) [n:localhost:49465_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=json and sendToOCPQueue=true
[junit4] 2> 910067 INFO (qtp120693127-11297) [n:localhost:49465_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=json} status=0 QTime=3
[junit4] 2> 910071 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 910079 INFO (zkConnectionManagerCallback-7162-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 910079 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 910084 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 910090 INFO (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:49468/solr ready
[junit4] 2> 910199 INFO (qtp120693127-11297) [n:localhost:49465_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=list&wt=json and sendToOCPQueue=true
[junit4] 2> 910199 INFO (qtp120693127-11297) [n:localhost:49465_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=list&wt=json} status=0 QTime=0
[junit4] 2> 911249 WARN (OverseerThreadFactory-7147-thread-1-processing-n:localhost:49465_solr) [n:localhost:49465_solr ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 2 on collection testCloudExamplePrompt1 is higher than the number of Solr instances currently live or live and part of your createNodeSet(1). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 919934 WARN (zkCallback-7139-thread-3) [ ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
[junit4] 2> 922485 INFO (jetty-closer-7323-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@9f64f11{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 922485 INFO (jetty-closer-7323-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2facd6b4{/solr,null,UNAVAILABLE}
[junit4] 2> 922486 INFO (jetty-closer-7323-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 922700 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/configs/testCloudExamplePrompt1/managed-schema
[junit4] 2> 8 /solr/clusterprops.json
[junit4] 2> 8 /solr/aliases.json
[junit4] 2> 6 /solr/collections/testCloudExamplePrompt1/terms/shard1
[junit4] 2> 5 /solr/collections/testCloudExamplePrompt1/terms/shard2
[junit4] 2> 3 /solr/collections/testCloudExamplePrompt1/state.json
[junit4] 2> 3 /solr/collections/newColl/state.json
[junit4] 2> 2 /solr/configs/testCloudExamplePrompt1
[junit4] 2> 2 /solr/collections/newColl/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 23 /solr/collections/testCloudExamplePrompt1/state.json
[junit4] 2> 9 /solr/collections/newColl/state.json
[junit4] 2> 8 /solr/clusterstate.json
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 43 /solr/overseer/queue
[junit4] 2> 21 /solr/collections
[junit4] 2> 15 /solr/overseer/collection-queue-work
[junit4] 2> 9 /solr/live_nodes
[junit4] 2>
[junit4] 2>
[junit4] 2> ERROR: access denied ("java.io.FilePermission" "/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.util.TestSolrCLIRunExample_FBEA37AD555BE23D-001/tempDir-003/failExecuteScript" "execute")
[junit4] 2>
[junit4] 2> 922734 WARN (TEST-TestSolrCLIRunExample.testTechproductsExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 922735 INFO (Thread-2469) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 922738 INFO (Thread-2469) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 922738 INFO (Thread-2469) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 922738 INFO (Thread-2469) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 922739 INFO (Thread-2469) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@475effd6{/solr,null,AVAILABLE}
[junit4] 2> 922741 INFO (Thread-2469) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6eaf6a5a{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 922741 INFO (Thread-2469) [ ] o.e.j.s.Server Started @??????ms
[junit4] 2> 923023 WARN (Thread-2469) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@d53130a[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 923023 WARN (Thread-2469) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@d53130a[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 923031 WARN (Thread-2469) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3c5c0e91[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 923031 WARN (Thread-2469) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3c5c0e91[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 923032 WARN (Thread-2469) [ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 930183 WARN (qtp893539303-11610) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/extraction/lib filtered by .*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/extraction/lib
[junit4] 2> 930184 WARN (qtp893539303-11610) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist filtered by solr-cell-\d.*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist
[junit4] 2> 930184 WARN (qtp893539303-11610) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/clustering/lib filtered by .*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/clustering/lib
[junit4] 2> 930184 WARN (qtp893539303-11610) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist filtered by solr-clustering-\d.*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist
[junit4] 2> 930184 WARN (qtp893539303-11610) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/langid/lib filtered by .*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/langid/lib
[junit4] 2> 930185 WARN (qtp893539303-11610) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist filtered by solr-langid-\d.*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist
[junit4] 2> 930185 WARN (qtp893539303-11610) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist filtered by solr-ltr-\d.*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist
[junit4] 2> 930185 WARN (qtp893539303-11610) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/velocity/lib filtered by .*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/velocity/lib
[junit4] 2> 930185 WARN (qtp893539303-11610) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist filtered by solr-velocity-\d.*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist
[junit4] 1> SimplePostTool version 5.0.0
[junit4] 1> Posting files to [base] url http://localhost:49584/solr/techproducts/update using content-type application/xml...
[junit4] 1> POSTing file mem.xml to [base]
[junit4] 1> POSTing file ipod_video.xml to [base]
[junit4] 1> POSTing file ipod_other.xml to [base]
[junit4] 1> POSTing file sd500.xml to [base]
[junit4] 1> POSTing file monitor2.xml to [base]
[junit4] 1> POSTing file vidcard.xml to [base]
[junit4] 1> POSTing file mp500.xml to [base]
[junit4] 1> POSTing file monitor.xml to [base]
[junit4] 1> POSTing file manufacturers.xml to [base]
[junit4] 1> POSTing file hd.xml to [base]
[junit4] 1> POSTing file money.xml to [base]
[junit4] 1> POSTing file utf8-example.xml to [base]
[junit4] 1> POSTing file gb18030-example.xml to [base]
[junit4] 1> POSTing file solr.xml to [base]
[junit4] 1> 14 files indexed.
[junit4] 1> COMMITting Solr index changes to http://localhost:49584/solr/techproducts/update...
[junit4] 1> Time spent: ?:??:??.???
[junit4] 2> 931372 INFO (TEST-TestSolrCLIRunExample.testTechproductsExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6eaf6a5a{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 931373 INFO (TEST-TestSolrCLIRunExample.testTechproductsExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@475effd6{/solr,null,UNAVAILABLE}
[junit4] 2> 931373 INFO (TEST-TestSolrCLIRunExample.testTechproductsExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 931379 WARN (TEST-TestSolrCLIRunExample.testTechproductsExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 931379 INFO (Thread-2479) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 931382 INFO (Thread-2479) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 931382 INFO (Thread-2479) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 931382 INFO (Thread-2479) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 931383 INFO (Thread-2479) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28d13fad{/solr,null,AVAILABLE}
[junit4] 2> 931384 INFO (Thread-2479) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3bf4abb0{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 931384 INFO (Thread-2479) [ ] o.e.j.s.Server Started @??????ms
[junit4] 2> 931564 WARN (Thread-2479) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@675f0425[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 931564 WARN (Thread-2479) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@675f0425[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 931569 WARN (Thread-2479) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@226700ba[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 931569 WARN (Thread-2479) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@226700ba[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 931572 WARN (Thread-2479) [ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 931726 WARN (coreLoadExecutor-7365-thread-1) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/extraction/lib filtered by .*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/extraction/lib
[junit4] 2> 931761 WARN (coreLoadExecutor-7365-thread-1) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist filtered by solr-cell-\d.*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist
[junit4] 2> 931762 WARN (coreLoadExecutor-7365-thread-1) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/clustering/lib filtered by .*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/clustering/lib
[junit4] 2> 931762 WARN (coreLoadExecutor-7365-thread-1) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist filtered by solr-clustering-\d.*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist
[junit4] 2> 931762 WARN (coreLoadExecutor-7365-thread-1) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/langid/lib filtered by .*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/langid/lib
[junit4] 2> 931762 WARN (coreLoadExecutor-7365-thread-1) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist filtered by solr-langid-\d.*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist
[junit4] 2> 931762 WARN (coreLoadExecutor-7365-thread-1) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist filtered by solr-ltr-\d.*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist
[junit4] 2> 931762 WARN (coreLoadExecutor-7365-thread-1) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/velocity/lib filtered by .*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/contrib/velocity/lib
[junit4] 2> 931762 WARN (coreLoadExecutor-7365-thread-1) [ x:techproducts ] o.a.s.c.SolrConfig Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist filtered by solr-velocity-\d.*\.jar to classpath: java.nio.file.NoSuchFileException: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/dist
[junit4] 2> 932848 INFO (TEST-TestSolrCLIRunExample.testTechproductsExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@3bf4abb0{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 932849 INFO (TEST-TestSolrCLIRunExample.testTechproductsExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@28d13fad{/solr,null,UNAVAILABLE}
[junit4] 2> 932849 INFO (TEST-TestSolrCLIRunExample.testTechproductsExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 933109 WARN (jetty-launcher-7382-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 933109 INFO (jetty-launcher-7382-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 933112 INFO (jetty-launcher-7382-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 933112 INFO (jetty-launcher-7382-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 933112 INFO (jetty-launcher-7382-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 933113 INFO (jetty-launcher-7382-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@76686c85{/solr,null,AVAILABLE}
[junit4] 2> 933114 INFO (jetty-launcher-7382-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2c4787ed{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 933114 INFO (jetty-launcher-7382-thread-1) [ ] o.e.j.s.Server Started @??????ms
[junit4] 2> 933385 WARN (jetty-launcher-7382-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6d01ccd1[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 933385 WARN (jetty-launcher-7382-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6d01ccd1[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 933390 WARN (jetty-launcher-7382-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@284821d7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 933391 WARN (jetty-launcher-7382-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@284821d7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 934498 WARN (jetty-launcher-7382-thread-1) [n:localhost:49666_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 935314 WARN (OverseerThreadFactory-7404-thread-1-processing-n:localhost:49666_solr) [n:localhost:49666_solr ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 2 on collection testCloudExamplePrompt is higher than the number of Solr instances currently live or live and part of your createNodeSet(1). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 947139 WARN (zkCallback-7396-thread-3) [ ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
[junit4] 2> 948166 INFO (jetty-closer-7674-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@2c4787ed{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 948166 INFO (jetty-closer-7674-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@76686c85{/solr,null,UNAVAILABLE}
[junit4] 2> 948166 INFO (jetty-closer-7674-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 948396 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/configs/testCloudExamplePrompt/managed-schema
[junit4] 2> 7 /solr/collections/testCloudExamplePrompt/terms/shard1
[junit4] 2> 7 /solr/collections/testCloudExamplePrompt/terms/shard2
[junit4] 2> 6 /solr/clusterprops.json
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 3 /solr/collections/testCloudExamplePrompt/state.json
[junit4] 2> 2 /solr/configs/testCloudExamplePrompt
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 16 /solr/collections/testCloudExamplePrompt/state.json
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 32 /solr/overseer/queue
[junit4] 2> 12 /solr/collections
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 948418 WARN (TEST-TestSolrCLIRunExample.testSchemalessExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 948419 INFO (Thread-2501) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 948422 INFO (Thread-2501) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 948422 INFO (Thread-2501) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 948422 INFO (Thread-2501) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 948424 INFO (Thread-2501) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4c184d21{/solr,null,AVAILABLE}
[junit4] 2> 948425 INFO (Thread-2501) [ ] o.e.j.s.AbstractConnector Started ServerConnector@236e755d{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 948425 INFO (Thread-2501) [ ] o.e.j.s.Server Started @??????ms
[junit4] 2> 948511 WARN (Thread-2501) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@541f8546[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 948511 WARN (Thread-2501) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@541f8546[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 948518 WARN (Thread-2501) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1caa2e6e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 948518 WARN (Thread-2501) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1caa2e6e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 948519 WARN (Thread-2501) [ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 949729 INFO (TEST-TestSolrCLIRunExample.testSchemalessExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@236e755d{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 949729 INFO (TEST-TestSolrCLIRunExample.testSchemalessExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4c184d21{/solr,null,UNAVAILABLE}
[junit4] 2> 949730 INFO (TEST-TestSolrCLIRunExample.testSchemalessExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 949740 WARN (TEST-TestSolrCLIRunExample.testSchemalessExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 949740 INFO (Thread-2511) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 949749 INFO (Thread-2511) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 949749 INFO (Thread-2511) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 949749 INFO (Thread-2511) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 949751 INFO (Thread-2511) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5dce19a7{/solr,null,AVAILABLE}
[junit4] 2> 949751 INFO (Thread-2511) [ ] o.e.j.s.AbstractConnector Started ServerConnector@235bc44b{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 949751 INFO (Thread-2511) [ ] o.e.j.s.Server Started @??????ms
[junit4] 2> 949887 WARN (Thread-2511) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7d58570c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 949888 WARN (Thread-2511) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7d58570c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 949902 WARN (Thread-2511) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1afd8568[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 949902 WARN (Thread-2511) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1afd8568[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 949904 WARN (Thread-2511) [ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 956806 INFO (TEST-TestSolrCLIRunExample.testSchemalessExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@235bc44b{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
[junit4] 2> 956806 INFO (TEST-TestSolrCLIRunExample.testSchemalessExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5dce19a7{/solr,null,UNAVAILABLE}
[junit4] 2> 956807 INFO (TEST-TestSolrCLIRunExample.testSchemalessExample-seed#[FBEA37AD555BE23D]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> Jul 06, 2020 6:34:32 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Jul 06, 2020 6:34:42 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.util.TestSolrCLIRunExample:
[junit4] 2> 1) Thread[id=11671, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSolrCLIRunExample]
[junit4] 2> at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
[junit4] 2> at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] 2> Jul 06, 2020 6:34:42 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=11671, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSolrCLIRunExample]
[junit4] 2> 967123 ERROR (SessionTracker) [ ] o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : SessionTracker
[junit4] 2> => java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.base/java.lang.Thread.sleep(Native Method)
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method) ~[?:?]
[junit4] 2> at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) [zookeeper-3.5.7.jar:3.5.7]
[junit4] 2> Jul 06, 2020 6:34:42 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene86), sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=as-IN, timezone=Etc/UTC
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=6,threads=1,free=196502792,total=367742976
[junit4] 2> NOTE: All tests run in this JVM: [ShardsWhitelistTest, TestSimPolicyCloud, PeerSyncWithBufferUpdatesTest, BJQParserTest, UninvertDocValuesMergePolicyTest, TestClassicSimilarityFactory, SolrRrdBackendFactoryTest, SegmentsInfoRequestHandlerTest, TestConfigSetProperties, ZkStateReaderTest, ZookeeperReadAPITest, SchemaVersionSpecificBehaviorTest, BasicAuthOnSingleNodeTest, AnalysisAfterCoreReloadTest, XmlUpdateRequestHandlerTest, SparseHLLTest, TestSolrTestCaseJ4, AnalyticsQueryTest, TestInPlaceUpdatesRequiredField, TestSimpleQParserPlugin, TestPolicyCloud, DistributedUpdateProcessorTest, RankQueryTest, SoftAutoCommitTest, BJQFilterAccessibleTest, TestImplicitCoreProperties, TestExplainDocTransformer, TestLFUCache, TestSchemaNameResource, DeleteReplicaTest, TestDistributedMap, TestConfigSetsAPIExclusivity, TestUnInvertedFieldException, TolerantUpdateProcessorTest, TemplateUpdateProcessorTest, PhrasesIdentificationComponentTest, TestJsonFacets, TestSweetSpotSimilarityFactory, MigrateRouteKeyTest, IndexSizeTriggerTest, DataDrivenBlockJoinTest, FieldAnalysisRequestHandlerTest, HighlighterWithoutStoredIdTest, TestExtendedDismaxParser, TimeZoneUtilsTest, TestSolrCoreParser, TestCollectionAPI, SolrInfoBeanTest, TestUniqueKeyFieldResource, CustomTermsComponentTest, TestFileDictionaryLookup, DateFieldTest, TestMergePolicyConfig, PrimUtilsTest, TestFastOutputStream, GraphQueryTest, SpatialFilterTest, JavaBinAtomicUpdateMultivalueTest, CreateCollectionCleanupTest, TestSolrCloudWithSecureImpersonation, CdcrRequestHandlerTest, TestSolrCLIRunExample]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCLIRunExample -Dtests.seed=FBEA37AD555BE23D -Dtests.slow=true -Dtests.locale=as-IN -Dtests.timezone=Etc/UTC -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J0 | TestSolrCLIRunExample (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.util.TestSolrCLIRunExample:
[junit4] > 1) Thread[id=11671, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSolrCLIRunExample]
[junit4] > at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
[junit4] > at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] > at __randomizedtesting.SeedInfo.seed([FBEA37AD555BE23D]:0)
[junit4] Completed [433/914 (1!)] on J0 in 59.35s, 5 tests, 1 error <<< FAILURES!
[...truncated 584 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.ExecutePlanActionTest
[junit4] 2> 1565166 INFO (SUITE-ExecutePlanActionTest-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 1565167 INFO (SUITE-ExecutePlanActionTest-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.ExecutePlanActionTest_FBEA37AD555BE23D-001/data-dir-100-001
[junit4] 2> 1565167 WARN (SUITE-ExecutePlanActionTest-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=52 numCloses=52
[junit4] 2> 1565167 INFO (SUITE-ExecutePlanActionTest-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1565168 INFO (SUITE-ExecutePlanActionTest-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 1565168 INFO (SUITE-ExecutePlanActionTest-seed#[FBEA37AD555BE23D]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1565170 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testExecute
[junit4] 2> 1565170 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.ExecutePlanActionTest_FBEA37AD555BE23D-001/tempDir-001
[junit4] 2> 1565170 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1565171 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 1565171 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1565271 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer start zk server on port: 57662
[junit4] 2> 1565271 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:57662
[junit4] 2> 1565271 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:57662
[junit4] 2> 1565271 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 57662
[junit4] 2> 1565274 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1565278 INFO (zkConnectionManagerCallback-13955-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1565278 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1565281 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1565284 INFO (zkConnectionManagerCallback-13957-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1565285 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1565285 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1565288 INFO (zkConnectionManagerCallback-13959-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1565288 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1565399 WARN (jetty-launcher-13960-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 1565399 WARN (jetty-launcher-13960-thread-2) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 1565399 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1565399 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1565399 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1565399 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1565399 INFO (jetty-launcher-13960-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 1565399 INFO (jetty-launcher-13960-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 1565402 INFO (jetty-launcher-13960-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1565402 INFO (jetty-launcher-13960-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1565402 INFO (jetty-launcher-13960-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1565403 INFO (jetty-launcher-13960-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1565403 INFO (jetty-launcher-13960-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1565403 INFO (jetty-launcher-13960-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1565403 INFO (jetty-launcher-13960-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36d6f1f9{/solr,null,AVAILABLE}
[junit4] 2> 1565403 INFO (jetty-launcher-13960-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c06c678{/solr,null,AVAILABLE}
[junit4] 2> 1565403 INFO (jetty-launcher-13960-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@61cf8819{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:57669}
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1251eea0{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:57670}
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-1) [ ] o.e.j.s.Server Started @1565563ms
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-2) [ ] o.e.j.s.Server Started @1565563ms
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=57669}
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=57670}
[junit4] 2> 1565404 ERROR (jetty-launcher-13960-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1565404 ERROR (jetty-launcher-13960-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.6.0
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.6.0
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-06T06:44:40.541648Z
[junit4] 2> 1565404 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-06T06:44:40.541654Z
[junit4] 2> 1565405 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1565406 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1565409 INFO (zkConnectionManagerCallback-13964-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1565409 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1565409 INFO (zkConnectionManagerCallback-13962-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1565409 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1565410 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1565410 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1565752 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1565753 WARN (jetty-launcher-13960-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@40de6eac[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1565753 WARN (jetty-launcher-13960-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@40de6eac[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1565756 WARN (jetty-launcher-13960-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@482f5b7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1565756 WARN (jetty-launcher-13960-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@482f5b7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1565757 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57662/solr
[junit4] 2> 1565757 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1565760 INFO (zkConnectionManagerCallback-13978-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1565760 INFO (jetty-launcher-13960-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1565865 INFO (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1565874 INFO (zkConnectionManagerCallback-13980-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1565874 INFO (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1565880 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1565882 WARN (jetty-launcher-13960-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3829e723[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1565882 WARN (jetty-launcher-13960-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3829e723[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1565888 WARN (jetty-launcher-13960-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3661a411[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1565888 WARN (jetty-launcher-13960-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3661a411[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1565890 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57662/solr
[junit4] 2> 1565891 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1565896 INFO (zkConnectionManagerCallback-13988-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1565896 INFO (jetty-launcher-13960-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1566007 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1566016 INFO (zkConnectionManagerCallback-13992-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1566017 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1566693 INFO (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:57670_solr
[junit4] 2> 1566707 INFO (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.c.Overseer Overseer (id=72226416825073670-127.0.0.1:57670_solr-n_0000000000) starting
[junit4] 2> 1566772 INFO (OverseerStateUpdate-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [n:127.0.0.1:57670_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:57670_solr
[junit4] 2> 1566772 INFO (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57670_solr
[junit4] 2> 1566773 DEBUG (OverseerAutoScalingTriggerThread-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 1566782 DEBUG (OverseerAutoScalingTriggerThread-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1566783 INFO (OverseerStateUpdate-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [n:127.0.0.1:57670_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1566783 DEBUG (OverseerAutoScalingTriggerThread-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
[junit4] 2> 1566783 DEBUG (OverseerAutoScalingTriggerThread-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1566793 INFO (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1566794 WARN (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1566843 DEBUG (OverseerAutoScalingTriggerThread-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:57670_solr]
[junit4] 2> 1566846 DEBUG (OverseerAutoScalingTriggerThread-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 1566848 DEBUG (ScheduledTrigger-13997-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1 and last live nodes: 1
[junit4] 2> 1566848 DEBUG (OverseerAutoScalingTriggerThread-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 1566855 INFO (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1566870 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1566885 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:57669_solr as DOWN
[junit4] 2> 1566889 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1566889 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57669_solr
[junit4] 2> 1566893 INFO (zkCallback-13979-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1566894 INFO (zkCallback-13991-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1566898 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1566899 WARN (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1566906 INFO (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57670.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@62956e1
[junit4] 2> 1566928 INFO (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57670.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@62956e1
[junit4] 2> 1566928 INFO (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57670.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@62956e1
[junit4] 2> 1566930 INFO (jetty-launcher-13960-thread-2) [n:127.0.0.1:57670_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.ExecutePlanActionTest_FBEA37AD555BE23D-001/tempDir-001/node2
[junit4] 2> 1566936 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1566988 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57669.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@62956e1
[junit4] 2> 1566999 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57669.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@62956e1
[junit4] 2> 1567000 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57669.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@62956e1
[junit4] 2> 1567001 INFO (jetty-launcher-13960-thread-1) [n:127.0.0.1:57669_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.ExecutePlanActionTest_FBEA37AD555BE23D-001/tempDir-001/node1
[junit4] 2> 1567026 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
[junit4] 2> 1567027 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1567031 INFO (zkConnectionManagerCallback-14015-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1567031 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1567035 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1567040 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57662/solr ready
[junit4] 2> 1567053 DEBUG (zkCallback-13979-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 1567054 DEBUG (OverseerAutoScalingTriggerThread-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 1567064 INFO (qtp479593282-21309) [n:127.0.0.1:57670_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&maxShardsPerNode=1&name=testExecute&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1567083 DEBUG (OverseerAutoScalingTriggerThread-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 1567085 DEBUG (OverseerAutoScalingTriggerThread-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 1567087 INFO (OverseerThreadFactory-13999-thread-1-processing-n:127.0.0.1:57670_solr) [n:127.0.0.1:57670_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testExecute
[junit4] 2> 1567217 INFO (OverseerStateUpdate-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [n:127.0.0.1:57670_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testExecute",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testExecute_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:57670/solr",
[junit4] 2> "node_name":"127.0.0.1:57670_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1567226 INFO (OverseerStateUpdate-72226416825073670-127.0.0.1:57670_solr-n_0000000000) [n:127.0.0.1:57670_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testExecute",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testExecute_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:57669/solr",
[junit4] 2> "node_name":"127.0.0.1:57669_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1567433 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr x:testExecute_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testExecute_shard1_replica_n1&action=CREATE&numShards=1&collection=testExecute&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1567433 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr x:testExecute_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testExecute_shard1_replica_n2&action=CREATE&numShards=1&collection=testExecute&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1567434 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr x:testExecute_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1567462 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 1567462 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 1567472 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
[junit4] 2> 1567472 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
[junit4] 2> 1567473 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1567473 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testExecute_shard1_replica_n1' using configuration from configset conf, trusted=true
[junit4] 2> 1567474 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1567474 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'testExecute_shard1_replica_n2' using configuration from configset conf, trusted=true
[junit4] 2> 1567474 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57670.solr.core.testExecute.shard1.replica_n1' (registry 'solr.core.testExecute.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@62956e1
[junit4] 2> 1567474 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57669.solr.core.testExecute.shard1.replica_n2' (registry 'solr.core.testExecute.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@62956e1
[junit4] 2> 1567474 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.SolrCore [[testExecute_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.ExecutePlanActionTest_FBEA37AD555BE23D-001/tempDir-001/node2/testExecute_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.ExecutePlanActionTest_FBEA37AD555BE23D-001/tempDir-001/node2/testExecute_shard1_replica_n1/data/]
[junit4] 2> 1567474 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.c.SolrCore [[testExecute_shard1_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.ExecutePlanActionTest_FBEA37AD555BE23D-001/tempDir-001/node1/testExecute_shard1_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.ExecutePlanActionTest_FBEA37AD555BE23D-001/tempDir-001/node1/testExecute_shard1_replica_n2/data/]
[junit4] 2> 1567559 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1567559 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1567561 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1567561 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1567564 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1567565 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1567565 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1567565 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1567565 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 1567565 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1671448895372132352
[junit4] 2> 1567568 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1567568 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1567570 INFO (searcherExecutor-14017-thread-1-processing-n:127.0.0.1:57670_solr x:testExecute_shard1_replica_n1 c:testExecute s:shard1 r:core_node3) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.SolrCore [testExecute_shard1_replica_n1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 1567573 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1567574 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1567575 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 1567575 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1671448895382618112
[junit4] 2> 1567582 INFO (searcherExecutor-14019-thread-1-processing-n:127.0.0.1:57669_solr x:testExecute_shard1_replica_n2 c:testExecute s:shard1 r:core_node4) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.c.SolrCore [testExecute_shard1_replica_n2] Registered new searcher autowarm time: 0 ms
[junit4] 2> 1567585 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testExecute/terms/shard1 to Terms{values={core_node3=0}, version=0}
[junit4] 2> 1567585 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testExecute/leaders/shard1
[junit4] 2> 1567596 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testExecute/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
[junit4] 2> 1567596 INFO (qtp1862822792-21304) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testExecute/leaders/shard1
[junit4] 2> 1567611 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1567611 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1567611 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:57670/solr/testExecute_shard1_replica_n1/
[junit4] 2> 1567613 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=testExecute_shard1_replica_n1 url=http://127.0.0.1:57670/solr START replicas=[http://127.0.0.1:57669/solr/testExecute_shard1_replica_n2/] nUpdates=100
[junit4] 2> 1567613 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=testExecute_shard1_replica_n1 url=http://127.0.0.1:57670/solr DONE. We have no versions. sync failed.
[junit4] 2> 1567615 INFO (qtp1862822792-21307) [n:127.0.0.1:57669_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2 ] o.a.s.c.S.Request [testExecute_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1567616 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 1567616 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1567616 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testExecute/leaders/shard1/leader after winning as /collections/testExecute/leader_elect/shard1/election/72226416825073670-core_node3-n_0000000000
[junit4] 2> 1567622 INFO (qtp479593282-21312) [n:127.0.0.1:57670_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:57670/solr/testExecute_shard1_replica_n1/ shard1
[junit4] 2> 1567730 INFO (zkCallback-13979-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1567731 INFO (zkCallback-13979-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [Wa
[...truncated too long message...]
rJmxReporter@3754c9e6: rootName = solr_57943, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1e9f7da5
[junit4] 2> 1613930 INFO (jetty-closer-14319-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
[junit4] 2> 1613930 INFO (jetty-closer-14319-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@af561cc: rootName = solr_57943, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@15ad2052
[junit4] 2> 1613930 INFO (jetty-closer-14319-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 1613932 INFO (closeThreadPool-14325-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72226419249971208-127.0.0.1:57943_solr-n_0000000000) closing
[junit4] 2> 1613932 INFO (OverseerStateUpdate-72226419249971208-127.0.0.1:57943_solr-n_0000000000) [n:127.0.0.1:57943_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:57943_solr
[junit4] 2> 1613934 DEBUG (closeThreadPool-14325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
[junit4] 2> 1613934 INFO (OverseerAutoScalingTriggerThread-72226419249971208-127.0.0.1:57943_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1613935 DEBUG (closeThreadPool-14325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
[junit4] 2> 1613935 DEBUG (closeThreadPool-14325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
[junit4] 2> 1613935 DEBUG (closeThreadPool-14325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
[junit4] 2> 1613935 DEBUG (closeThreadPool-14325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
[junit4] 2> 1613935 DEBUG (closeThreadPool-14325-thread-2) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 1613938 INFO (closeThreadPool-14325-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72226419249971208-127.0.0.1:57943_solr-n_0000000000) closing
[junit4] 2> 1614040 INFO (jetty-closer-14319-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72226419249971208-127.0.0.1:57943_solr-n_0000000000) closing
[junit4] 2> 1614043 INFO (jetty-closer-14319-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@2f14ad3e{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 1614043 INFO (jetty-closer-14319-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@55a3798a{/solr,null,UNAVAILABLE}
[junit4] 2> 1614043 INFO (jetty-closer-14319-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1614045 INFO (TEST-ExecutePlanActionTest.testTaskFail-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1614256 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections/testTaskFail/terms/shard1
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/packages.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 26 /solr/collections/testTaskFail/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2> 3 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 21 /solr/overseer/queue
[junit4] 2> 8 /solr/live_nodes
[junit4] 2> 6 /solr/collections
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 1614258 INFO (TEST-ExecutePlanActionTest.testTaskFail-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:57937
[junit4] 2> 1614258 INFO (TEST-ExecutePlanActionTest.testTaskFail-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:57937
[junit4] 2> 1614258 INFO (TEST-ExecutePlanActionTest.testTaskFail-seed#[FBEA37AD555BE23D]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 57937
[junit4] 2> 1614259 INFO (TEST-ExecutePlanActionTest.testTaskFail-seed#[FBEA37AD555BE23D]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTaskFail
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.ExecutePlanActionTest_FBEA37AD555BE23D-001
[junit4] 2> Jul 06, 2020 6:45:29 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene86): {}, docValues:{}, maxPointsInLeafNode=946, maxMBSortInHeap=5.56019727922601, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=ki, timezone=Australia/Hobart
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=6,threads=1,free=91104568,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [SuggestComponentContextFilterQueryTest, TestSimUtils, PeerSyncWithLeaderTest, BlockJoinFacetSimpleTest, TestIBSimilarityFactory, SimpleFacetsTest, SplitHandlerTest, TestCoreDiscovery, RuleEngineTest, CloudReplicaSourceTest, SynonymTokenizerTest, JWTAuthPluginTest, CursorPagingTest, AutoscalingHistoryHandlerTest, TestHttpServletCarrier, PathHierarchyTokenizerFactoryTest, FuzzySearchTest, TestNestedUpdateProcessor, TestSolr4Spatial2, TriggerIntegrationTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, SolrIndexSearcherTest, SolrIndexMetricsTest, SimpleMLTQParserTest, TestJmxIntegration, TestSubQueryTransformerDistrib, TestMaxScoreQueryParser, TestSchemaVersionResource, DistribCursorPagingTest, TestExclusionRuleCollectionAccess, TestDeleteCollectionOnDownNodes, TestMacros, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, ResponseLogComponentTest, TestJsonRangeFacets, TestDistribIDF, MoveReplicaHDFSTest, NodeAddedTriggerIntegrationTest, MaxSizeAutoCommitTest, PingRequestHandlerTest, TestUnifiedSolrHighlighterWithoutStoredId, TestFilteredDocIdSet, TestSolrQueryParser, TestLocalFSCloudBackupRestore, TestCursorMarkWithoutUniqueKey, TestManagedSynonymGraphFilterFactory, DistributedExpandComponentTest, TestHighFrequencyDictionaryFactory, DocValuesMultiTest, TestQuerySenderNoQuery, SolrPluginUtilsTest, TestRTimerTree, TestScoreJoinQPNoScore, TestCollapseQParserPlugin, PreAnalyzedUpdateProcessorTest, DeleteLastCustomShardedReplicaTest, TestStressLiveNodes, HDFSCollectionsAPITest, TestTestInjection, TestSearchPerf, DistributedFacetPivotSmallTest, JvmMetricsTest, TestFieldCacheReopen, TestPushWriter, ConfigSetsAPITest, RequiredFieldsTest, TestSimpleTrackingShardHandler, CopyFieldTest, HdfsNNFailoverTest, TestConfigOverlay, NumberUtilsTest, TestClusterStateMutator, DirectoryFactoryTest, AddReplicaTest, TestUtilizeNode, ReindexCollectionTest, TestStressReorder, LeaderFailoverAfterPartitionTest, BasicZkTest, PolyFieldTest, TestFieldTypeCollectionResource, RestartWhileUpdatingTest, BigEndianAscendingWordSerializerTest, SearchRateTriggerTest, HLLUtilTest, TestIndexSearcher, DirectSolrConnectionTest, DisMaxRequestHandlerTest, DistributedIntervalFacetingTest, OutputWriterTest, TestDistributedSearch, DistributedVersionInfoTest, HttpPartitionWithTlogReplicasTest, SystemCollectionCompatTest, TestAuthenticationFramework, TestCloudInspectUtil, TestCloudPhrasesIdentificationComponent, TestCloudPivotFacet, TestCloudRecovery2, TestLeaderElectionWithEmptyReplica, TestPullReplica, TestPullReplicaErrorHandling, TestRebalanceLeaders, TestTlogReplayVsRecovery, TestWithCollection, CollectionsAPIDistributedZkTest, ExecutePlanActionTest]
[junit4] Completed [588/914 (2!)] on J3 in 49.93s, 4 tests, 1 failure <<< FAILURES!
[...truncated 48555 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/97/consoleText
[repro] Revision: 925799d4b60aa6bf7d292ac9e3c09a21567f50f4
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=TestSolrCLIRunExample -Dtests.seed=FBEA37AD555BE23D -Dtests.slow=true -Dtests.locale=as-IN -Dtests.timezone=Etc/UTC -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Repro line: ant test -Dtestcase=ExecutePlanActionTest -Dtests.method=testTaskTimeout -Dtests.seed=FBEA37AD555BE23D -Dtests.slow=true -Dtests.locale=ki -Dtests.timezone=Australia/Hobart -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestSolrCLIRunExample
[repro] ExecutePlanActionTest
[repro] ant compile-test
[...truncated 3472 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.TestSolrCLIRunExample|*.ExecutePlanActionTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=FBEA37AD555BE23D -Dtests.slow=true -Dtests.locale=as-IN -Dtests.timezone=Etc/UTC -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 136 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.autoscaling.ExecutePlanActionTest
[repro] 0/5 failed: org.apache.solr.util.TestSolrCLIRunExample
[repro] Exiting with code 0
[...truncated 91 lines...]
Re: [JENKINS-Experimental-GC] Lucene-Solr-8.6-MacOSX (64bit/jdk-14.0.1)
- Build # 100 - Still Unstable!
Posted by Chris Hostetter <ho...@fucit.org>.
: Note: it is expected for MultiThreadedOCPTest to fail from time to time on
: the 8x branch as SOLR-14546
: <https://issues.apache.org/jira/browse/SOLR-14546> was only fixed in 9.0.
: Such failures would be unexpected on master.
If there is no intention of fixing this on branch_8x (either because of
backcompat concerns, or whatever other concerns may exist...) but the
problem is "known" to cause test failures then the test should be
disabled/removed from branch_8x.
-Hoss
http://www.lucidworks.com/
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS-Experimental-GC] Lucene-Solr-8.6-MacOSX
(64bit/jdk-14.0.1) - Build # 100 - Still Unstable!
Posted by David Smiley <da...@gmail.com>.
Then you may want to @Ignore it on 8x only so we don't get this noise.
~ David
On Tue, Jul 7, 2020 at 5:22 AM Ilan Ginzburg <il...@gmail.com> wrote:
> Note: it is expected for MultiThreadedOCPTest to fail from time to time
> on the 8x branch as SOLR-14546
> <https://issues.apache.org/jira/browse/SOLR-14546> was only fixed in 9.0.
> Such failures would be unexpected on master.
>
> Ilan
>
> On Tue, Jul 7, 2020 at 11:11 AM Policeman Jenkins Server <
> jenkins@thetaphi.de> wrote:
>
>> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/100/
>> Java: 64bit/jdk-14.0.1 -XX:-UseCompressedOops
>> -XX:+UnlockExperimentalVMOptions -XX:+UseZGC
>>
>> 1 tests failed.
>> FAILED: org.apache.solr.cloud.MultiThreadedOCPTest.test
>>
>> Error Message:
>> acoll: 1594109474089 bcoll: 1594109474958
>>
>> Stack Trace:
>> java.lang.AssertionError: acoll: 1594109474089 bcoll: 1594109474958
>> at
>> __randomizedtesting.SeedInfo.seed([E6EA690F0B5FD1D1:6EBE56D5A5A3BC29]:0)
>> at org.junit.Assert.fail(Assert.java:88)
>> at org.junit.Assert.assertTrue(Assert.java:41)
>> at
>> org.apache.solr.cloud.MultiThreadedOCPTest.testFillWorkQueue(MultiThreadedOCPTest.java:113)
>> at
>> org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:68)
>> at
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
>> Method)
>> at
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.base/java.lang.reflect.Method.invoke(Method.java:564)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
>> at
>> org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
>> at
>> org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at java.base/java.lang.Thread.run(Thread.java:832)
>>
>>
>>
>>
>> Build Log:
>> [...truncated 13732 lines...]
>> [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
>> [junit4] 2> 365607 INFO
>> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
>> o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to
>> test-framework derived value of
>> '/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/server/solr/configsets/_default/conf'
>> [junit4] 2> 365607 INFO
>> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
>> o.a.s.SolrTestCaseJ4 SecureRandom sanity checks:
>> test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
>> [junit4] 2> 365608 INFO
>> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
>> o.a.s.SolrTestCaseJ4 Created dataDir:
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/data-dir-21-001
>> [junit4] 2> 365608 WARN
>> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
>> o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
>> [junit4] 2> 365609 INFO
>> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
>> o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false)
>> w/NUMERIC_DOCVALUES_SYSPROP=false
>> [junit4] 2> 365610 INFO
>> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
>> o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via:
>> @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0,
>> clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
>> [junit4] 2> 365610 INFO
>> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
>> o.a.s.BaseDistributedSearchTestCase Setting hostContext system property:
>> /il/
>> [junit4] 2> 365634 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
>> [junit4] 2> 365634 INFO (ZkTestServer Run Thread) [ ]
>> o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
>> [junit4] 2> 365634 INFO (ZkTestServer Run Thread) [ ]
>> o.a.s.c.ZkTestServer Starting server
>> [junit4] 2> 365737 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer start zk server on port: 61290
>> [junit4] 2> 365737 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:61290
>> [junit4] 2> 365737 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:61290
>> [junit4] 2> 365737 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer connecting to 127.0.0.1 61290
>> [junit4] 2> 365743 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 365755 INFO (zkConnectionManagerCallback-1807-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 365755 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 365763 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 365768 INFO (zkConnectionManagerCallback-1809-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 365768 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 365774 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer put
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
>> to /configs/conf1/solrconfig.xml
>> [junit4] 2> 365780 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer put
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml
>> to /configs/conf1/schema.xml
>> [junit4] 2> 365784 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer put
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
>> to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>> [junit4] 2> 365787 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer put
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
>> to /configs/conf1/stopwords.txt
>> [junit4] 2> 365791 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer put
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt
>> to /configs/conf1/protwords.txt
>> [junit4] 2> 365794 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer put
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml
>> to /configs/conf1/currency.xml
>> [junit4] 2> 365797 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer put
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
>> to /configs/conf1/enumsConfig.xml
>> [junit4] 2> 365800 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer put
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
>> to /configs/conf1/open-exchange-rates.json
>> [junit4] 2> 365803 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer put
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
>> to /configs/conf1/mapping-ISOLatin1Accent.txt
>> [junit4] 2> 365807 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer put
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
>> to /configs/conf1/old_synonyms.txt
>> [junit4] 2> 365810 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer put
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
>> to /configs/conf1/synonyms.txt
>> [junit4] 2> 365813 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless
>> explicitly asked otherwise
>> [junit4] 2> 366243 WARN
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content,
>> break even is size 23
>> [junit4] 2> 366244 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
>> [junit4] 2> 366244 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
>> [junit4] 2> 366244 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z;
>> git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
>> [junit4] 2> 366247 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.s.session DefaultSessionIdManager workerName=node0
>> [junit4] 2> 366247 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.s.session No SessionScavenger set, using defaults
>> [junit4] 2> 366247 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.s.session node0 Scavenging every 600000ms
>> [junit4] 2> 366249 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@196e435e
>> {/il,null,AVAILABLE}
>> [junit4] 2> 366251 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.s.AbstractConnector Started ServerConnector@60c39296{HTTP/1.1,
>> (http/1.1, h2c)}{127.0.0.1:61294}
>> [junit4] 2> 366251 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.s.Server Started @366377ms
>> [junit4] 2> 366251 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il,
>> solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/control/data,
>> hostPort=61294,
>> coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores}
>> [junit4] 2> 366252 ERROR
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
>> be missing or incomplete.
>> [junit4] 2> 366252 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.s.SolrDispatchFilter Using logger factory
>> org.apache.logging.slf4j.Log4jLoggerFactory
>> [junit4] 2> 366252 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
>> version 8.6.0
>> [junit4] 2> 366252 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
>> null
>> [junit4] 2> 366252 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir:
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
>> [junit4] 2> 366252 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
>> 2020-07-07T08:10:14.352578Z
>> [junit4] 2> 366255 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 366259 INFO (zkConnectionManagerCallback-1811-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 366259 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 366365 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
>> ZooKeeper)
>> [junit4] 2> 366365 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.SolrXmlConfig Loading container configuration from
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/solr.xml
>> [junit4] 2> 366378 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.SolrXmlConfig Configuration parameter
>> autoReplicaFailoverWorkLoopDelay is ignored
>> [junit4] 2> 366378 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.SolrXmlConfig Configuration parameter
>> autoReplicaFailoverBadNodeExpiration is ignored
>> [junit4] 2> 366382 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.SolrXmlConfig MBean server found:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters
>> were configured - adding default JMX reporter.
>> [junit4] 2> 366570 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized:
>> WhitelistHostChecker [whitelistHosts=null,
>> whitelistHostCheckingEnabled=false]
>> [junit4] 2> 366576 WARN
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.u.s.S.config Trusting all certificates configured for Client@b8d7e06
>> [provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 366576 WARN
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
>> Client@b8d7e06[provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 366584 WARN
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.u.s.S.config Trusting all certificates configured for Client@13785524
>> [provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 366584 WARN
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
>> Client@13785524[provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 366586 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
>> [junit4] 2> 366588 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 366592 INFO (zkConnectionManagerCallback-1822-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 366592 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 366712 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 366714 INFO (zkConnectionManagerCallback-1824-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 366714 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 367090 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.c.OverseerElectionContext I am going to be the leader
>> 127.0.0.1:61294_il
>> [junit4] 2> 367092 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.c.Overseer Overseer
>> (id=72232415561777156-127.0.0.1:61294_il-n_0000000000) starting
>> [junit4] 2> 367113 INFO
>> (OverseerStateUpdate-72232415561777156-127.0.0.1:61294_il-n_0000000000)
>> [n:127.0.0.1:61294_il ] o.a.s.c.Overseer Starting to work on the
>> main queue : 127.0.0.1:61294_il
>> [junit4] 2> 367120 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/
>> 127.0.0.1:61294_il
>> [junit4] 2> 367136 INFO (zkCallback-1823-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
>> [junit4] 2> 367151 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.p.PackageLoader /packages.json updated to version -1
>> [junit4] 2> 367154 WARN
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.c.CoreContainer Not all security plugins configured!
>> authentication=disabled authorization=disabled. Solr is only as secure as
>> you make it. Consider configuring authentication/authorization before
>> exposing Solr to users internal or external. See
>> https://s.apache.org/solrsecurity for more info
>> [junit4] 2> 367186 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics
>> history in memory.
>> [junit4] 2> 367214 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry
>> 'solr.node') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 367226 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry
>> 'solr.jvm') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 367226 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry
>> 'solr.jetty') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 367229 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
>> ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores
>> [junit4] 2> 367244 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 367247 INFO (zkConnectionManagerCallback-1841-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 367248 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 367251 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
>> [junit4] 2> 367256 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:61290/solr
>> ready
>> [junit4] 2> 367261 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
>> ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with
>> params
>> collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:61294_il&wt=javabin&version=2
>> and sendToOCPQueue=true
>> [junit4] 2> 367272 INFO
>> (OverseerThreadFactory-1831-thread-1-processing-n:127.0.0.1:61294_il)
>> [n:127.0.0.1:61294_il ] o.a.s.c.a.c.CreateCollectionCmd Create
>> collection control_collection
>> [junit4] 2> 367388 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il
>> ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
>> transient cores
>> [junit4] 2> 367392 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il
>> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
>> params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
>> status=0 QTime=4
>> [junit4] 2> 367412 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation
>> core create command
>> qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
>> [junit4] 2> 368439 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
>> [junit4] 2> 368452 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.s.IndexSchema Schema name=test
>> [junit4] 2> 368523 WARN (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class
>> [solr.EnumField]. Please consult documentation how to replace it
>> accordingly.
>> [junit4] 2> 368630 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
>> [junit4] 2> 368665 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.CoreContainer Creating SolrCore
>> 'control_collection_shard1_replica_n1' using configuration from configset
>> conf1, trusted=true
>> [junit4] 2> 368665 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.core.control_collection.shard1.replica_n1' (registry
>> 'solr.core.control_collection.shard1.replica_n1') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 368665 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new
>> SolrCore at
>> [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores/control_collection_shard1_replica_n1],
>> dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores/control_collection_shard1_replica_n1/data/]
>> [junit4] 2> 368667 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
>> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
>> maxMergeAtOnce=33, maxMergeAtOnceExplicit=17,
>> maxMergedSegmentMB=92.99609375, floorSegmentMB=1.458984375,
>> forceMergeDeletesPctAllowed=13.45063000950353, segmentsPerTier=24.0,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15388833146547976,
>> deletesPctAllowed=28.27740993910293
>> [junit4] 2> 368669 WARN (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
>> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
>> {initParams=a, name=/dump, class=DumpRequestHandler},args =
>> {defaults={a=A,b=B}}}
>> [junit4] 2> 368726 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.u.UpdateHandler Using UpdateLog implementation:
>> org.apache.solr.update.UpdateLog
>> [junit4] 2> 368726 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
>> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>> [junit4] 2> 368727 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>> [junit4] 2> 368728 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>> [junit4] 2> 368728 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
>> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
>> maxMergeAtOnce=31, maxMergeAtOnceExplicit=13,
>> maxMergedSegmentMB=82.12890625, floorSegmentMB=1.560546875,
>> forceMergeDeletesPctAllowed=20.77586369497545, segmentsPerTier=36.0,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0,
>> deletesPctAllowed=20.920356383090496
>> [junit4] 2> 368731 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
>> znodeBase: /configs/conf1
>> [junit4] 2> 368732 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
>> ZooKeeperStorageIO:path=/configs/conf1
>> [junit4] 2> 368732 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
>> [junit4] 2> 368732 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.u.UpdateLog Could not find max version in index or recent updates,
>> using new clock 1671544875864031232
>> [junit4] 2> 368735 INFO
>> (searcherExecutor-1843-thread-1-processing-n:127.0.0.1:61294_il
>> x:control_collection_shard1_replica_n1 c:control_collection s:shard1)
>> [n:127.0.0.1:61294_il c:control_collection s:shard1
>> x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore
>> [control_collection_shard1_replica_n1] Registered new searcher autowarm
>> time: 0 ms
>> [junit4] 2> 368740 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.ZkShardTerms Successful update of terms at
>> /collections/control_collection/terms/shard1 to
>> Terms{values={core_node2=0}, version=0}
>> [junit4] 2> 368740 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.ShardLeaderElectionContextBase make sure parent is created
>> /collections/control_collection/leaders/shard1
>> [junit4] 2> 368746 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>> [junit4] 2> 368746 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>> [junit4] 2> 368746 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.SyncStrategy Sync replicas to
>> http://127.0.0.1:61294/il/control_collection_shard1_replica_n1/
>> [junit4] 2> 368747 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
>> [junit4] 2> 368747 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.SyncStrategy
>> http://127.0.0.1:61294/il/control_collection_shard1_replica_n1/ has no
>> replicas
>> [junit4] 2> 368747 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
>> /collections/control_collection/leaders/shard1/leader after winning as
>> /collections/control_collection/leader_elect/shard1/election/72232415561777156-core_node2-n_0000000000
>> [junit4] 2> 368751 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.ShardLeaderElectionContext I am the new leader:
>> http://127.0.0.1:61294/il/control_collection_shard1_replica_n1/ shard1
>> [junit4] 2> 368855 INFO (zkCallback-1823-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
>> state:SyncConnected type:NodeDataChanged
>> path:/collections/control_collection/state.json] for collection
>> [control_collection] has occurred - updating... (live nodes size: [1])
>> [junit4] 2> 368855 INFO (zkCallback-1823-thread-2) [ ]
>> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
>> state:SyncConnected type:NodeDataChanged
>> path:/collections/control_collection/state.json] for collection
>> [control_collection] has occurred - updating... (live nodes size: [1])
>> [junit4] 2> 368858 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
>> o.a.s.c.ZkController I am the leader, no recovery necessary
>> [junit4] 2> 368862 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
>> params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT}
>> status=0 QTime=1450
>> [junit4] 2> 368865 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
>> ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for
>> at most 45 seconds. Check all shard replicas
>> [junit4] 2> 368973 INFO (zkCallback-1823-thread-2) [ ]
>> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
>> state:SyncConnected type:NodeDataChanged
>> path:/collections/control_collection/state.json] for collection
>> [control_collection] has occurred - updating... (live nodes size: [1])
>> [junit4] 2> 368973 INFO (zkCallback-1823-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
>> state:SyncConnected type:NodeDataChanged
>> path:/collections/control_collection/state.json] for collection
>> [control_collection] has occurred - updating... (live nodes size: [1])
>> [junit4] 2> 368973 INFO (zkCallback-1823-thread-3) [ ]
>> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
>> state:SyncConnected type:NodeDataChanged
>> path:/collections/control_collection/state.json] for collection
>> [control_collection] has occurred - updating... (live nodes size: [1])
>> [junit4] 2> 368974 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
>> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
>> params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:61294_il&wt=javabin&version=2}
>> status=0 QTime=1712
>> [junit4] 2> 368974 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in
>> collection: control_collection
>> [junit4] 2> 369093 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 369096 INFO (zkConnectionManagerCallback-1852-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 369097 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 369098 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
>> [junit4] 2> 369101 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:61290/solr
>> ready
>> [junit4] 2> 369101 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection
>> loss:false
>> [junit4] 2> 369103 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
>> ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with
>> params
>> collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2
>> and sendToOCPQueue=true
>> [junit4] 2> 369109 INFO
>> (OverseerThreadFactory-1831-thread-2-processing-n:127.0.0.1:61294_il)
>> [n:127.0.0.1:61294_il ] o.a.s.c.a.c.CreateCollectionCmd Create
>> collection collection1
>> [junit4] 2> 369109 INFO
>> (OverseerCollectionConfigSetProcessor-72232415561777156-127.0.0.1:61294_il-n_0000000000)
>> [n:127.0.0.1:61294_il ] o.a.s.c.OverseerTaskQueue Response ZK path:
>> /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may
>> have disconnected from ZooKeeper
>> [junit4] 2> 369335 WARN
>> (OverseerThreadFactory-1831-thread-2-processing-n:127.0.0.1:61294_il)
>> [n:127.0.0.1:61294_il ] o.a.s.c.a.c.CreateCollectionCmd It is
>> unusual to create a collection (collection1) without cores.
>> [junit4] 2> 369344 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
>> ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for
>> at most 45 seconds. Check all shard replicas
>> [junit4] 2> 369350 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
>> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
>> params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2}
>> status=0 QTime=247
>> [junit4] 2> 369351 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
>> [junit4] 2> 369351 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
>> [junit4] 2> 369352 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
>> [junit4] 2> 369352 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
>> [junit4] 2> 369353 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
>> [junit4] 2> 369353 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
>> [junit4] 2> 369353 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances
>> pullReplicaCount=0 numOtherReplicas=3
>> [junit4] 2> 369605 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001
>> of type NRT for shard2
>> [junit4] 2> 369606 WARN (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content,
>> break even is size 23
>> [junit4] 2> 369606 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
>> [junit4] 2> 369606 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
>> [junit4] 2> 369606 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z;
>> git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
>> [junit4] 2> 369609 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.session DefaultSessionIdManager workerName=node0
>> [junit4] 2> 369609 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.session No SessionScavenger set, using defaults
>> [junit4] 2> 369609 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.session node0 Scavenging every 600000ms
>> [junit4] 2> 369610 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6221549f
>> {/il,null,AVAILABLE}
>> [junit4] 2> 369611 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.AbstractConnector Started ServerConnector@1dfdcc2b{HTTP/1.1,
>> (http/1.1, h2c)}{127.0.0.1:61327}
>> [junit4] 2> 369611 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.Server Started @369737ms
>> [junit4] 2> 369611 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il,
>> solrconfig=solrconfig.xml,
>> solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/jetty1,
>> hostPort=61327,
>> coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores}
>> [junit4] 2> 369612 ERROR (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
>> be missing or incomplete.
>> [junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter Using logger factory
>> org.apache.logging.slf4j.Log4jLoggerFactory
>> [junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
>> version 8.6.0
>> [junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
>> null
>> [junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir:
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
>> [junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
>> 2020-07-07T08:10:17.712474Z
>> [junit4] 2> 369613 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 369617 INFO (zkConnectionManagerCallback-1855-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 369617 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 369720 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
>> ZooKeeper)
>> [junit4] 2> 369720 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.SolrXmlConfig Loading container configuration from
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/solr.xml
>> [junit4] 2> 369724 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.SolrXmlConfig Configuration parameter
>> autoReplicaFailoverWorkLoopDelay is ignored
>> [junit4] 2> 369724 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.SolrXmlConfig Configuration parameter
>> autoReplicaFailoverBadNodeExpiration is ignored
>> [junit4] 2> 369726 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.SolrXmlConfig MBean server found:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters
>> were configured - adding default JMX reporter.
>> [junit4] 2> 369790 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized:
>> WhitelistHostChecker [whitelistHosts=null,
>> whitelistHostCheckingEnabled=false]
>> [junit4] 2> 369790 WARN (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.u.s.S.config Trusting all certificates configured for Client@7e2a7c4c
>> [provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 369790 WARN (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
>> Client@7e2a7c4c[provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 369796 WARN (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.u.s.S.config Trusting all certificates configured for Client@3be4fae2
>> [provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 369796 WARN (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
>> Client@3be4fae2[provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 369798 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
>> [junit4] 2> 369799 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 369803 INFO (zkConnectionManagerCallback-1866-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 369803 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 369859 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001
>> of type NRT for shard1
>> [junit4] 2> 369860 WARN (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content,
>> break even is size 23
>> [junit4] 2> 369860 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
>> [junit4] 2> 369860 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
>> [junit4] 2> 369860 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z;
>> git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
>> [junit4] 2> 369862 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.s.session DefaultSessionIdManager workerName=node0
>> [junit4] 2> 369862 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.s.session No SessionScavenger set, using defaults
>> [junit4] 2> 369862 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.s.session node0 Scavenging every 660000ms
>> [junit4] 2> 369863 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36ad93b5
>> {/il,null,AVAILABLE}
>> [junit4] 2> 369864 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.s.AbstractConnector Started ServerConnector@1ed6717f{HTTP/1.1,
>> (http/1.1, h2c)}{127.0.0.1:61332}
>> [junit4] 2> 369864 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.s.Server Started @369989ms
>> [junit4] 2> 369864 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il,
>> solrconfig=solrconfig.xml,
>> solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/jetty2,
>> hostPort=61332,
>> coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores}
>> [junit4] 2> 369864 ERROR (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
>> be missing or incomplete.
>> [junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.s.SolrDispatchFilter Using logger factory
>> org.apache.logging.slf4j.Log4jLoggerFactory
>> [junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
>> version 8.6.0
>> [junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
>> null
>> [junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir:
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
>> [junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
>> 2020-07-07T08:10:17.965193Z
>> [junit4] 2> 369866 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 369869 INFO (zkConnectionManagerCallback-1868-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 369870 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 369912 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.c.c.ConnectionManager Waiting for
>> client to connect to ZooKeeper
>> [junit4] 2> 369914 INFO (zkConnectionManagerCallback-1870-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 369914 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.c.c.ConnectionManager Client is
>> connected to ZooKeeper
>> [junit4] 2> 369926 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.c.c.ZkStateReader Updated live nodes
>> from ZooKeeper... (0) -> (1)
>> [junit4] 2> 369936 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.c.ZkController Publish
>> node=127.0.0.1:61327_il as DOWN
>> [junit4] 2> 369938 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.c.TransientSolrCoreCacheDefault
>> Allocating transient cache for 4 transient cores
>> [junit4] 2> 369938 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.c.ZkController Register node as live
>> in ZooKeeper:/live_nodes/127.0.0.1:61327_il
>> [junit4] 2> 369941 INFO (zkCallback-1823-thread-2) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
>> [junit4] 2> 369941 INFO (zkCallback-1851-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
>> [junit4] 2> 369941 INFO (zkCallback-1869-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
>> [junit4] 2> 369946 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.p.PackageLoader /packages.json updated
>> to version -1
>> [junit4] 2> 369946 WARN (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.c.CoreContainer Not all security
>> plugins configured! authentication=disabled authorization=disabled. Solr
>> is only as secure as you make it. Consider configuring
>> authentication/authorization before exposing Solr to users internal or
>> external. See https://s.apache.org/solrsecurity for more info
>> [junit4] 2> 369971 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.h.a.MetricsHistoryHandler No .system
>> collection, keeping metrics history in memory.
>> [junit4] 2> 369995 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.node' (registry 'solr.node') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 370004 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.jvm' (registry 'solr.jvm') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 370005 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.jetty' (registry 'solr.jetty') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 370007 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61327_il ] o.a.s.c.CorePropertiesLocator Found 0 core
>> definitions underneath
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores
>> [junit4] 2> 370011 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
>> ZooKeeper)
>> [junit4] 2> 370011 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.SolrXmlConfig Loading container configuration from
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/solr.xml
>> [junit4] 2> 370015 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.SolrXmlConfig Configuration parameter
>> autoReplicaFailoverWorkLoopDelay is ignored
>> [junit4] 2> 370015 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.SolrXmlConfig Configuration parameter
>> autoReplicaFailoverBadNodeExpiration is ignored
>> [junit4] 2> 370017 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.SolrXmlConfig MBean server found:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters
>> were configured - adding default JMX reporter.
>> [junit4] 2> 370020 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:61327_il
>> [junit4] 2> 370068 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized:
>> WhitelistHostChecker [whitelistHosts=null,
>> whitelistHostCheckingEnabled=false]
>> [junit4] 2> 370070 WARN (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.u.s.S.config Trusting all certificates configured for Client@f6899ad
>> [provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 370070 WARN (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
>> Client@f6899ad[provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 370074 WARN (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.u.s.S.config Trusting all certificates configured for Client@44d5c0c5
>> [provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 370075 WARN (closeThreadPool-1853-thread-2) [ ]
>> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
>> Client@44d5c0c5[provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 370076 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
>> [junit4] 2> 370078 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 370081 INFO (zkConnectionManagerCallback-1889-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 370081 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 370149 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001
>> of type NRT for shard2
>> [junit4] 2> 370150 WARN (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content,
>> break even is size 23
>> [junit4] 2> 370150 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
>> [junit4] 2> 370150 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
>> [junit4] 2> 370150 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z;
>> git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
>> [junit4] 2> 370151 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.session DefaultSessionIdManager workerName=node0
>> [junit4] 2> 370151 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.session No SessionScavenger set, using defaults
>> [junit4] 2> 370151 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.session node0 Scavenging every 600000ms
>> [junit4] 2> 370152 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@186a191
>> {/il,null,AVAILABLE}
>> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.AbstractConnector Started ServerConnector@7365123b{HTTP/1.1,
>> (http/1.1, h2c)}{127.0.0.1:61337}
>> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.s.Server Started @370278ms
>> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il,
>> solrconfig=solrconfig.xml,
>> solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/jetty3,
>> hostPort=61337,
>> coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001/cores,
>> replicaType=NRT}
>> [junit4] 2> 370153 ERROR (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
>> be missing or incomplete.
>> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter Using logger factory
>> org.apache.logging.slf4j.Log4jLoggerFactory
>> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
>> version 8.6.0
>> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
>> null
>> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir:
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
>> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
>> 2020-07-07T08:10:18.253975Z
>> [junit4] 2> 370155 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 370158 INFO (zkConnectionManagerCallback-1891-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 370158 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 370193 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.c.c.ConnectionManager Waiting for
>> client to connect to ZooKeeper
>> [junit4] 2> 370195 INFO (zkConnectionManagerCallback-1893-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 370195 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.c.c.ConnectionManager Client is
>> connected to ZooKeeper
>> [junit4] 2> 370206 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.c.c.ZkStateReader Updated live nodes
>> from ZooKeeper... (0) -> (2)
>> [junit4] 2> 370216 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.c.ZkController Publish
>> node=127.0.0.1:61332_il as DOWN
>> [junit4] 2> 370217 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.c.TransientSolrCoreCacheDefault
>> Allocating transient cache for 4 transient cores
>> [junit4] 2> 370217 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.c.ZkController Register node as live
>> in ZooKeeper:/live_nodes/127.0.0.1:61332_il
>> [junit4] 2> 370221 INFO (zkCallback-1869-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
>> [junit4] 2> 370221 INFO (zkCallback-1823-thread-2) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
>> [junit4] 2> 370221 INFO (zkCallback-1851-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
>> [junit4] 2> 370222 INFO (zkCallback-1892-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
>> [junit4] 2> 370226 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.p.PackageLoader /packages.json updated
>> to version -1
>> [junit4] 2> 370226 WARN (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.c.CoreContainer Not all security
>> plugins configured! authentication=disabled authorization=disabled. Solr
>> is only as secure as you make it. Consider configuring
>> authentication/authorization before exposing Solr to users internal or
>> external. See https://s.apache.org/solrsecurity for more info
>> [junit4] 2> 370251 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.h.a.MetricsHistoryHandler No .system
>> collection, keeping metrics history in memory.
>> [junit4] 2> 370275 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.node' (registry 'solr.node') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 370287 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.jvm' (registry 'solr.jvm') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 370287 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.jetty' (registry 'solr.jetty') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 370289 INFO (closeThreadPool-1853-thread-2)
>> [n:127.0.0.1:61332_il ] o.a.s.c.CorePropertiesLocator Found 0 core
>> definitions underneath
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores
>> [junit4] 2> 370293 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
>> ZooKeeper)
>> [junit4] 2> 370294 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.SolrXmlConfig Loading container configuration from
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001/solr.xml
>> [junit4] 2> 370298 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.SolrXmlConfig Configuration parameter
>> autoReplicaFailoverWorkLoopDelay is ignored
>> [junit4] 2> 370298 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.SolrXmlConfig Configuration parameter
>> autoReplicaFailoverBadNodeExpiration is ignored
>> [junit4] 2> 370299 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.SolrXmlConfig MBean server found:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters
>> were configured - adding default JMX reporter.
>> [junit4] 2> 370321 INFO (closeThreadPool-1853-thread-2) [ ]
>> o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:61332_il
>> [junit4] 2> 370387 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized:
>> WhitelistHostChecker [whitelistHosts=null,
>> whitelistHostCheckingEnabled=false]
>> [junit4] 2> 370389 WARN (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.u.s.S.config Trusting all certificates configured for Client@603817e
>> [provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 370389 WARN (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
>> Client@603817e[provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 370394 WARN (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.u.s.S.config Trusting all certificates configured for Client@60633c00
>> [provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 370394 WARN (closeThreadPool-1853-thread-1) [ ]
>> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
>> Client@60633c00[provider=null,keyStore=null,trustStore=null]
>> [junit4] 2> 370395 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
>> [junit4] 2> 370398 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
>> [junit4] 2> 370404 INFO (zkConnectionManagerCallback-1912-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 370404 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
>> [junit4] 2> 370515 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.c.c.ConnectionManager Waiting for
>> client to connect to ZooKeeper
>> [junit4] 2> 370519 INFO (zkConnectionManagerCallback-1914-thread-1)
>> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 370519 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.c.c.ConnectionManager Client is
>> connected to ZooKeeper
>> [junit4] 2> 370543 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.c.c.ZkStateReader Updated live nodes
>> from ZooKeeper... (0) -> (3)
>> [junit4] 2> 370557 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.c.ZkController Publish
>> node=127.0.0.1:61337_il as DOWN
>> [junit4] 2> 370563 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.c.TransientSolrCoreCacheDefault
>> Allocating transient cache for 4 transient cores
>> [junit4] 2> 370564 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.c.ZkController Register node as live
>> in ZooKeeper:/live_nodes/127.0.0.1:61337_il
>> [junit4] 2> 370572 INFO (zkCallback-1851-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
>> [junit4] 2> 370572 INFO (zkCallback-1823-thread-2) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
>> [junit4] 2> 370572 INFO (zkCallback-1869-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
>> [junit4] 2> 370573 INFO (zkCallback-1913-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
>> [junit4] 2> 370573 INFO (zkCallback-1892-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
>> [junit4] 2> 370597 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.p.PackageLoader /packages.json updated
>> to version -1
>> [junit4] 2> 370598 WARN (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.c.CoreContainer Not all security
>> plugins configured! authentication=disabled authorization=disabled. Solr
>> is only as secure as you make it. Consider configuring
>> authentication/authorization before exposing Solr to users internal or
>> external. See https://s.apache.org/solrsecurity for more info
>> [junit4] 2> 370623 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.h.a.MetricsHistoryHandler No .system
>> collection, keeping metrics history in memory.
>> [junit4] 2> 370648 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.node' (registry 'solr.node') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 370660 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.jvm' (registry 'solr.jvm') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 370660 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.jetty' (registry 'solr.jetty') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 370663 INFO (closeThreadPool-1853-thread-1)
>> [n:127.0.0.1:61337_il ] o.a.s.c.CorePropertiesLocator Found 0 core
>> definitions underneath
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001/cores
>> [junit4] 2> 370683 INFO (closeThreadPool-1853-thread-1) [ ]
>> o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:61337_il
>> [junit4] 2> 370707 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il
>> ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica
>> with params node=127.0.0.1:61332_il&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2
>> and sendToOCPQueue=true
>> [junit4] 2> 370709 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
>> ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica
>> with params node=127.0.0.1:61327_il&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2
>> and sendToOCPQueue=true
>> [junit4] 2> 370718 INFO (qtp1884586278-2968) [n:127.0.0.1:61294_il
>> ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica
>> with params node=127.0.0.1:61337_il&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2
>> and sendToOCPQueue=true
>> [junit4] 2> 370761 INFO
>> (OverseerCollectionConfigSetProcessor-72232415561777156-127.0.0.1:61294_il-n_0000000000)
>> [n:127.0.0.1:61294_il ] o.a.s.c.OverseerTaskQueue Response ZK path:
>> /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may
>> have disconnected from ZooKeeper
>> [junit4] 2> 370801 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
>> params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes}
>> status=0 QTime=0
>> [junit4] 2> 370804 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
>> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
>> params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
>> status=0 QTime=1
>> [junit4] 2> 370810 INFO (qtp432167883-3024) [n:127.0.0.1:61327_il
>> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
>> params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
>> status=0 QTime=1
>> [junit4] 2> 370815 INFO (qtp451536634-3044) [n:127.0.0.1:61332_il
>> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
>> params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
>> status=0 QTime=1
>> [junit4] 2> 370822 INFO (qtp1354606003-3074) [n:127.0.0.1:61337_il
>> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
>> params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
>> status=0 QTime=2
>> [junit4] 2> 370827 INFO
>> (OverseerThreadFactory-1831-thread-3-processing-n:127.0.0.1:61294_il)
>> [n:127.0.0.1:61294_il c:collection1 s:shard1 ]
>> o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:61332_il for
>> creating new replica of shard shard1 for collection collection1
>> [junit4] 2> 370832 INFO
>> (OverseerThreadFactory-1831-thread-4-processing-n:127.0.0.1:61294_il)
>> [n:127.0.0.1:61294_il c:collection1 s:shard2 ]
>> o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:61327_il for
>> creating new replica of shard shard2 for collection collection1
>> [junit4] 2> 370834 INFO
>> (OverseerThreadFactory-1831-thread-3-processing-n:127.0.0.1:61294_il)
>> [n:127.0.0.1:61294_il c:collection1 s:shard1 ]
>> o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
>> [junit4] 2> 370838 INFO
>> (OverseerThreadFactory-1831-thread-4-processing-n:127.0.0.1:61294_il)
>> [n:127.0.0.1:61294_il c:collection1 s:shard2 ]
>> o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
>> [junit4] 2> 370843 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> x:collection1_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core
>> create command
>> qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
>> [junit4] 2> 370844 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> x:collection1_shard2_replica_n2 ] o.a.s.h.a.CoreAdminOperation core
>> create command
>> qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n2&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
>> [junit4] 2> 371885 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
>> [junit4] 2> 371885 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
>> [junit4] 2> 371902 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.s.IndexSchema Schema name=test
>> [junit4] 2> 371912 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.s.IndexSchema Schema name=test
>> [junit4] 2> 372202 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
>> [junit4] 2> 372207 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
>> [junit4] 2> 372296 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n2'
>> using configuration from configset conf1, trusted=true
>> [junit4] 2> 372297 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.core.collection1.shard2.replica_n2' (registry
>> 'solr.core.collection1.shard2.replica_n2') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 372297 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SolrCore
>> [[collection1_shard2_replica_n2] ] Opening new SolrCore at
>> [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores/collection1_shard2_replica_n2],
>> dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores/collection1_shard2_replica_n2/data/]
>> [junit4] 2> 372300 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
>> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
>> maxMergeAtOnce=33, maxMergeAtOnceExplicit=17,
>> maxMergedSegmentMB=92.99609375, floorSegmentMB=1.458984375,
>> forceMergeDeletesPctAllowed=13.45063000950353, segmentsPerTier=24.0,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15388833146547976,
>> deletesPctAllowed=28.27740993910293
>> [junit4] 2> 372306 WARN (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
>> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
>> {initParams=a, name=/dump, class=DumpRequestHandler},args =
>> {defaults={a=A,b=B}}}
>> [junit4] 2> 372314 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1'
>> using configuration from configset conf1, trusted=true
>> [junit4] 2> 372315 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr.core.collection1.shard1.replica_n1' (registry
>> 'solr.core.collection1.shard1.replica_n1') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
>> [junit4] 2> 372316 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore
>> [[collection1_shard1_replica_n1] ] Opening new SolrCore at
>> [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores/collection1_shard1_replica_n1],
>> dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores/collection1_shard1_replica_n1/data/]
>> [junit4] 2> 372318 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
>> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
>> maxMergeAtOnce=33, maxMergeAtOnceExplicit=17,
>> maxMergedSegmentMB=92.99609375, floorSegmentMB=1.458984375,
>> forceMergeDeletesPctAllowed=13.45063000950353, segmentsPerTier=24.0,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15388833146547976,
>> deletesPctAllowed=28.27740993910293
>> [junit4] 2> 372330 WARN (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
>> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
>> {initParams=a, name=/dump, class=DumpRequestHandler},args =
>> {defaults={a=A,b=B}}}
>> [junit4] 2> 372394 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.u.UpdateHandler Using UpdateLog implementation:
>> org.apache.solr.update.UpdateLog
>> [junit4] 2> 372394 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.UpdateLog
>> Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
>> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>> [junit4] 2> 372402 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>> [junit4] 2> 372402 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>> [junit4] 2> 372403 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
>> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
>> maxMergeAtOnce=31, maxMergeAtOnceExplicit=13,
>> maxMergedSegmentMB=82.12890625, floorSegmentMB=1.560546875,
>> forceMergeDeletesPctAllowed=20.77586369497545, segmentsPerTier=36.0,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0,
>> deletesPctAllowed=20.920356383090496
>> [junit4] 2> 372413 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
>> znodeBase: /configs/conf1
>> [junit4] 2> 372417 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.u.UpdateHandler Using UpdateLog implementation:
>> org.apache.solr.update.UpdateLog
>> [junit4] 2> 372417 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog
>> Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
>> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>> [junit4] 2> 372418 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
>> ZooKeeperStorageIO:path=/configs/conf1
>> [junit4] 2> 372419 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
>> [junit4] 2> 372419 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.UpdateLog
>> Could not find max version in index or recent updates, using new clock
>> 1671544879730130944
>> [junit4] 2> 372420 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>> [junit4] 2> 372422 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>> [junit4] 2> 372424 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
>> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
>> maxMergeAtOnce=31, maxMergeAtOnceExplicit=13,
>> maxMergedSegmentMB=82.12890625, floorSegmentMB=1.560546875,
>> forceMergeDeletesPctAllowed=20.77586369497545, segmentsPerTier=36.0,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0,
>> deletesPctAllowed=20.920356383090496
>> [junit4] 2> 372426 INFO
>> (searcherExecutor-1925-thread-1-processing-n:127.0.0.1:61327_il
>> x:collection1_shard2_replica_n2 c:collection1 s:shard2) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SolrCore
>> [collection1_shard2_replica_n2] Registered new searcher autowarm time: 0 ms
>> [junit4] 2> 372430 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
>> znodeBase: /configs/conf1
>> [junit4] 2> 372432 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
>> ZooKeeperStorageIO:path=/configs/conf1
>> [junit4] 2> 372432 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
>> [junit4] 2> 372432 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog
>> Could not find max version in index or recent updates, using new clock
>> 1671544879743762432
>> [junit4] 2> 372436 INFO
>> (searcherExecutor-1927-thread-1-processing-n:127.0.0.1:61332_il
>> x:collection1_shard1_replica_n1 c:collection1 s:shard1) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore
>> [collection1_shard1_replica_n1] Registered new searcher autowarm time: 0 ms
>> [junit4] 2> 372442 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.ZkShardTerms Successful update of terms at
>> /collections/collection1/terms/shard2 to Terms{values={core_node4=0},
>> version=0}
>> [junit4] 2> 372442 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.ShardLeaderElectionContextBase make sure parent is created
>> /collections/collection1/leaders/shard2
>> [junit4] 2> 372452 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.ZkShardTerms Successful update of terms at
>> /collections/collection1/terms/shard1 to Terms{values={core_node3=0},
>> version=0}
>> [junit4] 2> 372452 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.ShardLeaderElectionContextBase make sure parent is created
>> /collections/collection1/leaders/shard1
>> [junit4] 2> 372474 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>> [junit4] 2> 372474 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>> [junit4] 2> 372474 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.SyncStrategy Sync replicas to
>> http://127.0.0.1:61327/il/collection1_shard2_replica_n2/
>> [junit4] 2> 372476 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
>> [junit4] 2> 372476 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>> [junit4] 2> 372476 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>> [junit4] 2> 372476 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.SyncStrategy Sync replicas to
>> http://127.0.0.1:61332/il/collection1_shard1_replica_n1/
>> [junit4] 2> 372479 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.SyncStrategy
>> http://127.0.0.1:61327/il/collection1_shard2_replica_n2/ has no replicas
>> [junit4] 2> 372479 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
>> [junit4] 2> 372480 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
>> /collections/collection1/leaders/shard2/leader after winning as
>> /collections/collection1/leader_elect/shard2/election/72232415561777162-core_node4-n_0000000000
>> [junit4] 2> 372485 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.SyncStrategy
>> http://127.0.0.1:61332/il/collection1_shard1_replica_n1/ has no replicas
>> [junit4] 2> 372485 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
>> /collections/collection1/leaders/shard1/leader after winning as
>> /collections/collection1/leader_elect/shard1/election/72232415561777165-core_node3-n_0000000000
>> [junit4] 2> 372494 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.ShardLeaderElectionContext I am the new leader:
>> http://127.0.0.1:61327/il/collection1_shard2_replica_n2/ shard2
>> [junit4] 2> 372494 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.ShardLeaderElectionContext I am the new leader:
>> http://127.0.0.1:61332/il/collection1_shard1_replica_n1/ shard1
>> [junit4] 2> 372614 INFO (zkCallback-1892-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
>> state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json] for collection [collection1] has
>> occurred - updating... (live nodes size: [4])
>> [junit4] 2> 372614 INFO (zkCallback-1869-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
>> state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json] for collection [collection1] has
>> occurred - updating... (live nodes size: [4])
>> [junit4] 2> 372617 INFO (zkCallback-1892-thread-2) [ ]
>> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
>> state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json] for collection [collection1] has
>> occurred - updating... (live nodes size: [4])
>> [junit4] 2> 372624 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
>> o.a.s.c.ZkController I am the leader, no recovery necessary
>> [junit4] 2> 372628 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
>> o.a.s.c.ZkController I am the leader, no recovery necessary
>> [junit4] 2> 372666 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
>> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
>> params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT}
>> status=0 QTime=1823
>> [junit4] 2> 372668 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
>> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
>> params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n2&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT}
>> status=0 QTime=1824
>> [junit4] 2> 372679 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il
>> c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null
>> path=/admin/collections params={node=127.0.0.1:61332_il&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2}
>> status=0 QTime=1972
>> [junit4] 2> 372680 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
>> c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null
>> path=/admin/collections params={node=127.0.0.1:61327_il&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2}
>> status=0 QTime=1971
>> [junit4] 2> 372749 INFO (zkCallback-1869-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
>> state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json] for collection [collection1] has
>> occurred - updating... (live nodes size: [4])
>> [junit4] 2> 372749 INFO (zkCallba
>>
>> [...truncated too long message...]
>>
>> 435163 INFO (closeThreadPool-2071-thread-3) [ ] o.e.j.s.session
>> node0 Stopped scavenging
>> [junit4] 2> 435200 INFO (closeThreadPool-2071-thread-2) [ ]
>> o.a.s.c.Overseer Overseer
>> (id=72232415561777156-127.0.0.1:61294_il-n_0000000000) closing
>> [junit4] 2> 435200 INFO (zkCallback-1913-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
>> [junit4] 2> 435215 INFO (closeThreadPool-2071-thread-2) [ ]
>> o.e.j.s.AbstractConnector Stopped ServerConnector@60c39296{HTTP/1.1,
>> (http/1.1, h2c)}{127.0.0.1:0}
>> [junit4] 2> 435217 INFO (closeThreadPool-2071-thread-2) [ ]
>> o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@196e435e
>> {/il,null,UNAVAILABLE}
>> [junit4] 2> 435217 INFO (closeThreadPool-2071-thread-2) [ ]
>> o.e.j.s.session node0 Stopped scavenging
>> [junit4] 2> 435331 INFO (closeThreadPool-2071-thread-1) [ ]
>> o.e.j.s.AbstractConnector Stopped ServerConnector@7365123b{HTTP/1.1,
>> (http/1.1, h2c)}{127.0.0.1:0}
>> [junit4] 2> 435333 INFO (closeThreadPool-2071-thread-1) [ ]
>> o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@186a191
>> {/il,null,UNAVAILABLE}
>> [junit4] 2> 435333 INFO (closeThreadPool-2071-thread-1) [ ]
>> o.e.j.s.session node0 Stopped scavenging
>> [junit4] 2> 435337 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer Shutting down ZkTestServer.
>> [junit4] 2> 435554 WARN (ZkTestServer Run Thread) [ ]
>> o.a.s.c.ZkTestServer Watch limit violations:
>> [junit4] 2> Maximum concurrent create/delete watches above limit:
>> [junit4] 2>
>> [junit4] 2> 7 /solr/collections/collection1/terms/shard2
>> [junit4] 2> 6 /solr/aliases.json
>> [junit4] 2> 4 /solr/packages.json
>> [junit4] 2> 4 /solr/security.json
>> [junit4] 2> 4 /solr/configs/conf1
>> [junit4] 2> 3
>> /solr/collections/collection1/collectionprops.json
>> [junit4] 2> 3
>> /solr/collections/ocptest_shardsplit2/terms/shard2_0
>> [junit4] 2> 3
>> /solr/collections/ocptest_shardsplit2/terms/shard1_1
>> [junit4] 2> 3
>> /solr/collections/ocptest_shardsplit2/terms/shard1_0
>> [junit4] 2> 3
>> /solr/collections/control_collection/terms/shard1
>> [junit4] 2> 3
>> /solr/collections/ocptest_shardsplit2/terms/shard2_1
>> [junit4] 2> 3 /solr/collections/collection1/terms/shard1
>> [junit4] 2> 3
>> /solr/collections/ocptest_shardsplit2/collectionprops.json
>> [junit4] 2> 2
>> /solr/collections/ocptest_shardsplit2/terms/shard2
>> [junit4] 2> 2
>> /solr/collections/ocptest_shardsplit2/terms/shard3
>> [junit4] 2> 2
>> /solr/collections/ocptest_shardsplit2/terms/shard1
>> [junit4] 2> 2 /solr/collections/ocptest1/terms/shard1
>> [junit4] 2> 2 /solr/collections/ocptest2/terms/shard1
>> [junit4] 2> 2 /solr/collections/ocptest2/terms/shard2
>> [junit4] 2> 2 /solr/collections/ocptest3/terms/shard2
>> [junit4] 2> 2 /solr/collections/ocptest3/terms/shard3
>> [junit4] 2> 2 /solr/collections/ocptest3/terms/shard1
>> [junit4] 2> 2
>> /solr/collections/collection1/terms/shard1_0
>> [junit4] 2> 2
>> /solr/collections/ocptest_shardsplit/terms/shard4
>> [junit4] 2> 2 /solr/collections/ocptest2/terms/shard3
>> [junit4] 2> 2
>> /solr/collections/ocptest_shardsplit/terms/shard3
>> [junit4] 2> 2
>> /solr/collections/ocptest_shardsplit/terms/shard2
>> [junit4] 2> 2 /solr/collections/ocptest1/terms/shard3
>> [junit4] 2> 2
>> /solr/collections/ocptest_shardsplit/terms/shard1
>> [junit4] 2> 2 /solr/collections/ocptest1/terms/shard2
>> [junit4] 2>
>> [junit4] 2> Maximum concurrent data watches above limit:
>> [junit4] 2>
>> [junit4] 2> 131
>> /solr/collections/ocptest_shardsplit2/state.json
>> [junit4] 2> 79 /solr/collections/collection1/state.json
>> [junit4] 2> 43 /solr/collections/ocptest1/state.json
>> [junit4] 2> 41
>> /solr/collections/ocptest_shardsplit/state.json
>> [junit4] 2> 33 /solr/collections/ocptest3/state.json
>> [junit4] 2> 33 /solr/collections/ocptest2/state.json
>> [junit4] 2> 12
>> /solr/collections/control_collection/state.json
>> [junit4] 2> 6 /solr/clusterprops.json
>> [junit4] 2> 6 /solr/clusterstate.json
>> [junit4] 2> 3
>> /solr/overseer_elect/election/72232415561777156-127.0.0.1:61294_il-n_0000000000
>> [junit4] 2>
>> [junit4] 2> Maximum concurrent children watches above limit:
>> [junit4] 2>
>> [junit4] 2> 127 /solr/overseer/queue
>> [junit4] 2> 48 /solr/overseer/collection-queue-work
>> [junit4] 2> 31 /solr/collections
>> [junit4] 2> 25 /solr/live_nodes
>> [junit4] 2>
>> [junit4] 2> 435558 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:61290
>> [junit4] 2> 435558 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:61290
>> [junit4] 2> 435558 INFO
>> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
>> o.a.s.c.ZkTestServer connecting to 127.0.0.1 61290
>> [junit4] 2> NOTE: reproduce with: ant test
>> -Dtestcase=MultiThreadedOCPTest -Dtests.method=test
>> -Dtests.seed=E6EA690F0B5FD1D1 -Dtests.slow=true -Dtests.locale=yue-Hant
>> -Dtests.timezone=IET -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
>> [junit4] FAILURE 70.0s J1 | MultiThreadedOCPTest.test <<<
>> [junit4] > Throwable #1: java.lang.AssertionError: acoll:
>> 1594109474089 bcoll: 1594109474958
>> [junit4] > at
>> __randomizedtesting.SeedInfo.seed([E6EA690F0B5FD1D1:6EBE56D5A5A3BC29]:0)
>> [junit4] > at
>> org.apache.solr.cloud.MultiThreadedOCPTest.testFillWorkQueue(MultiThreadedOCPTest.java:113)
>> [junit4] > at
>> org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:68)
>> [junit4] > at
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
>> Method)
>> [junit4] > at
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> [junit4] > at
>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> [junit4] > at
>> java.base/java.lang.reflect.Method.invoke(Method.java:564)
>> [junit4] > at
>> org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
>> [junit4] > at
>> org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
>> [junit4] > at java.base/java.lang.Thread.run(Thread.java:832)
>> [junit4] 2> NOTE: leaving temporary files on disk at:
>> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001
>> [junit4] 2> Jul 07, 2020 8:11:23 AM
>> com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
>> [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked
>> thread(s).
>> [junit4] 2> NOTE: test params are: codec=Asserting(Lucene86):
>> {range_facet_l_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)),
>> multiDefault=PostingsFormat(name=Direct),
>> _root_=PostingsFormat(name=LuceneVarGapFixedInterval),
>> intDefault=PostingsFormat(name=LuceneVarGapFixedInterval),
>> id_i1=PostingsFormat(name=Direct),
>> id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)),
>> range_facet_i_dv=PostingsFormat(name=LuceneVarGapFixedInterval),
>> range_facet_l=PostingsFormat(name=LuceneVarGapFixedInterval),
>> timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)},
>> docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting),
>> _version_=DocValuesFormat(name=Lucene80),
>> range_facet_i_dv=DocValuesFormat(name=Lucene80),
>> intDvoDefault=DocValuesFormat(name=Direct),
>> timestamp=DocValuesFormat(name=Lucene80)}, maxPointsInLeafNode=1938,
>> maxMBSortInHeap=6.402907350715655,
>> sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=yue-Hant,
>> timezone=IET
>> [junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14.0.1
>> (64-bit)/cpus=6,threads=1,free=226492416,total=536870912
>> [junit4] 2> NOTE: All tests run in this JVM: [MergeStrategyTest,
>> SimplePostToolTest, TestHdfsBackupRestoreCore, DeleteShardTest,
>> UpdateLogTest, BlockDirectoryTest, TestJavabinTupleStreamParser,
>> AutoAddReplicasIntegrationTest, MetricTriggerIntegrationTest,
>> TestPKIAuthenticationPlugin, TestNRTOpen, TestAddFieldRealTimeGet,
>> XsltUpdateRequestHandlerTest, SOLR749Test, TestReload,
>> TestSolrFieldCacheBean, HdfsCollectionsAPIDistributedZkTest,
>> TestDownShardTolerantSearch, TestMultiWordSynonyms,
>> BasicDistributedZk2Test, PeerSyncWithIndexFingerprintCachingTest,
>> MultiThreadedOCPTest]
>> [junit4] Completed [108/914 (1!)] on J1 in 70.45s, 1 test, 1 failure
>> <<< FAILURES!
>>
>> [...truncated 47618 lines...]
>> [repro] Jenkins log URL:
>> https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/100/consoleText
>>
>> [repro] Revision: a9c5fb0da2dfc8c7375622c80dbf1a0cc26f44dc
>>
>> [repro] Ant options: "-Dargs=-XX:-UseCompressedOops
>> -XX:+UnlockExperimentalVMOptions -XX:+UseZGC"
>> [repro] Repro line: ant test -Dtestcase=MultiThreadedOCPTest
>> -Dtests.method=test -Dtests.seed=E6EA690F0B5FD1D1 -Dtests.slow=true
>> -Dtests.locale=yue-Hant -Dtests.timezone=IET -Dtests.asserts=true
>> -Dtests.file.encoding=US-ASCII
>>
>> [repro] JUnit rest result XML files will be moved to: ./repro-reports
>> [repro] ant clean
>>
>> [...truncated 6 lines...]
>> [repro] Test suites by module:
>> [repro] solr/core
>> [repro] MultiThreadedOCPTest
>> [repro] ant compile-test
>>
>> [...truncated 3472 lines...]
>> [repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5
>> -Dtests.class="*.MultiThreadedOCPTest" -Dtests.showOutput=onerror
>> "-Dargs=-XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions
>> -XX:+UseZGC" -Dtests.seed=E6EA690F0B5FD1D1 -Dtests.slow=true
>> -Dtests.locale=yue-Hant -Dtests.timezone=IET -Dtests.asserts=true
>> -Dtests.file.encoding=US-ASCII
>>
>> [...truncated 86 lines...]
>> [repro] Failures w/original seeds:
>> [repro] 0/5 failed: org.apache.solr.cloud.MultiThreadedOCPTest
>> [repro] Exiting with code 0
>>
>> [...truncated 91 lines...]
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: builds-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: builds-help@lucene.apache.org
>
>
Re: [JENKINS-Experimental-GC] Lucene-Solr-8.6-MacOSX
(64bit/jdk-14.0.1) - Build # 100 - Still Unstable!
Posted by Ilan Ginzburg <il...@gmail.com>.
Note: it is expected for MultiThreadedOCPTest to fail from time to time on
the 8x branch as SOLR-14546
<https://issues.apache.org/jira/browse/SOLR-14546> was only fixed in 9.0.
Such failures would be unexpected on master.
Ilan
On Tue, Jul 7, 2020 at 11:11 AM Policeman Jenkins Server <
jenkins@thetaphi.de> wrote:
> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/100/
> Java: 64bit/jdk-14.0.1 -XX:-UseCompressedOops
> -XX:+UnlockExperimentalVMOptions -XX:+UseZGC
>
> 1 tests failed.
> FAILED: org.apache.solr.cloud.MultiThreadedOCPTest.test
>
> Error Message:
> acoll: 1594109474089 bcoll: 1594109474958
>
> Stack Trace:
> java.lang.AssertionError: acoll: 1594109474089 bcoll: 1594109474958
> at
> __randomizedtesting.SeedInfo.seed([E6EA690F0B5FD1D1:6EBE56D5A5A3BC29]:0)
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at
> org.apache.solr.cloud.MultiThreadedOCPTest.testFillWorkQueue(MultiThreadedOCPTest.java:113)
> at
> org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:68)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:564)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
> at
> org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
> at
> org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
> at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> at java.base/java.lang.Thread.run(Thread.java:832)
>
>
>
>
> Build Log:
> [...truncated 13732 lines...]
> [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
> [junit4] 2> 365607 INFO
> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
> o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to
> test-framework derived value of
> '/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/server/solr/configsets/_default/conf'
> [junit4] 2> 365607 INFO
> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
> o.a.s.SolrTestCaseJ4 SecureRandom sanity checks:
> test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
> [junit4] 2> 365608 INFO
> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
> o.a.s.SolrTestCaseJ4 Created dataDir:
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/data-dir-21-001
> [junit4] 2> 365608 WARN
> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
> o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
> [junit4] 2> 365609 INFO
> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
> o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false)
> w/NUMERIC_DOCVALUES_SYSPROP=false
> [junit4] 2> 365610 INFO
> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
> o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via:
> @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0,
> clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
> [junit4] 2> 365610 INFO
> (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ]
> o.a.s.BaseDistributedSearchTestCase Setting hostContext system property:
> /il/
> [junit4] 2> 365634 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
> [junit4] 2> 365634 INFO (ZkTestServer Run Thread) [ ]
> o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
> [junit4] 2> 365634 INFO (ZkTestServer Run Thread) [ ]
> o.a.s.c.ZkTestServer Starting server
> [junit4] 2> 365737 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer start zk server on port: 61290
> [junit4] 2> 365737 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:61290
> [junit4] 2> 365737 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:61290
> [junit4] 2> 365737 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer connecting to 127.0.0.1 61290
> [junit4] 2> 365743 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 365755 INFO (zkConnectionManagerCallback-1807-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 365755 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 365763 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 365768 INFO (zkConnectionManagerCallback-1809-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 365768 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 365774 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer put
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
> to /configs/conf1/solrconfig.xml
> [junit4] 2> 365780 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer put
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml
> to /configs/conf1/schema.xml
> [junit4] 2> 365784 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer put
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
> to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
> [junit4] 2> 365787 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer put
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
> to /configs/conf1/stopwords.txt
> [junit4] 2> 365791 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer put
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt
> to /configs/conf1/protwords.txt
> [junit4] 2> 365794 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer put
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml
> to /configs/conf1/currency.xml
> [junit4] 2> 365797 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer put
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
> to /configs/conf1/enumsConfig.xml
> [junit4] 2> 365800 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer put
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
> to /configs/conf1/open-exchange-rates.json
> [junit4] 2> 365803 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer put
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
> to /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4] 2> 365807 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer put
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
> to /configs/conf1/old_synonyms.txt
> [junit4] 2> 365810 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer put
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
> to /configs/conf1/synonyms.txt
> [junit4] 2> 365813 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless
> explicitly asked otherwise
> [junit4] 2> 366243 WARN
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content,
> break even is size 23
> [junit4] 2> 366244 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
> [junit4] 2> 366244 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
> [junit4] 2> 366244 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z;
> git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
> [junit4] 2> 366247 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.s.session DefaultSessionIdManager workerName=node0
> [junit4] 2> 366247 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.s.session No SessionScavenger set, using defaults
> [junit4] 2> 366247 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.s.session node0 Scavenging every 600000ms
> [junit4] 2> 366249 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@196e435e
> {/il,null,AVAILABLE}
> [junit4] 2> 366251 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.s.AbstractConnector Started ServerConnector@60c39296{HTTP/1.1,
> (http/1.1, h2c)}{127.0.0.1:61294}
> [junit4] 2> 366251 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.s.Server Started @366377ms
> [junit4] 2> 366251 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il,
> solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/control/data,
> hostPort=61294,
> coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores}
> [junit4] 2> 366252 ERROR
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
> be missing or incomplete.
> [junit4] 2> 366252 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.s.SolrDispatchFilter Using logger factory
> org.apache.logging.slf4j.Log4jLoggerFactory
> [junit4] 2> 366252 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
> version 8.6.0
> [junit4] 2> 366252 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
> null
> [junit4] 2> 366252 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir:
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
> [junit4] 2> 366252 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
> 2020-07-07T08:10:14.352578Z
> [junit4] 2> 366255 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 366259 INFO (zkConnectionManagerCallback-1811-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 366259 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 366365 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
> ZooKeeper)
> [junit4] 2> 366365 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.SolrXmlConfig Loading container configuration from
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/solr.xml
> [junit4] 2> 366378 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.SolrXmlConfig Configuration parameter
> autoReplicaFailoverWorkLoopDelay is ignored
> [junit4] 2> 366378 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.SolrXmlConfig Configuration parameter
> autoReplicaFailoverBadNodeExpiration is ignored
> [junit4] 2> 366382 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters
> were configured - adding default JMX reporter.
> [junit4] 2> 366570 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized:
> WhitelistHostChecker [whitelistHosts=null,
> whitelistHostCheckingEnabled=false]
> [junit4] 2> 366576 WARN
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.u.s.S.config Trusting all certificates configured for Client@b8d7e06
> [provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 366576 WARN
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
> Client@b8d7e06[provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 366584 WARN
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.u.s.S.config Trusting all certificates configured for Client@13785524
> [provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 366584 WARN
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
> Client@13785524[provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 366586 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
> [junit4] 2> 366588 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 366592 INFO (zkConnectionManagerCallback-1822-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 366592 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 366712 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 366714 INFO (zkConnectionManagerCallback-1824-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 366714 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 367090 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.c.OverseerElectionContext I am going to be the leader
> 127.0.0.1:61294_il
> [junit4] 2> 367092 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.c.Overseer Overseer
> (id=72232415561777156-127.0.0.1:61294_il-n_0000000000) starting
> [junit4] 2> 367113 INFO
> (OverseerStateUpdate-72232415561777156-127.0.0.1:61294_il-n_0000000000)
> [n:127.0.0.1:61294_il ] o.a.s.c.Overseer Starting to work on the main
> queue : 127.0.0.1:61294_il
> [junit4] 2> 367120 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/
> 127.0.0.1:61294_il
> [junit4] 2> 367136 INFO (zkCallback-1823-thread-1) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
> [junit4] 2> 367151 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.p.PackageLoader /packages.json updated to version -1
> [junit4] 2> 367154 WARN
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.c.CoreContainer Not all security plugins configured!
> authentication=disabled authorization=disabled. Solr is only as secure as
> you make it. Consider configuring authentication/authorization before
> exposing Solr to users internal or external. See
> https://s.apache.org/solrsecurity for more info
> [junit4] 2> 367186 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics
> history in memory.
> [junit4] 2> 367214 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry
> 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 367226 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry
> 'solr.jvm') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 367226 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry
> 'solr.jetty') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 367229 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il
> ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores
> [junit4] 2> 367244 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 367247 INFO (zkConnectionManagerCallback-1841-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 367248 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 367251 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
> [junit4] 2> 367256 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:61290/solr
> ready
> [junit4] 2> 367261 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
> ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with
> params
> collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:61294_il&wt=javabin&version=2
> and sendToOCPQueue=true
> [junit4] 2> 367272 INFO
> (OverseerThreadFactory-1831-thread-1-processing-n:127.0.0.1:61294_il)
> [n:127.0.0.1:61294_il ] o.a.s.c.a.c.CreateCollectionCmd Create
> collection control_collection
> [junit4] 2> 367388 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il
> ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
> transient cores
> [junit4] 2> 367392 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il
> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
> params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
> status=0 QTime=4
> [junit4] 2> 367412 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation
> core create command
> qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
> [junit4] 2> 368439 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
> [junit4] 2> 368452 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.s.IndexSchema Schema name=test
> [junit4] 2> 368523 WARN (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class
> [solr.EnumField]. Please consult documentation how to replace it
> accordingly.
> [junit4] 2> 368630 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
> [junit4] 2> 368665 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.CoreContainer Creating SolrCore
> 'control_collection_shard1_replica_n1' using configuration from configset
> conf1, trusted=true
> [junit4] 2> 368665 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.core.control_collection.shard1.replica_n1' (registry
> 'solr.core.control_collection.shard1.replica_n1') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 368665 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new
> SolrCore at
> [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores/control_collection_shard1_replica_n1],
> dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores/control_collection_shard1_replica_n1/data/]
> [junit4] 2> 368667 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=33, maxMergeAtOnceExplicit=17,
> maxMergedSegmentMB=92.99609375, floorSegmentMB=1.458984375,
> forceMergeDeletesPctAllowed=13.45063000950353, segmentsPerTier=24.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15388833146547976,
> deletesPctAllowed=28.27740993910293
> [junit4] 2> 368669 WARN (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
> {initParams=a, name=/dump, class=DumpRequestHandler},args =
> {defaults={a=A,b=B}}}
> [junit4] 2> 368726 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.u.UpdateHandler Using UpdateLog implementation:
> org.apache.solr.update.UpdateLog
> [junit4] 2> 368726 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
> [junit4] 2> 368727 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
> [junit4] 2> 368728 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
> [junit4] 2> 368728 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=31, maxMergeAtOnceExplicit=13,
> maxMergedSegmentMB=82.12890625, floorSegmentMB=1.560546875,
> forceMergeDeletesPctAllowed=20.77586369497545, segmentsPerTier=36.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0,
> deletesPctAllowed=20.920356383090496
> [junit4] 2> 368731 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
> znodeBase: /configs/conf1
> [junit4] 2> 368732 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
> ZooKeeperStorageIO:path=/configs/conf1
> [junit4] 2> 368732 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
> [junit4] 2> 368732 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.u.UpdateLog Could not find max version in index or recent updates,
> using new clock 1671544875864031232
> [junit4] 2> 368735 INFO (searcherExecutor-1843-thread-1-processing-n:
> 127.0.0.1:61294_il x:control_collection_shard1_replica_n1
> c:control_collection s:shard1) [n:127.0.0.1:61294_il c:control_collection
> s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore
> [control_collection_shard1_replica_n1] Registered new searcher autowarm
> time: 0 ms
> [junit4] 2> 368740 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.ZkShardTerms Successful update of terms at
> /collections/control_collection/terms/shard1 to
> Terms{values={core_node2=0}, version=0}
> [junit4] 2> 368740 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.ShardLeaderElectionContextBase make sure parent is created
> /collections/control_collection/leaders/shard1
> [junit4] 2> 368746 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
> [junit4] 2> 368746 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
> [junit4] 2> 368746 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.SyncStrategy Sync replicas to
> http://127.0.0.1:61294/il/control_collection_shard1_replica_n1/
> [junit4] 2> 368747 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
> [junit4] 2> 368747 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.SyncStrategy
> http://127.0.0.1:61294/il/control_collection_shard1_replica_n1/ has no
> replicas
> [junit4] 2> 368747 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
> /collections/control_collection/leaders/shard1/leader after winning as
> /collections/control_collection/leader_elect/shard1/election/72232415561777156-core_node2-n_0000000000
> [junit4] 2> 368751 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.ShardLeaderElectionContext I am the new leader:
> http://127.0.0.1:61294/il/control_collection_shard1_replica_n1/ shard1
> [junit4] 2> 368855 INFO (zkCallback-1823-thread-1) [ ]
> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
> state:SyncConnected type:NodeDataChanged
> path:/collections/control_collection/state.json] for collection
> [control_collection] has occurred - updating... (live nodes size: [1])
> [junit4] 2> 368855 INFO (zkCallback-1823-thread-2) [ ]
> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
> state:SyncConnected type:NodeDataChanged
> path:/collections/control_collection/state.json] for collection
> [control_collection] has occurred - updating... (live nodes size: [1])
> [junit4] 2> 368858 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ]
> o.a.s.c.ZkController I am the leader, no recovery necessary
> [junit4] 2> 368862 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
> params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT}
> status=0 QTime=1450
> [junit4] 2> 368865 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
> ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for
> at most 45 seconds. Check all shard replicas
> [junit4] 2> 368973 INFO (zkCallback-1823-thread-2) [ ]
> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
> state:SyncConnected type:NodeDataChanged
> path:/collections/control_collection/state.json] for collection
> [control_collection] has occurred - updating... (live nodes size: [1])
> [junit4] 2> 368973 INFO (zkCallback-1823-thread-1) [ ]
> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
> state:SyncConnected type:NodeDataChanged
> path:/collections/control_collection/state.json] for collection
> [control_collection] has occurred - updating... (live nodes size: [1])
> [junit4] 2> 368973 INFO (zkCallback-1823-thread-3) [ ]
> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
> state:SyncConnected type:NodeDataChanged
> path:/collections/control_collection/state.json] for collection
> [control_collection] has occurred - updating... (live nodes size: [1])
> [junit4] 2> 368974 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
> params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:61294_il&wt=javabin&version=2}
> status=0 QTime=1712
> [junit4] 2> 368974 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in
> collection: control_collection
> [junit4] 2> 369093 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 369096 INFO (zkConnectionManagerCallback-1852-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 369097 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 369098 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
> [junit4] 2> 369101 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:61290/solr
> ready
> [junit4] 2> 369101 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection
> loss:false
> [junit4] 2> 369103 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
> ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with
> params
> collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2
> and sendToOCPQueue=true
> [junit4] 2> 369109 INFO
> (OverseerThreadFactory-1831-thread-2-processing-n:127.0.0.1:61294_il)
> [n:127.0.0.1:61294_il ] o.a.s.c.a.c.CreateCollectionCmd Create
> collection collection1
> [junit4] 2> 369109 INFO
> (OverseerCollectionConfigSetProcessor-72232415561777156-127.0.0.1:61294_il-n_0000000000)
> [n:127.0.0.1:61294_il ] o.a.s.c.OverseerTaskQueue Response ZK path:
> /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may
> have disconnected from ZooKeeper
> [junit4] 2> 369335 WARN
> (OverseerThreadFactory-1831-thread-2-processing-n:127.0.0.1:61294_il)
> [n:127.0.0.1:61294_il ] o.a.s.c.a.c.CreateCollectionCmd It is unusual
> to create a collection (collection1) without cores.
> [junit4] 2> 369344 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
> ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for
> at most 45 seconds. Check all shard replicas
> [junit4] 2> 369350 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
> params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2}
> status=0 QTime=247
> [junit4] 2> 369351 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
> [junit4] 2> 369351 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
> [junit4] 2> 369352 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
> [junit4] 2> 369352 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
> [junit4] 2> 369353 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
> [junit4] 2> 369353 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
> [junit4] 2> 369353 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances
> pullReplicaCount=0 numOtherReplicas=3
> [junit4] 2> 369605 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001
> of type NRT for shard2
> [junit4] 2> 369606 WARN (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content,
> break even is size 23
> [junit4] 2> 369606 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
> [junit4] 2> 369606 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
> [junit4] 2> 369606 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z;
> git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
> [junit4] 2> 369609 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.session DefaultSessionIdManager workerName=node0
> [junit4] 2> 369609 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.session No SessionScavenger set, using defaults
> [junit4] 2> 369609 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.session node0 Scavenging every 600000ms
> [junit4] 2> 369610 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6221549f
> {/il,null,AVAILABLE}
> [junit4] 2> 369611 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.AbstractConnector Started ServerConnector@1dfdcc2b{HTTP/1.1,
> (http/1.1, h2c)}{127.0.0.1:61327}
> [junit4] 2> 369611 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.Server Started @369737ms
> [junit4] 2> 369611 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il,
> solrconfig=solrconfig.xml,
> solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/jetty1,
> hostPort=61327,
> coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores}
> [junit4] 2> 369612 ERROR (closeThreadPool-1853-thread-1) [ ]
> o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
> be missing or incomplete.
> [junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter Using logger factory
> org.apache.logging.slf4j.Log4jLoggerFactory
> [junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
> version 8.6.0
> [junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
> null
> [junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir:
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
> [junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
> 2020-07-07T08:10:17.712474Z
> [junit4] 2> 369613 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 369617 INFO (zkConnectionManagerCallback-1855-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 369617 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 369720 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
> ZooKeeper)
> [junit4] 2> 369720 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.SolrXmlConfig Loading container configuration from
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/solr.xml
> [junit4] 2> 369724 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.SolrXmlConfig Configuration parameter
> autoReplicaFailoverWorkLoopDelay is ignored
> [junit4] 2> 369724 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.SolrXmlConfig Configuration parameter
> autoReplicaFailoverBadNodeExpiration is ignored
> [junit4] 2> 369726 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters
> were configured - adding default JMX reporter.
> [junit4] 2> 369790 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized:
> WhitelistHostChecker [whitelistHosts=null,
> whitelistHostCheckingEnabled=false]
> [junit4] 2> 369790 WARN (closeThreadPool-1853-thread-1) [ ]
> o.e.j.u.s.S.config Trusting all certificates configured for Client@7e2a7c4c
> [provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 369790 WARN (closeThreadPool-1853-thread-1) [ ]
> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
> Client@7e2a7c4c[provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 369796 WARN (closeThreadPool-1853-thread-1) [ ]
> o.e.j.u.s.S.config Trusting all certificates configured for Client@3be4fae2
> [provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 369796 WARN (closeThreadPool-1853-thread-1) [ ]
> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
> Client@3be4fae2[provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 369798 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
> [junit4] 2> 369799 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 369803 INFO (zkConnectionManagerCallback-1866-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 369803 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 369859 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001
> of type NRT for shard1
> [junit4] 2> 369860 WARN (closeThreadPool-1853-thread-2) [ ]
> o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content,
> break even is size 23
> [junit4] 2> 369860 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
> [junit4] 2> 369860 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
> [junit4] 2> 369860 INFO (closeThreadPool-1853-thread-2) [ ]
> o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z;
> git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
> [junit4] 2> 369862 INFO (closeThreadPool-1853-thread-2) [ ]
> o.e.j.s.session DefaultSessionIdManager workerName=node0
> [junit4] 2> 369862 INFO (closeThreadPool-1853-thread-2) [ ]
> o.e.j.s.session No SessionScavenger set, using defaults
> [junit4] 2> 369862 INFO (closeThreadPool-1853-thread-2) [ ]
> o.e.j.s.session node0 Scavenging every 660000ms
> [junit4] 2> 369863 INFO (closeThreadPool-1853-thread-2) [ ]
> o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36ad93b5
> {/il,null,AVAILABLE}
> [junit4] 2> 369864 INFO (closeThreadPool-1853-thread-2) [ ]
> o.e.j.s.AbstractConnector Started ServerConnector@1ed6717f{HTTP/1.1,
> (http/1.1, h2c)}{127.0.0.1:61332}
> [junit4] 2> 369864 INFO (closeThreadPool-1853-thread-2) [ ]
> o.e.j.s.Server Started @369989ms
> [junit4] 2> 369864 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il,
> solrconfig=solrconfig.xml,
> solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/jetty2,
> hostPort=61332,
> coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores}
> [junit4] 2> 369864 ERROR (closeThreadPool-1853-thread-2) [ ]
> o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
> be missing or incomplete.
> [junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.s.SolrDispatchFilter Using logger factory
> org.apache.logging.slf4j.Log4jLoggerFactory
> [junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
> version 8.6.0
> [junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
> null
> [junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir:
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
> [junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
> 2020-07-07T08:10:17.965193Z
> [junit4] 2> 369866 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 369869 INFO (zkConnectionManagerCallback-1868-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 369870 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 369912 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.c.c.ConnectionManager Waiting for
> client to connect to ZooKeeper
> [junit4] 2> 369914 INFO (zkConnectionManagerCallback-1870-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 369914 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.c.c.ConnectionManager Client is
> connected to ZooKeeper
> [junit4] 2> 369926 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.c.c.ZkStateReader Updated live nodes
> from ZooKeeper... (0) -> (1)
> [junit4] 2> 369936 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.c.ZkController Publish
> node=127.0.0.1:61327_il as DOWN
> [junit4] 2> 369938 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.c.TransientSolrCoreCacheDefault
> Allocating transient cache for 4 transient cores
> [junit4] 2> 369938 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.c.ZkController Register node as live in
> ZooKeeper:/live_nodes/127.0.0.1:61327_il
> [junit4] 2> 369941 INFO (zkCallback-1823-thread-2) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
> [junit4] 2> 369941 INFO (zkCallback-1851-thread-1) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
> [junit4] 2> 369941 INFO (zkCallback-1869-thread-1) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
> [junit4] 2> 369946 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.p.PackageLoader /packages.json updated
> to version -1
> [junit4] 2> 369946 WARN (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.c.CoreContainer Not all security
> plugins configured! authentication=disabled authorization=disabled. Solr
> is only as secure as you make it. Consider configuring
> authentication/authorization before exposing Solr to users internal or
> external. See https://s.apache.org/solrsecurity for more info
> [junit4] 2> 369971 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.h.a.MetricsHistoryHandler No .system
> collection, keeping metrics history in memory.
> [junit4] 2> 369995 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.node' (registry 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 370004 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.jvm' (registry 'solr.jvm') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 370005 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.jetty' (registry 'solr.jetty') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 370007 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61327_il ] o.a.s.c.CorePropertiesLocator Found 0 core
> definitions underneath
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores
> [junit4] 2> 370011 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
> ZooKeeper)
> [junit4] 2> 370011 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.SolrXmlConfig Loading container configuration from
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/solr.xml
> [junit4] 2> 370015 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.SolrXmlConfig Configuration parameter
> autoReplicaFailoverWorkLoopDelay is ignored
> [junit4] 2> 370015 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.SolrXmlConfig Configuration parameter
> autoReplicaFailoverBadNodeExpiration is ignored
> [junit4] 2> 370017 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters
> were configured - adding default JMX reporter.
> [junit4] 2> 370020 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:61327_il
> [junit4] 2> 370068 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized:
> WhitelistHostChecker [whitelistHosts=null,
> whitelistHostCheckingEnabled=false]
> [junit4] 2> 370070 WARN (closeThreadPool-1853-thread-2) [ ]
> o.e.j.u.s.S.config Trusting all certificates configured for Client@f6899ad
> [provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 370070 WARN (closeThreadPool-1853-thread-2) [ ]
> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
> Client@f6899ad[provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 370074 WARN (closeThreadPool-1853-thread-2) [ ]
> o.e.j.u.s.S.config Trusting all certificates configured for Client@44d5c0c5
> [provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 370075 WARN (closeThreadPool-1853-thread-2) [ ]
> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
> Client@44d5c0c5[provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 370076 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
> [junit4] 2> 370078 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 370081 INFO (zkConnectionManagerCallback-1889-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 370081 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 370149 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001
> of type NRT for shard2
> [junit4] 2> 370150 WARN (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content,
> break even is size 23
> [junit4] 2> 370150 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
> [junit4] 2> 370150 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
> [junit4] 2> 370150 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z;
> git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
> [junit4] 2> 370151 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.session DefaultSessionIdManager workerName=node0
> [junit4] 2> 370151 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.session No SessionScavenger set, using defaults
> [junit4] 2> 370151 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.session node0 Scavenging every 600000ms
> [junit4] 2> 370152 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@186a191
> {/il,null,AVAILABLE}
> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.AbstractConnector Started ServerConnector@7365123b{HTTP/1.1,
> (http/1.1, h2c)}{127.0.0.1:61337}
> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
> o.e.j.s.Server Started @370278ms
> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il,
> solrconfig=solrconfig.xml,
> solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/jetty3,
> hostPort=61337,
> coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001/cores,
> replicaType=NRT}
> [junit4] 2> 370153 ERROR (closeThreadPool-1853-thread-1) [ ]
> o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
> be missing or incomplete.
> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter Using logger factory
> org.apache.logging.slf4j.Log4jLoggerFactory
> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
> version 8.6.0
> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
> null
> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir:
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
> [junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
> 2020-07-07T08:10:18.253975Z
> [junit4] 2> 370155 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 370158 INFO (zkConnectionManagerCallback-1891-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 370158 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 370193 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.c.c.ConnectionManager Waiting for
> client to connect to ZooKeeper
> [junit4] 2> 370195 INFO (zkConnectionManagerCallback-1893-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 370195 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.c.c.ConnectionManager Client is
> connected to ZooKeeper
> [junit4] 2> 370206 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.c.c.ZkStateReader Updated live nodes
> from ZooKeeper... (0) -> (2)
> [junit4] 2> 370216 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.c.ZkController Publish
> node=127.0.0.1:61332_il as DOWN
> [junit4] 2> 370217 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.c.TransientSolrCoreCacheDefault
> Allocating transient cache for 4 transient cores
> [junit4] 2> 370217 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.c.ZkController Register node as live in
> ZooKeeper:/live_nodes/127.0.0.1:61332_il
> [junit4] 2> 370221 INFO (zkCallback-1869-thread-1) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
> [junit4] 2> 370221 INFO (zkCallback-1823-thread-2) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
> [junit4] 2> 370221 INFO (zkCallback-1851-thread-1) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
> [junit4] 2> 370222 INFO (zkCallback-1892-thread-1) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
> [junit4] 2> 370226 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.p.PackageLoader /packages.json updated
> to version -1
> [junit4] 2> 370226 WARN (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.c.CoreContainer Not all security
> plugins configured! authentication=disabled authorization=disabled. Solr
> is only as secure as you make it. Consider configuring
> authentication/authorization before exposing Solr to users internal or
> external. See https://s.apache.org/solrsecurity for more info
> [junit4] 2> 370251 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.h.a.MetricsHistoryHandler No .system
> collection, keeping metrics history in memory.
> [junit4] 2> 370275 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.node' (registry 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 370287 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.jvm' (registry 'solr.jvm') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 370287 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.jetty' (registry 'solr.jetty') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 370289 INFO (closeThreadPool-1853-thread-2)
> [n:127.0.0.1:61332_il ] o.a.s.c.CorePropertiesLocator Found 0 core
> definitions underneath
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores
> [junit4] 2> 370293 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
> ZooKeeper)
> [junit4] 2> 370294 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.SolrXmlConfig Loading container configuration from
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001/solr.xml
> [junit4] 2> 370298 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.SolrXmlConfig Configuration parameter
> autoReplicaFailoverWorkLoopDelay is ignored
> [junit4] 2> 370298 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.SolrXmlConfig Configuration parameter
> autoReplicaFailoverBadNodeExpiration is ignored
> [junit4] 2> 370299 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.SolrXmlConfig MBean server found:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters
> were configured - adding default JMX reporter.
> [junit4] 2> 370321 INFO (closeThreadPool-1853-thread-2) [ ]
> o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:61332_il
> [junit4] 2> 370387 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized:
> WhitelistHostChecker [whitelistHosts=null,
> whitelistHostCheckingEnabled=false]
> [junit4] 2> 370389 WARN (closeThreadPool-1853-thread-1) [ ]
> o.e.j.u.s.S.config Trusting all certificates configured for Client@603817e
> [provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 370389 WARN (closeThreadPool-1853-thread-1) [ ]
> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
> Client@603817e[provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 370394 WARN (closeThreadPool-1853-thread-1) [ ]
> o.e.j.u.s.S.config Trusting all certificates configured for Client@60633c00
> [provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 370394 WARN (closeThreadPool-1853-thread-1) [ ]
> o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
> Client@60633c00[provider=null,keyStore=null,trustStore=null]
> [junit4] 2> 370395 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
> [junit4] 2> 370398 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
> [junit4] 2> 370404 INFO (zkConnectionManagerCallback-1912-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 370404 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> [junit4] 2> 370515 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.c.c.ConnectionManager Waiting for
> client to connect to ZooKeeper
> [junit4] 2> 370519 INFO (zkConnectionManagerCallback-1914-thread-1)
> [ ] o.a.s.c.c.ConnectionManager zkClient has connected
> [junit4] 2> 370519 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.c.c.ConnectionManager Client is
> connected to ZooKeeper
> [junit4] 2> 370543 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.c.c.ZkStateReader Updated live nodes
> from ZooKeeper... (0) -> (3)
> [junit4] 2> 370557 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.c.ZkController Publish
> node=127.0.0.1:61337_il as DOWN
> [junit4] 2> 370563 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.c.TransientSolrCoreCacheDefault
> Allocating transient cache for 4 transient cores
> [junit4] 2> 370564 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.c.ZkController Register node as live in
> ZooKeeper:/live_nodes/127.0.0.1:61337_il
> [junit4] 2> 370572 INFO (zkCallback-1851-thread-1) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
> [junit4] 2> 370572 INFO (zkCallback-1823-thread-2) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
> [junit4] 2> 370572 INFO (zkCallback-1869-thread-1) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
> [junit4] 2> 370573 INFO (zkCallback-1913-thread-1) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
> [junit4] 2> 370573 INFO (zkCallback-1892-thread-1) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
> [junit4] 2> 370597 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.p.PackageLoader /packages.json updated
> to version -1
> [junit4] 2> 370598 WARN (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.c.CoreContainer Not all security
> plugins configured! authentication=disabled authorization=disabled. Solr
> is only as secure as you make it. Consider configuring
> authentication/authorization before exposing Solr to users internal or
> external. See https://s.apache.org/solrsecurity for more info
> [junit4] 2> 370623 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.h.a.MetricsHistoryHandler No .system
> collection, keeping metrics history in memory.
> [junit4] 2> 370648 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.node' (registry 'solr.node') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 370660 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.jvm' (registry 'solr.jvm') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 370660 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.jetty' (registry 'solr.jetty') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 370663 INFO (closeThreadPool-1853-thread-1)
> [n:127.0.0.1:61337_il ] o.a.s.c.CorePropertiesLocator Found 0 core
> definitions underneath
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001/cores
> [junit4] 2> 370683 INFO (closeThreadPool-1853-thread-1) [ ]
> o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:61337_il
> [junit4] 2> 370707 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il
> ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica
> with params node=127.0.0.1:61332_il&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2
> and sendToOCPQueue=true
> [junit4] 2> 370709 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
> ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica
> with params node=127.0.0.1:61327_il&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2
> and sendToOCPQueue=true
> [junit4] 2> 370718 INFO (qtp1884586278-2968) [n:127.0.0.1:61294_il
> ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica
> with params node=127.0.0.1:61337_il&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2
> and sendToOCPQueue=true
> [junit4] 2> 370761 INFO
> (OverseerCollectionConfigSetProcessor-72232415561777156-127.0.0.1:61294_il-n_0000000000)
> [n:127.0.0.1:61294_il ] o.a.s.c.OverseerTaskQueue Response ZK path:
> /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may
> have disconnected from ZooKeeper
> [junit4] 2> 370801 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
> params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes}
> status=0 QTime=0
> [junit4] 2> 370804 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il
> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
> params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
> status=0 QTime=1
> [junit4] 2> 370810 INFO (qtp432167883-3024) [n:127.0.0.1:61327_il
> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
> params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
> status=0 QTime=1
> [junit4] 2> 370815 INFO (qtp451536634-3044) [n:127.0.0.1:61332_il
> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
> params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
> status=0 QTime=1
> [junit4] 2> 370822 INFO (qtp1354606003-3074) [n:127.0.0.1:61337_il
> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
> params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
> status=0 QTime=2
> [junit4] 2> 370827 INFO
> (OverseerThreadFactory-1831-thread-3-processing-n:127.0.0.1:61294_il)
> [n:127.0.0.1:61294_il c:collection1 s:shard1 ]
> o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:61332_il for creating
> new replica of shard shard1 for collection collection1
> [junit4] 2> 370832 INFO
> (OverseerThreadFactory-1831-thread-4-processing-n:127.0.0.1:61294_il)
> [n:127.0.0.1:61294_il c:collection1 s:shard2 ]
> o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:61327_il for creating
> new replica of shard shard2 for collection collection1
> [junit4] 2> 370834 INFO
> (OverseerThreadFactory-1831-thread-3-processing-n:127.0.0.1:61294_il)
> [n:127.0.0.1:61294_il c:collection1 s:shard1 ]
> o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
> [junit4] 2> 370838 INFO
> (OverseerThreadFactory-1831-thread-4-processing-n:127.0.0.1:61294_il)
> [n:127.0.0.1:61294_il c:collection1 s:shard2 ]
> o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
> [junit4] 2> 370843 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> x:collection1_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core
> create command
> qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
> [junit4] 2> 370844 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> x:collection1_shard2_replica_n2 ] o.a.s.h.a.CoreAdminOperation core
> create command
> qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n2&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
> [junit4] 2> 371885 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
> [junit4] 2> 371885 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
> [junit4] 2> 371902 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.s.IndexSchema Schema name=test
> [junit4] 2> 371912 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.s.IndexSchema Schema name=test
> [junit4] 2> 372202 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
> [junit4] 2> 372207 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
> [junit4] 2> 372296 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n2'
> using configuration from configset conf1, trusted=true
> [junit4] 2> 372297 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.core.collection1.shard2.replica_n2' (registry
> 'solr.core.collection1.shard2.replica_n2') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 372297 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SolrCore
> [[collection1_shard2_replica_n2] ] Opening new SolrCore at
> [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores/collection1_shard2_replica_n2],
> dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores/collection1_shard2_replica_n2/data/]
> [junit4] 2> 372300 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=33, maxMergeAtOnceExplicit=17,
> maxMergedSegmentMB=92.99609375, floorSegmentMB=1.458984375,
> forceMergeDeletesPctAllowed=13.45063000950353, segmentsPerTier=24.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15388833146547976,
> deletesPctAllowed=28.27740993910293
> [junit4] 2> 372306 WARN (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
> {initParams=a, name=/dump, class=DumpRequestHandler},args =
> {defaults={a=A,b=B}}}
> [junit4] 2> 372314 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1'
> using configuration from configset conf1, trusted=true
> [junit4] 2> 372315 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.m.r.SolrJmxReporter JMX monitoring for
> 'solr.core.collection1.shard1.replica_n1' (registry
> 'solr.core.collection1.shard1.replica_n1') enabled at server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
> [junit4] 2> 372316 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore
> [[collection1_shard1_replica_n1] ] Opening new SolrCore at
> [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores/collection1_shard1_replica_n1],
> dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores/collection1_shard1_replica_n1/data/]
> [junit4] 2> 372318 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=33, maxMergeAtOnceExplicit=17,
> maxMergedSegmentMB=92.99609375, floorSegmentMB=1.458984375,
> forceMergeDeletesPctAllowed=13.45063000950353, segmentsPerTier=24.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15388833146547976,
> deletesPctAllowed=28.27740993910293
> [junit4] 2> 372330 WARN (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
> requestHandler,name = /dump,class = DumpRequestHandler,attributes =
> {initParams=a, name=/dump, class=DumpRequestHandler},args =
> {defaults={a=A,b=B}}}
> [junit4] 2> 372394 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.u.UpdateHandler Using UpdateLog implementation:
> org.apache.solr.update.UpdateLog
> [junit4] 2> 372394 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.UpdateLog
> Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
> [junit4] 2> 372402 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
> [junit4] 2> 372402 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
> [junit4] 2> 372403 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=31, maxMergeAtOnceExplicit=13,
> maxMergedSegmentMB=82.12890625, floorSegmentMB=1.560546875,
> forceMergeDeletesPctAllowed=20.77586369497545, segmentsPerTier=36.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0,
> deletesPctAllowed=20.920356383090496
> [junit4] 2> 372413 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
> znodeBase: /configs/conf1
> [junit4] 2> 372417 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.u.UpdateHandler Using UpdateLog implementation:
> org.apache.solr.update.UpdateLog
> [junit4] 2> 372417 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog
> Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
> [junit4] 2> 372418 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
> ZooKeeperStorageIO:path=/configs/conf1
> [junit4] 2> 372419 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
> [junit4] 2> 372419 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.UpdateLog
> Could not find max version in index or recent updates, using new clock
> 1671544879730130944
> [junit4] 2> 372420 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
> [junit4] 2> 372422 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
> [junit4] 2> 372424 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
> org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
> maxMergeAtOnce=31, maxMergeAtOnceExplicit=13,
> maxMergedSegmentMB=82.12890625, floorSegmentMB=1.560546875,
> forceMergeDeletesPctAllowed=20.77586369497545, segmentsPerTier=36.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0,
> deletesPctAllowed=20.920356383090496
> [junit4] 2> 372426 INFO (searcherExecutor-1925-thread-1-processing-n:
> 127.0.0.1:61327_il x:collection1_shard2_replica_n2 c:collection1
> s:shard2) [n:127.0.0.1:61327_il c:collection1 s:shard2
> x:collection1_shard2_replica_n2 ] o.a.s.c.SolrCore
> [collection1_shard2_replica_n2] Registered new searcher autowarm time: 0 ms
> [junit4] 2> 372430 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with
> znodeBase: /configs/conf1
> [junit4] 2> 372432 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
> ZooKeeperStorageIO:path=/configs/conf1
> [junit4] 2> 372432 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
> [junit4] 2> 372432 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog
> Could not find max version in index or recent updates, using new clock
> 1671544879743762432
> [junit4] 2> 372436 INFO (searcherExecutor-1927-thread-1-processing-n:
> 127.0.0.1:61332_il x:collection1_shard1_replica_n1 c:collection1
> s:shard1) [n:127.0.0.1:61332_il c:collection1 s:shard1
> x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore
> [collection1_shard1_replica_n1] Registered new searcher autowarm time: 0 ms
> [junit4] 2> 372442 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.ZkShardTerms Successful update of terms at
> /collections/collection1/terms/shard2 to Terms{values={core_node4=0},
> version=0}
> [junit4] 2> 372442 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.ShardLeaderElectionContextBase make sure parent is created
> /collections/collection1/leaders/shard2
> [junit4] 2> 372452 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.ZkShardTerms Successful update of terms at
> /collections/collection1/terms/shard1 to Terms{values={core_node3=0},
> version=0}
> [junit4] 2> 372452 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.ShardLeaderElectionContextBase make sure parent is created
> /collections/collection1/leaders/shard1
> [junit4] 2> 372474 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
> [junit4] 2> 372474 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
> [junit4] 2> 372474 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.SyncStrategy Sync replicas to
> http://127.0.0.1:61327/il/collection1_shard2_replica_n2/
> [junit4] 2> 372476 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
> [junit4] 2> 372476 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
> [junit4] 2> 372476 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
> [junit4] 2> 372476 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.SyncStrategy Sync replicas to
> http://127.0.0.1:61332/il/collection1_shard1_replica_n1/
> [junit4] 2> 372479 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.SyncStrategy
> http://127.0.0.1:61327/il/collection1_shard2_replica_n2/ has no replicas
> [junit4] 2> 372479 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
> [junit4] 2> 372480 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
> /collections/collection1/leaders/shard2/leader after winning as
> /collections/collection1/leader_elect/shard2/election/72232415561777162-core_node4-n_0000000000
> [junit4] 2> 372485 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.SyncStrategy
> http://127.0.0.1:61332/il/collection1_shard1_replica_n1/ has no replicas
> [junit4] 2> 372485 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
> /collections/collection1/leaders/shard1/leader after winning as
> /collections/collection1/leader_elect/shard1/election/72232415561777165-core_node3-n_0000000000
> [junit4] 2> 372494 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.ShardLeaderElectionContext I am the new leader:
> http://127.0.0.1:61327/il/collection1_shard2_replica_n2/ shard2
> [junit4] 2> 372494 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.ShardLeaderElectionContext I am the new leader:
> http://127.0.0.1:61332/il/collection1_shard1_replica_n1/ shard1
> [junit4] 2> 372614 INFO (zkCallback-1892-thread-1) [ ]
> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
> state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
> [junit4] 2> 372614 INFO (zkCallback-1869-thread-1) [ ]
> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
> state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
> [junit4] 2> 372617 INFO (zkCallback-1892-thread-2) [ ]
> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
> state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
> [junit4] 2> 372624 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> c:collection1 s:shard2 x:collection1_shard2_replica_n2 ]
> o.a.s.c.ZkController I am the leader, no recovery necessary
> [junit4] 2> 372628 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> c:collection1 s:shard1 x:collection1_shard1_replica_n1 ]
> o.a.s.c.ZkController I am the leader, no recovery necessary
> [junit4] 2> 372666 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il
> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
> params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT}
> status=0 QTime=1823
> [junit4] 2> 372668 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il
> ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
> params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n2&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT}
> status=0 QTime=1824
> [junit4] 2> 372679 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il
> c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null
> path=/admin/collections params={node=127.0.0.1:61332_il&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2}
> status=0 QTime=1972
> [junit4] 2> 372680 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il
> c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null
> path=/admin/collections params={node=127.0.0.1:61327_il&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2}
> status=0 QTime=1971
> [junit4] 2> 372749 INFO (zkCallback-1869-thread-1) [ ]
> o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
> state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json] for collection [collection1] has
> occurred - updating... (live nodes size: [4])
> [junit4] 2> 372749 INFO (zkCallba
>
> [...truncated too long message...]
>
> 435163 INFO (closeThreadPool-2071-thread-3) [ ] o.e.j.s.session
> node0 Stopped scavenging
> [junit4] 2> 435200 INFO (closeThreadPool-2071-thread-2) [ ]
> o.a.s.c.Overseer Overseer
> (id=72232415561777156-127.0.0.1:61294_il-n_0000000000) closing
> [junit4] 2> 435200 INFO (zkCallback-1913-thread-1) [ ]
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
> [junit4] 2> 435215 INFO (closeThreadPool-2071-thread-2) [ ]
> o.e.j.s.AbstractConnector Stopped ServerConnector@60c39296{HTTP/1.1,
> (http/1.1, h2c)}{127.0.0.1:0}
> [junit4] 2> 435217 INFO (closeThreadPool-2071-thread-2) [ ]
> o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@196e435e
> {/il,null,UNAVAILABLE}
> [junit4] 2> 435217 INFO (closeThreadPool-2071-thread-2) [ ]
> o.e.j.s.session node0 Stopped scavenging
> [junit4] 2> 435331 INFO (closeThreadPool-2071-thread-1) [ ]
> o.e.j.s.AbstractConnector Stopped ServerConnector@7365123b{HTTP/1.1,
> (http/1.1, h2c)}{127.0.0.1:0}
> [junit4] 2> 435333 INFO (closeThreadPool-2071-thread-1) [ ]
> o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@186a191
> {/il,null,UNAVAILABLE}
> [junit4] 2> 435333 INFO (closeThreadPool-2071-thread-1) [ ]
> o.e.j.s.session node0 Stopped scavenging
> [junit4] 2> 435337 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer Shutting down ZkTestServer.
> [junit4] 2> 435554 WARN (ZkTestServer Run Thread) [ ]
> o.a.s.c.ZkTestServer Watch limit violations:
> [junit4] 2> Maximum concurrent create/delete watches above limit:
> [junit4] 2>
> [junit4] 2> 7 /solr/collections/collection1/terms/shard2
> [junit4] 2> 6 /solr/aliases.json
> [junit4] 2> 4 /solr/packages.json
> [junit4] 2> 4 /solr/security.json
> [junit4] 2> 4 /solr/configs/conf1
> [junit4] 2> 3
> /solr/collections/collection1/collectionprops.json
> [junit4] 2> 3
> /solr/collections/ocptest_shardsplit2/terms/shard2_0
> [junit4] 2> 3
> /solr/collections/ocptest_shardsplit2/terms/shard1_1
> [junit4] 2> 3
> /solr/collections/ocptest_shardsplit2/terms/shard1_0
> [junit4] 2> 3
> /solr/collections/control_collection/terms/shard1
> [junit4] 2> 3
> /solr/collections/ocptest_shardsplit2/terms/shard2_1
> [junit4] 2> 3 /solr/collections/collection1/terms/shard1
> [junit4] 2> 3
> /solr/collections/ocptest_shardsplit2/collectionprops.json
> [junit4] 2> 2
> /solr/collections/ocptest_shardsplit2/terms/shard2
> [junit4] 2> 2
> /solr/collections/ocptest_shardsplit2/terms/shard3
> [junit4] 2> 2
> /solr/collections/ocptest_shardsplit2/terms/shard1
> [junit4] 2> 2 /solr/collections/ocptest1/terms/shard1
> [junit4] 2> 2 /solr/collections/ocptest2/terms/shard1
> [junit4] 2> 2 /solr/collections/ocptest2/terms/shard2
> [junit4] 2> 2 /solr/collections/ocptest3/terms/shard2
> [junit4] 2> 2 /solr/collections/ocptest3/terms/shard3
> [junit4] 2> 2 /solr/collections/ocptest3/terms/shard1
> [junit4] 2> 2
> /solr/collections/collection1/terms/shard1_0
> [junit4] 2> 2
> /solr/collections/ocptest_shardsplit/terms/shard4
> [junit4] 2> 2 /solr/collections/ocptest2/terms/shard3
> [junit4] 2> 2
> /solr/collections/ocptest_shardsplit/terms/shard3
> [junit4] 2> 2
> /solr/collections/ocptest_shardsplit/terms/shard2
> [junit4] 2> 2 /solr/collections/ocptest1/terms/shard3
> [junit4] 2> 2
> /solr/collections/ocptest_shardsplit/terms/shard1
> [junit4] 2> 2 /solr/collections/ocptest1/terms/shard2
> [junit4] 2>
> [junit4] 2> Maximum concurrent data watches above limit:
> [junit4] 2>
> [junit4] 2> 131
> /solr/collections/ocptest_shardsplit2/state.json
> [junit4] 2> 79 /solr/collections/collection1/state.json
> [junit4] 2> 43 /solr/collections/ocptest1/state.json
> [junit4] 2> 41
> /solr/collections/ocptest_shardsplit/state.json
> [junit4] 2> 33 /solr/collections/ocptest3/state.json
> [junit4] 2> 33 /solr/collections/ocptest2/state.json
> [junit4] 2> 12
> /solr/collections/control_collection/state.json
> [junit4] 2> 6 /solr/clusterprops.json
> [junit4] 2> 6 /solr/clusterstate.json
> [junit4] 2> 3
> /solr/overseer_elect/election/72232415561777156-127.0.0.1:61294_il-n_0000000000
> [junit4] 2>
> [junit4] 2> Maximum concurrent children watches above limit:
> [junit4] 2>
> [junit4] 2> 127 /solr/overseer/queue
> [junit4] 2> 48 /solr/overseer/collection-queue-work
> [junit4] 2> 31 /solr/collections
> [junit4] 2> 25 /solr/live_nodes
> [junit4] 2>
> [junit4] 2> 435558 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:61290
> [junit4] 2> 435558 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:61290
> [junit4] 2> 435558 INFO
> (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ]
> o.a.s.c.ZkTestServer connecting to 127.0.0.1 61290
> [junit4] 2> NOTE: reproduce with: ant test
> -Dtestcase=MultiThreadedOCPTest -Dtests.method=test
> -Dtests.seed=E6EA690F0B5FD1D1 -Dtests.slow=true -Dtests.locale=yue-Hant
> -Dtests.timezone=IET -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
> [junit4] FAILURE 70.0s J1 | MultiThreadedOCPTest.test <<<
> [junit4] > Throwable #1: java.lang.AssertionError: acoll:
> 1594109474089 bcoll: 1594109474958
> [junit4] > at
> __randomizedtesting.SeedInfo.seed([E6EA690F0B5FD1D1:6EBE56D5A5A3BC29]:0)
> [junit4] > at
> org.apache.solr.cloud.MultiThreadedOCPTest.testFillWorkQueue(MultiThreadedOCPTest.java:113)
> [junit4] > at
> org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:68)
> [junit4] > at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> [junit4] > at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> [junit4] > at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit4] > at
> java.base/java.lang.reflect.Method.invoke(Method.java:564)
> [junit4] > at
> org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
> [junit4] > at
> org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
> [junit4] > at java.base/java.lang.Thread.run(Thread.java:832)
> [junit4] 2> NOTE: leaving temporary files on disk at:
> /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001
> [junit4] 2> Jul 07, 2020 8:11:23 AM
> com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
> [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked
> thread(s).
> [junit4] 2> NOTE: test params are: codec=Asserting(Lucene86):
> {range_facet_l_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)),
> multiDefault=PostingsFormat(name=Direct),
> _root_=PostingsFormat(name=LuceneVarGapFixedInterval),
> intDefault=PostingsFormat(name=LuceneVarGapFixedInterval),
> id_i1=PostingsFormat(name=Direct),
> id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)),
> range_facet_i_dv=PostingsFormat(name=LuceneVarGapFixedInterval),
> range_facet_l=PostingsFormat(name=LuceneVarGapFixedInterval),
> timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)},
> docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting),
> _version_=DocValuesFormat(name=Lucene80),
> range_facet_i_dv=DocValuesFormat(name=Lucene80),
> intDvoDefault=DocValuesFormat(name=Direct),
> timestamp=DocValuesFormat(name=Lucene80)}, maxPointsInLeafNode=1938,
> maxMBSortInHeap=6.402907350715655,
> sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=yue-Hant,
> timezone=IET
> [junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14.0.1
> (64-bit)/cpus=6,threads=1,free=226492416,total=536870912
> [junit4] 2> NOTE: All tests run in this JVM: [MergeStrategyTest,
> SimplePostToolTest, TestHdfsBackupRestoreCore, DeleteShardTest,
> UpdateLogTest, BlockDirectoryTest, TestJavabinTupleStreamParser,
> AutoAddReplicasIntegrationTest, MetricTriggerIntegrationTest,
> TestPKIAuthenticationPlugin, TestNRTOpen, TestAddFieldRealTimeGet,
> XsltUpdateRequestHandlerTest, SOLR749Test, TestReload,
> TestSolrFieldCacheBean, HdfsCollectionsAPIDistributedZkTest,
> TestDownShardTolerantSearch, TestMultiWordSynonyms,
> BasicDistributedZk2Test, PeerSyncWithIndexFingerprintCachingTest,
> MultiThreadedOCPTest]
> [junit4] Completed [108/914 (1!)] on J1 in 70.45s, 1 test, 1 failure
> <<< FAILURES!
>
> [...truncated 47618 lines...]
> [repro] Jenkins log URL:
> https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/100/consoleText
>
> [repro] Revision: a9c5fb0da2dfc8c7375622c80dbf1a0cc26f44dc
>
> [repro] Ant options: "-Dargs=-XX:-UseCompressedOops
> -XX:+UnlockExperimentalVMOptions -XX:+UseZGC"
> [repro] Repro line: ant test -Dtestcase=MultiThreadedOCPTest
> -Dtests.method=test -Dtests.seed=E6EA690F0B5FD1D1 -Dtests.slow=true
> -Dtests.locale=yue-Hant -Dtests.timezone=IET -Dtests.asserts=true
> -Dtests.file.encoding=US-ASCII
>
> [repro] JUnit rest result XML files will be moved to: ./repro-reports
> [repro] ant clean
>
> [...truncated 6 lines...]
> [repro] Test suites by module:
> [repro] solr/core
> [repro] MultiThreadedOCPTest
> [repro] ant compile-test
>
> [...truncated 3472 lines...]
> [repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5
> -Dtests.class="*.MultiThreadedOCPTest" -Dtests.showOutput=onerror
> "-Dargs=-XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions
> -XX:+UseZGC" -Dtests.seed=E6EA690F0B5FD1D1 -Dtests.slow=true
> -Dtests.locale=yue-Hant -Dtests.timezone=IET -Dtests.asserts=true
> -Dtests.file.encoding=US-ASCII
>
> [...truncated 86 lines...]
> [repro] Failures w/original seeds:
> [repro] 0/5 failed: org.apache.solr.cloud.MultiThreadedOCPTest
> [repro] Exiting with code 0
>
> [...truncated 91 lines...]
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: builds-unsubscribe@lucene.apache.org
> For additional commands, e-mail: builds-help@lucene.apache.org
[JENKINS-Experimental-GC] Lucene-Solr-8.6-MacOSX (64bit/jdk-14.0.1)
- Build # 100 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/100/
Java: 64bit/jdk-14.0.1 -XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC
1 tests failed.
FAILED: org.apache.solr.cloud.MultiThreadedOCPTest.test
Error Message:
acoll: 1594109474089 bcoll: 1594109474958
Stack Trace:
java.lang.AssertionError: acoll: 1594109474089 bcoll: 1594109474958
at __randomizedtesting.SeedInfo.seed([E6EA690F0B5FD1D1:6EBE56D5A5A3BC29]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.apache.solr.cloud.MultiThreadedOCPTest.testFillWorkQueue(MultiThreadedOCPTest.java:113)
at org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:68)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:832)
Build Log:
[...truncated 13732 lines...]
[junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
[junit4] 2> 365607 INFO (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 365607 INFO (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 365608 INFO (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/data-dir-21-001
[junit4] 2> 365608 WARN (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
[junit4] 2> 365609 INFO (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 365610 INFO (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 365610 INFO (SUITE-MultiThreadedOCPTest-seed#[E6EA690F0B5FD1D1]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /il/
[junit4] 2> 365634 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 365634 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 365634 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 365737 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer start zk server on port: 61290
[junit4] 2> 365737 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:61290
[junit4] 2> 365737 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:61290
[junit4] 2> 365737 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 61290
[junit4] 2> 365743 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 365755 INFO (zkConnectionManagerCallback-1807-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 365755 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 365763 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 365768 INFO (zkConnectionManagerCallback-1809-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 365768 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 365774 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 365780 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 365784 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 365787 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 365791 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 365794 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 365797 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 365800 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 365803 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 365807 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 365810 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 365813 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 366243 WARN (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 366244 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 366244 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 366244 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
[junit4] 2> 366247 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 366247 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 366247 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 366249 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@196e435e{/il,null,AVAILABLE}
[junit4] 2> 366251 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@60c39296{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:61294}
[junit4] 2> 366251 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.s.Server Started @366377ms
[junit4] 2> 366251 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/control/data, hostPort=61294, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores}
[junit4] 2> 366252 ERROR (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 366252 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 366252 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.6.0
[junit4] 2> 366252 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 366252 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 366252 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-07T08:10:14.352578Z
[junit4] 2> 366255 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 366259 INFO (zkConnectionManagerCallback-1811-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 366259 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 366365 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 366365 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/solr.xml
[junit4] 2> 366378 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 366378 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 366382 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 366570 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 366576 WARN (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@b8d7e06[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 366576 WARN (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@b8d7e06[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 366584 WARN (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@13785524[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 366584 WARN (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@13785524[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 366586 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
[junit4] 2> 366588 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 366592 INFO (zkConnectionManagerCallback-1822-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 366592 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 366712 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 366714 INFO (zkConnectionManagerCallback-1824-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 366714 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 367090 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:61294_il
[junit4] 2> 367092 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.c.Overseer Overseer (id=72232415561777156-127.0.0.1:61294_il-n_0000000000) starting
[junit4] 2> 367113 INFO (OverseerStateUpdate-72232415561777156-127.0.0.1:61294_il-n_0000000000) [n:127.0.0.1:61294_il ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:61294_il
[junit4] 2> 367120 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61294_il
[junit4] 2> 367136 INFO (zkCallback-1823-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 367151 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 367154 WARN (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 367186 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 367214 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 367226 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 367226 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 367229 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [n:127.0.0.1:61294_il ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores
[junit4] 2> 367244 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 367247 INFO (zkConnectionManagerCallback-1841-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 367248 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 367251 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 367256 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:61290/solr ready
[junit4] 2> 367261 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:61294_il&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 367272 INFO (OverseerThreadFactory-1831-thread-1-processing-n:127.0.0.1:61294_il) [n:127.0.0.1:61294_il ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 367388 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 367392 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=4
[junit4] 2> 367412 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 368439 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 368452 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 368523 WARN (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.EnumField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 368630 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 368665 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 368665 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 368665 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 368667 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=92.99609375, floorSegmentMB=1.458984375, forceMergeDeletesPctAllowed=13.45063000950353, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15388833146547976, deletesPctAllowed=28.27740993910293
[junit4] 2> 368669 WARN (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 368726 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 368726 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 368727 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 368728 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 368728 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=82.12890625, floorSegmentMB=1.560546875, forceMergeDeletesPctAllowed=20.77586369497545, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=20.920356383090496
[junit4] 2> 368731 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 368732 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 368732 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 368732 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1671544875864031232
[junit4] 2> 368735 INFO (searcherExecutor-1843-thread-1-processing-n:127.0.0.1:61294_il x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 368740 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 368740 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
[junit4] 2> 368746 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 368746 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 368746 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:61294/il/control_collection_shard1_replica_n1/
[junit4] 2> 368747 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 368747 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:61294/il/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 368747 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72232415561777156-core_node2-n_0000000000
[junit4] 2> 368751 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:61294/il/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 368855 INFO (zkCallback-1823-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 368855 INFO (zkCallback-1823-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 368858 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 368862 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1450
[junit4] 2> 368865 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 368973 INFO (zkCallback-1823-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 368973 INFO (zkCallback-1823-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 368973 INFO (zkCallback-1823-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 368974 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:61294_il&wt=javabin&version=2} status=0 QTime=1712
[junit4] 2> 368974 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection
[junit4] 2> 369093 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 369096 INFO (zkConnectionManagerCallback-1852-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 369097 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 369098 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 369101 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:61290/solr ready
[junit4] 2> 369101 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 369103 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 369109 INFO (OverseerThreadFactory-1831-thread-2-processing-n:127.0.0.1:61294_il) [n:127.0.0.1:61294_il ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 369109 INFO (OverseerCollectionConfigSetProcessor-72232415561777156-127.0.0.1:61294_il-n_0000000000) [n:127.0.0.1:61294_il ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 369335 WARN (OverseerThreadFactory-1831-thread-2-processing-n:127.0.0.1:61294_il) [n:127.0.0.1:61294_il ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 369344 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 369350 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=247
[junit4] 2> 369351 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 369351 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 369352 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 369352 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 369353 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 369353 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 369353 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=3
[junit4] 2> 369605 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001 of type NRT for shard2
[junit4] 2> 369606 WARN (closeThreadPool-1853-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 369606 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 369606 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 369606 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
[junit4] 2> 369609 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 369609 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 369609 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 369610 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6221549f{/il,null,AVAILABLE}
[junit4] 2> 369611 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1dfdcc2b{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:61327}
[junit4] 2> 369611 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.Server Started @369737ms
[junit4] 2> 369611 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/jetty1, hostPort=61327, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores}
[junit4] 2> 369612 ERROR (closeThreadPool-1853-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.6.0
[junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 369612 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-07T08:10:17.712474Z
[junit4] 2> 369613 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 369617 INFO (zkConnectionManagerCallback-1855-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 369617 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 369720 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 369720 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/solr.xml
[junit4] 2> 369724 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 369724 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 369726 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 369790 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 369790 WARN (closeThreadPool-1853-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7e2a7c4c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 369790 WARN (closeThreadPool-1853-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7e2a7c4c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 369796 WARN (closeThreadPool-1853-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3be4fae2[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 369796 WARN (closeThreadPool-1853-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3be4fae2[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 369798 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
[junit4] 2> 369799 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 369803 INFO (zkConnectionManagerCallback-1866-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 369803 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 369859 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001 of type NRT for shard1
[junit4] 2> 369860 WARN (closeThreadPool-1853-thread-2) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 369860 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 369860 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 369860 INFO (closeThreadPool-1853-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
[junit4] 2> 369862 INFO (closeThreadPool-1853-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 369862 INFO (closeThreadPool-1853-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 369862 INFO (closeThreadPool-1853-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 369863 INFO (closeThreadPool-1853-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36ad93b5{/il,null,AVAILABLE}
[junit4] 2> 369864 INFO (closeThreadPool-1853-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1ed6717f{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:61332}
[junit4] 2> 369864 INFO (closeThreadPool-1853-thread-2) [ ] o.e.j.s.Server Started @369989ms
[junit4] 2> 369864 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/jetty2, hostPort=61332, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores}
[junit4] 2> 369864 ERROR (closeThreadPool-1853-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.6.0
[junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 369865 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-07T08:10:17.965193Z
[junit4] 2> 369866 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 369869 INFO (zkConnectionManagerCallback-1868-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 369870 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 369912 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 369914 INFO (zkConnectionManagerCallback-1870-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 369914 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 369926 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 369936 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.c.ZkController Publish node=127.0.0.1:61327_il as DOWN
[junit4] 2> 369938 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 369938 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61327_il
[junit4] 2> 369941 INFO (zkCallback-1823-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 369941 INFO (zkCallback-1851-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 369941 INFO (zkCallback-1869-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 369946 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 369946 WARN (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 369971 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 369995 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 370004 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 370005 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 370007 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61327_il ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores
[junit4] 2> 370011 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 370011 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/solr.xml
[junit4] 2> 370015 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 370015 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 370017 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 370020 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:61327_il
[junit4] 2> 370068 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 370070 WARN (closeThreadPool-1853-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@f6899ad[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 370070 WARN (closeThreadPool-1853-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@f6899ad[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 370074 WARN (closeThreadPool-1853-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@44d5c0c5[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 370075 WARN (closeThreadPool-1853-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@44d5c0c5[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 370076 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
[junit4] 2> 370078 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 370081 INFO (zkConnectionManagerCallback-1889-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 370081 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 370149 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001 of type NRT for shard2
[junit4] 2> 370150 WARN (closeThreadPool-1853-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 370150 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 370150 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 370150 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
[junit4] 2> 370151 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 370151 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 370151 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 370152 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@186a191{/il,null,AVAILABLE}
[junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7365123b{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:61337}
[junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ] o.e.j.s.Server Started @370278ms
[junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/il, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/tempDir-001/jetty3, hostPort=61337, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001/cores, replicaType=NRT}
[junit4] 2> 370153 ERROR (closeThreadPool-1853-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.6.0
[junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 370153 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-07T08:10:18.253975Z
[junit4] 2> 370155 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 370158 INFO (zkConnectionManagerCallback-1891-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 370158 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 370193 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 370195 INFO (zkConnectionManagerCallback-1893-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 370195 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 370206 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 370216 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.c.ZkController Publish node=127.0.0.1:61332_il as DOWN
[junit4] 2> 370217 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 370217 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61332_il
[junit4] 2> 370221 INFO (zkCallback-1869-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 370221 INFO (zkCallback-1823-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 370221 INFO (zkCallback-1851-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 370222 INFO (zkCallback-1892-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 370226 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 370226 WARN (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 370251 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 370275 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 370287 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 370287 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 370289 INFO (closeThreadPool-1853-thread-2) [n:127.0.0.1:61332_il ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores
[junit4] 2> 370293 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 370294 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001/solr.xml
[junit4] 2> 370298 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 370298 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 370299 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 370321 INFO (closeThreadPool-1853-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:61332_il
[junit4] 2> 370387 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 370389 WARN (closeThreadPool-1853-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@603817e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 370389 WARN (closeThreadPool-1853-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@603817e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 370394 WARN (closeThreadPool-1853-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@60633c00[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 370394 WARN (closeThreadPool-1853-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@60633c00[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 370395 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61290/solr
[junit4] 2> 370398 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 370404 INFO (zkConnectionManagerCallback-1912-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 370404 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 370515 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 370519 INFO (zkConnectionManagerCallback-1914-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 370519 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 370543 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 370557 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.c.ZkController Publish node=127.0.0.1:61337_il as DOWN
[junit4] 2> 370563 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 370564 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61337_il
[junit4] 2> 370572 INFO (zkCallback-1851-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 370572 INFO (zkCallback-1823-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 370572 INFO (zkCallback-1869-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 370573 INFO (zkCallback-1913-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 370573 INFO (zkCallback-1892-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 370597 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 370598 WARN (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 370623 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 370648 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 370660 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 370660 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 370663 INFO (closeThreadPool-1853-thread-1) [n:127.0.0.1:61337_il ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-3-001/cores
[junit4] 2> 370683 INFO (closeThreadPool-1853-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:61337_il
[junit4] 2> 370707 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:61332_il&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 370709 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:61327_il&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 370718 INFO (qtp1884586278-2968) [n:127.0.0.1:61294_il ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:61337_il&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 370761 INFO (OverseerCollectionConfigSetProcessor-72232415561777156-127.0.0.1:61294_il-n_0000000000) [n:127.0.0.1:61294_il ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 370801 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 370804 INFO (qtp1884586278-2965) [n:127.0.0.1:61294_il ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 370810 INFO (qtp432167883-3024) [n:127.0.0.1:61327_il ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 370815 INFO (qtp451536634-3044) [n:127.0.0.1:61332_il ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 370822 INFO (qtp1354606003-3074) [n:127.0.0.1:61337_il ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=2
[junit4] 2> 370827 INFO (OverseerThreadFactory-1831-thread-3-processing-n:127.0.0.1:61294_il) [n:127.0.0.1:61294_il c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:61332_il for creating new replica of shard shard1 for collection collection1
[junit4] 2> 370832 INFO (OverseerThreadFactory-1831-thread-4-processing-n:127.0.0.1:61294_il) [n:127.0.0.1:61294_il c:collection1 s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:61327_il for creating new replica of shard shard2 for collection collection1
[junit4] 2> 370834 INFO (OverseerThreadFactory-1831-thread-3-processing-n:127.0.0.1:61294_il) [n:127.0.0.1:61294_il c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 370838 INFO (OverseerThreadFactory-1831-thread-4-processing-n:127.0.0.1:61294_il) [n:127.0.0.1:61294_il c:collection1 s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 370843 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il x:collection1_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 370844 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il x:collection1_shard2_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n2&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 371885 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 371885 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 371902 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 371912 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 372202 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 372207 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 372296 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n2' using configuration from configset conf1, trusted=true
[junit4] 2> 372297 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n2' (registry 'solr.core.collection1.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 372297 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SolrCore [[collection1_shard2_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores/collection1_shard2_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-1-001/cores/collection1_shard2_replica_n2/data/]
[junit4] 2> 372300 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=92.99609375, floorSegmentMB=1.458984375, forceMergeDeletesPctAllowed=13.45063000950353, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15388833146547976, deletesPctAllowed=28.27740993910293
[junit4] 2> 372306 WARN (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 372314 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 372315 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@35097d2b
[junit4] 2> 372316 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores/collection1_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001/shard-2-001/cores/collection1_shard1_replica_n1/data/]
[junit4] 2> 372318 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=92.99609375, floorSegmentMB=1.458984375, forceMergeDeletesPctAllowed=13.45063000950353, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15388833146547976, deletesPctAllowed=28.27740993910293
[junit4] 2> 372330 WARN (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 372394 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 372394 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 372402 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 372402 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 372403 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=82.12890625, floorSegmentMB=1.560546875, forceMergeDeletesPctAllowed=20.77586369497545, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=20.920356383090496
[junit4] 2> 372413 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 372417 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 372417 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 372418 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 372419 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 372419 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1671544879730130944
[junit4] 2> 372420 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 372422 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 372424 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=82.12890625, floorSegmentMB=1.560546875, forceMergeDeletesPctAllowed=20.77586369497545, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=20.920356383090496
[junit4] 2> 372426 INFO (searcherExecutor-1925-thread-1-processing-n:127.0.0.1:61327_il x:collection1_shard2_replica_n2 c:collection1 s:shard2) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SolrCore [collection1_shard2_replica_n2] Registered new searcher autowarm time: 0 ms
[junit4] 2> 372430 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 372432 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 372432 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 372432 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1671544879743762432
[junit4] 2> 372436 INFO (searcherExecutor-1927-thread-1-processing-n:127.0.0.1:61332_il x:collection1_shard1_replica_n1 c:collection1 s:shard1) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 372442 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node4=0}, version=0}
[junit4] 2> 372442 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2
[junit4] 2> 372452 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node3=0}, version=0}
[junit4] 2> 372452 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 372474 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 372474 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 372474 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:61327/il/collection1_shard2_replica_n2/
[junit4] 2> 372476 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 372476 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 372476 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 372476 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:61332/il/collection1_shard1_replica_n1/
[junit4] 2> 372479 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SyncStrategy http://127.0.0.1:61327/il/collection1_shard2_replica_n2/ has no replicas
[junit4] 2> 372479 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 372480 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard2/leader after winning as /collections/collection1/leader_elect/shard2/election/72232415561777162-core_node4-n_0000000000
[junit4] 2> 372485 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:61332/il/collection1_shard1_replica_n1/ has no replicas
[junit4] 2> 372485 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72232415561777165-core_node3-n_0000000000
[junit4] 2> 372494 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:61327/il/collection1_shard2_replica_n2/ shard2
[junit4] 2> 372494 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:61332/il/collection1_shard1_replica_n1/ shard1
[junit4] 2> 372614 INFO (zkCallback-1892-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 372614 INFO (zkCallback-1869-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 372617 INFO (zkCallback-1892-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 372624 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 372628 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 372666 INFO (qtp451536634-3043) [n:127.0.0.1:61332_il ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1823
[junit4] 2> 372668 INFO (qtp432167883-3023) [n:127.0.0.1:61327_il ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n2&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1824
[junit4] 2> 372679 INFO (qtp1884586278-2969) [n:127.0.0.1:61294_il c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:61332_il&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1972
[junit4] 2> 372680 INFO (qtp1884586278-2967) [n:127.0.0.1:61294_il c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:61327_il&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1971
[junit4] 2> 372749 INFO (zkCallback-1869-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 372749 INFO (zkCallba
[...truncated too long message...]
435163 INFO (closeThreadPool-2071-thread-3) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 435200 INFO (closeThreadPool-2071-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72232415561777156-127.0.0.1:61294_il-n_0000000000) closing
[junit4] 2> 435200 INFO (zkCallback-1913-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 435215 INFO (closeThreadPool-2071-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@60c39296{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 435217 INFO (closeThreadPool-2071-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@196e435e{/il,null,UNAVAILABLE}
[junit4] 2> 435217 INFO (closeThreadPool-2071-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 435331 INFO (closeThreadPool-2071-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@7365123b{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 435333 INFO (closeThreadPool-2071-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@186a191{/il,null,UNAVAILABLE}
[junit4] 2> 435333 INFO (closeThreadPool-2071-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 435337 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 435554 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/collections/collection1/terms/shard2
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 4 /solr/packages.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/configs/conf1
[junit4] 2> 3 /solr/collections/collection1/collectionprops.json
[junit4] 2> 3 /solr/collections/ocptest_shardsplit2/terms/shard2_0
[junit4] 2> 3 /solr/collections/ocptest_shardsplit2/terms/shard1_1
[junit4] 2> 3 /solr/collections/ocptest_shardsplit2/terms/shard1_0
[junit4] 2> 3 /solr/collections/control_collection/terms/shard1
[junit4] 2> 3 /solr/collections/ocptest_shardsplit2/terms/shard2_1
[junit4] 2> 3 /solr/collections/collection1/terms/shard1
[junit4] 2> 3 /solr/collections/ocptest_shardsplit2/collectionprops.json
[junit4] 2> 2 /solr/collections/ocptest_shardsplit2/terms/shard2
[junit4] 2> 2 /solr/collections/ocptest_shardsplit2/terms/shard3
[junit4] 2> 2 /solr/collections/ocptest_shardsplit2/terms/shard1
[junit4] 2> 2 /solr/collections/ocptest1/terms/shard1
[junit4] 2> 2 /solr/collections/ocptest2/terms/shard1
[junit4] 2> 2 /solr/collections/ocptest2/terms/shard2
[junit4] 2> 2 /solr/collections/ocptest3/terms/shard2
[junit4] 2> 2 /solr/collections/ocptest3/terms/shard3
[junit4] 2> 2 /solr/collections/ocptest3/terms/shard1
[junit4] 2> 2 /solr/collections/collection1/terms/shard1_0
[junit4] 2> 2 /solr/collections/ocptest_shardsplit/terms/shard4
[junit4] 2> 2 /solr/collections/ocptest2/terms/shard3
[junit4] 2> 2 /solr/collections/ocptest_shardsplit/terms/shard3
[junit4] 2> 2 /solr/collections/ocptest_shardsplit/terms/shard2
[junit4] 2> 2 /solr/collections/ocptest1/terms/shard3
[junit4] 2> 2 /solr/collections/ocptest_shardsplit/terms/shard1
[junit4] 2> 2 /solr/collections/ocptest1/terms/shard2
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 131 /solr/collections/ocptest_shardsplit2/state.json
[junit4] 2> 79 /solr/collections/collection1/state.json
[junit4] 2> 43 /solr/collections/ocptest1/state.json
[junit4] 2> 41 /solr/collections/ocptest_shardsplit/state.json
[junit4] 2> 33 /solr/collections/ocptest3/state.json
[junit4] 2> 33 /solr/collections/ocptest2/state.json
[junit4] 2> 12 /solr/collections/control_collection/state.json
[junit4] 2> 6 /solr/clusterprops.json
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 3 /solr/overseer_elect/election/72232415561777156-127.0.0.1:61294_il-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 127 /solr/overseer/queue
[junit4] 2> 48 /solr/overseer/collection-queue-work
[junit4] 2> 31 /solr/collections
[junit4] 2> 25 /solr/live_nodes
[junit4] 2>
[junit4] 2> 435558 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:61290
[junit4] 2> 435558 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:61290
[junit4] 2> 435558 INFO (TEST-MultiThreadedOCPTest.test-seed#[E6EA690F0B5FD1D1]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 61290
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=MultiThreadedOCPTest -Dtests.method=test -Dtests.seed=E6EA690F0B5FD1D1 -Dtests.slow=true -Dtests.locale=yue-Hant -Dtests.timezone=IET -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 70.0s J1 | MultiThreadedOCPTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: acoll: 1594109474089 bcoll: 1594109474958
[junit4] > at __randomizedtesting.SeedInfo.seed([E6EA690F0B5FD1D1:6EBE56D5A5A3BC29]:0)
[junit4] > at org.apache.solr.cloud.MultiThreadedOCPTest.testFillWorkQueue(MultiThreadedOCPTest.java:113)
[junit4] > at org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:68)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:832)
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_E6EA690F0B5FD1D1-001
[junit4] 2> Jul 07, 2020 8:11:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene86): {range_facet_l_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), multiDefault=PostingsFormat(name=Direct), _root_=PostingsFormat(name=LuceneVarGapFixedInterval), intDefault=PostingsFormat(name=LuceneVarGapFixedInterval), id_i1=PostingsFormat(name=Direct), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), range_facet_i_dv=PostingsFormat(name=LuceneVarGapFixedInterval), range_facet_l=PostingsFormat(name=LuceneVarGapFixedInterval), timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Lucene80), range_facet_i_dv=DocValuesFormat(name=Lucene80), intDvoDefault=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Lucene80)}, maxPointsInLeafNode=1938, maxMBSortInHeap=6.402907350715655, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=yue-Hant, timezone=IET
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14.0.1 (64-bit)/cpus=6,threads=1,free=226492416,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [MergeStrategyTest, SimplePostToolTest, TestHdfsBackupRestoreCore, DeleteShardTest, UpdateLogTest, BlockDirectoryTest, TestJavabinTupleStreamParser, AutoAddReplicasIntegrationTest, MetricTriggerIntegrationTest, TestPKIAuthenticationPlugin, TestNRTOpen, TestAddFieldRealTimeGet, XsltUpdateRequestHandlerTest, SOLR749Test, TestReload, TestSolrFieldCacheBean, HdfsCollectionsAPIDistributedZkTest, TestDownShardTolerantSearch, TestMultiWordSynonyms, BasicDistributedZk2Test, PeerSyncWithIndexFingerprintCachingTest, MultiThreadedOCPTest]
[junit4] Completed [108/914 (1!)] on J1 in 70.45s, 1 test, 1 failure <<< FAILURES!
[...truncated 47618 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/100/consoleText
[repro] Revision: a9c5fb0da2dfc8c7375622c80dbf1a0cc26f44dc
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC"
[repro] Repro line: ant test -Dtestcase=MultiThreadedOCPTest -Dtests.method=test -Dtests.seed=E6EA690F0B5FD1D1 -Dtests.slow=true -Dtests.locale=yue-Hant -Dtests.timezone=IET -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] MultiThreadedOCPTest
[repro] ant compile-test
[...truncated 3472 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.MultiThreadedOCPTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC" -Dtests.seed=E6EA690F0B5FD1D1 -Dtests.slow=true -Dtests.locale=yue-Hant -Dtests.timezone=IET -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 86 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.MultiThreadedOCPTest
[repro] Exiting with code 0
[...truncated 91 lines...]
[JENKINS] Lucene-Solr-8.6-MacOSX (64bit/jdk-13.0.2) - Build # 99 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/99/
Java: 64bit/jdk-13.0.2 -XX:-UseCompressedOops -XX:+UseParallelGC
3 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
Error Message:
timeout value is negative
Stack Trace:
java.lang.IllegalArgumentException: timeout value is negative
at __randomizedtesting.SeedInfo.seed([EE6D7537832728C5:66394AED2DDB453D]:0)
at java.base/java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.ChaosMonkey.wait(ChaosMonkey.java:641)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test(ChaosMonkeyNothingIsSafeWithPullReplicasTest.java:225)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:830)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest: 1) Thread[id=7023, name=StoppableCommitThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest] at java.base@13.0.2/java.lang.Thread.sleep(Native Method) at app//org.apache.solr.cloud.StoppableCommitThread.run(StoppableCommitThread.java:55) 2) Thread[id=7022, name=StoppableSearchThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest] at java.base@13.0.2/java.lang.Thread.sleep(Native Method) at app//org.apache.solr.cloud.StoppableSearchThread.run(StoppableSearchThread.java:65)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest:
1) Thread[id=7023, name=StoppableCommitThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
at app//org.apache.solr.cloud.StoppableCommitThread.run(StoppableCommitThread.java:55)
2) Thread[id=7022, name=StoppableSearchThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
at app//org.apache.solr.cloud.StoppableSearchThread.run(StoppableSearchThread.java:65)
at __randomizedtesting.SeedInfo.seed([EE6D7537832728C5]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=7022, name=StoppableSearchThread, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest] at java.base@13.0.2/sun.nio.cs.UTF_8$Encoder.encodeLoop(UTF_8.java:564) at java.base@13.0.2/java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:578) at java.base@13.0.2/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:301) at java.base@13.0.2/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:290) at java.base@13.0.2/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:131) at java.base@13.0.2/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:141) at java.base@13.0.2/java.io.OutputStreamWriter.write(OutputStreamWriter.java:229) at java.base@13.0.2/java.io.Writer.write(Writer.java:249) at app//com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.close(JsonWriter.java:345) at app//com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.endObject(JsonWriter.java:313) at app//com.carrotsearch.ant.tasks.junit4.events.AppendStdErrEvent.serialize(AppendStdErrEvent.java:31) at app//com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:129) at app//com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:124) at java.base@13.0.2/java.security.AccessController.executePrivileged(AccessController.java:784) at java.base@13.0.2/java.security.AccessController.doPrivileged(AccessController.java:554) at app//com.carrotsearch.ant.tasks.junit4.events.Serializer.flushQueue(Serializer.java:124) at app//com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:98) at app//com.carrotsearch.ant.tasks.junit4.slave.SlaveMain$3$2.write(SlaveMain.java:498) at java.base@13.0.2/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81) at java.base@13.0.2/java.io.BufferedOutputStream.flush(BufferedOutputStream.java:142) at java.base@13.0.2/java.io.PrintStream.flush(PrintStream.java:417) at app//org.apache.lucene.util.TestRuleLimitSysouts$DelegateStream.flush(TestRuleLimitSysouts.java:189) at java.base@13.0.2/java.io.PrintStream.write(PrintStream.java:561) at java.base@13.0.2/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:242) at java.base@13.0.2/sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:321) at java.base@13.0.2/sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:110) at java.base@13.0.2/java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:184) at java.base@13.0.2/java.io.PrintStream.writeln(PrintStream.java:654) at java.base@13.0.2/java.io.PrintStream.println(PrintStream.java:981) at java.base@13.0.2/java.lang.Throwable$WrappedPrintStream.println(Throwable.java:762) at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:672) at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:658) at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:649) at app//org.apache.solr.cloud.StoppableSearchThread.run(StoppableSearchThread.java:57)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=7022, name=StoppableSearchThread, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@13.0.2/sun.nio.cs.UTF_8$Encoder.encodeLoop(UTF_8.java:564)
at java.base@13.0.2/java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:578)
at java.base@13.0.2/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:301)
at java.base@13.0.2/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:290)
at java.base@13.0.2/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:131)
at java.base@13.0.2/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:141)
at java.base@13.0.2/java.io.OutputStreamWriter.write(OutputStreamWriter.java:229)
at java.base@13.0.2/java.io.Writer.write(Writer.java:249)
at app//com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.close(JsonWriter.java:345)
at app//com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.endObject(JsonWriter.java:313)
at app//com.carrotsearch.ant.tasks.junit4.events.AppendStdErrEvent.serialize(AppendStdErrEvent.java:31)
at app//com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:129)
at app//com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:124)
at java.base@13.0.2/java.security.AccessController.executePrivileged(AccessController.java:784)
at java.base@13.0.2/java.security.AccessController.doPrivileged(AccessController.java:554)
at app//com.carrotsearch.ant.tasks.junit4.events.Serializer.flushQueue(Serializer.java:124)
at app//com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:98)
at app//com.carrotsearch.ant.tasks.junit4.slave.SlaveMain$3$2.write(SlaveMain.java:498)
at java.base@13.0.2/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81)
at java.base@13.0.2/java.io.BufferedOutputStream.flush(BufferedOutputStream.java:142)
at java.base@13.0.2/java.io.PrintStream.flush(PrintStream.java:417)
at app//org.apache.lucene.util.TestRuleLimitSysouts$DelegateStream.flush(TestRuleLimitSysouts.java:189)
at java.base@13.0.2/java.io.PrintStream.write(PrintStream.java:561)
at java.base@13.0.2/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:242)
at java.base@13.0.2/sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:321)
at java.base@13.0.2/sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:110)
at java.base@13.0.2/java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:184)
at java.base@13.0.2/java.io.PrintStream.writeln(PrintStream.java:654)
at java.base@13.0.2/java.io.PrintStream.println(PrintStream.java:981)
at java.base@13.0.2/java.lang.Throwable$WrappedPrintStream.println(Throwable.java:762)
at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:672)
at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:658)
at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:649)
at app//org.apache.solr.cloud.StoppableSearchThread.run(StoppableSearchThread.java:57)
at __randomizedtesting.SeedInfo.seed([EE6D7537832728C5]:0)
Build Log:
[...truncated 14075 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
[junit4] 2> 447214 INFO (SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[EE6D7537832728C5]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 447214 INFO (SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[EE6D7537832728C5]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 447217 INFO (SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[EE6D7537832728C5]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/data-dir-40-001
[junit4] 2> 447217 WARN (SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[EE6D7537832728C5]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=168 numCloses=168
[junit4] 2> 447217 INFO (SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[EE6D7537832728C5]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 447217 INFO (SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[EE6D7537832728C5]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776") w/ MAC_OS_X supressed clientAuth
[junit4] 2> 447218 INFO (SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[EE6D7537832728C5]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 447218 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ChaosMonkeyNothingIsSafeWithPullReplicasTest Starting ChaosMonkey test with 1 shards and 2 nodes
[junit4] 2> 447221 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 447221 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 447222 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 447322 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer start zk server on port: 57448
[junit4] 2> 447323 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:57448
[junit4] 2> 447323 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:57448
[junit4] 2> 447323 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 57448
[junit4] 2> 447331 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 447357 INFO (zkConnectionManagerCallback-4187-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 447357 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 447380 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 447385 INFO (zkConnectionManagerCallback-4189-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 447385 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 447394 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 447401 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 447407 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 447414 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 447419 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 447424 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 447427 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 447431 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 447434 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 447438 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 447445 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 447454 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 448065 WARN (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 448066 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 448066 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 448066 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 448072 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 448073 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 448073 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 448073 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7aab6d54{/,null,AVAILABLE}
[junit4] 2> 448076 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@125d0faf{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:57453}
[junit4] 2> 448076 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.s.Server Started @448163ms
[junit4] 2> 448076 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/tempDir-001/control/data, hostPort=57453, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/control-001/cores}
[junit4] 2> 448077 ERROR (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 448077 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 448077 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.6.0
[junit4] 2> 448077 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 448077 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 448077 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-07T01:26:50.385284Z
[junit4] 2> 448078 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 448081 INFO (zkConnectionManagerCallback-4191-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 448081 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 448193 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 448193 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/control-001/solr.xml
[junit4] 2> 448198 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 448198 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 448199 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 448496 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 448498 WARN (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@e657588[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 448498 WARN (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@e657588[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 448524 WARN (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3bf55451[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 448524 WARN (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3bf55451[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 448534 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57448/solr
[junit4] 2> 448538 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 448539 INFO (zkConnectionManagerCallback-4202-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 448543 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 448703 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 448706 INFO (zkConnectionManagerCallback-4204-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 448707 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 450040 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:57453_
[junit4] 2> 450053 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.c.Overseer Overseer (id=72230829313949700-127.0.0.1:57453_-n_0000000000) starting
[junit4] 2> 450142 INFO (OverseerStateUpdate-72230829313949700-127.0.0.1:57453_-n_0000000000) [n:127.0.0.1:57453_ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:57453_
[junit4] 2> 450144 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57453_
[junit4] 2> 450159 INFO (OverseerStateUpdate-72230829313949700-127.0.0.1:57453_-n_0000000000) [n:127.0.0.1:57453_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 450189 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 450190 WARN (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 450220 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 450265 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 450274 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 450274 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 450275 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [n:127.0.0.1:57453_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/control-001/cores
[junit4] 2> 450321 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 450332 INFO (zkConnectionManagerCallback-4221-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 450332 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 450345 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 450350 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57448/solr ready
[junit4] 2> 450354 INFO (qtp1032772393-6886) [n:127.0.0.1:57453_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:57453_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 450411 INFO (OverseerThreadFactory-4211-thread-1-processing-n:127.0.0.1:57453_) [n:127.0.0.1:57453_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 450558 INFO (qtp1032772393-6888) [n:127.0.0.1:57453_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 450559 INFO (qtp1032772393-6888) [n:127.0.0.1:57453_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 450570 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 451595 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 451608 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 451655 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 451696 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 451697 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 451697 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 451701 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=21.203125, floorSegmentMB=0.365234375, forceMergeDeletesPctAllowed=19.410163653243306, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6574324557261713, deletesPctAllowed=45.862207326831964
[junit4] 2> 451723 WARN (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 451785 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 451785 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 451786 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms;
[junit4] 2> 451786 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 451788 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 451797 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 451799 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 451799 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 451799 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1671519497467461632
[junit4] 2> 451808 INFO (searcherExecutor-4223-thread-1-processing-n:127.0.0.1:57453_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 451818 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 451818 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
[junit4] 2> 451835 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 451835 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 451835 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:57453/control_collection_shard1_replica_n1/
[junit4] 2> 451838 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 451841 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:57453/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 451841 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72230829313949700-core_node2-n_0000000000
[junit4] 2> 451848 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:57453/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 451954 INFO (zkCallback-4203-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 451954 INFO (zkCallback-4203-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 451958 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 451966 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1396
[junit4] 2> 451972 INFO (qtp1032772393-6886) [n:127.0.0.1:57453_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 452070 INFO (zkCallback-4203-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 452070 INFO (zkCallback-4203-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 452070 INFO (zkCallback-4203-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 452073 INFO (qtp1032772393-6886) [n:127.0.0.1:57453_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:57453_&wt=javabin&version=2} status=0 QTime=1719
[junit4] 2> 452073 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection
[junit4] 2> 452182 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 452186 INFO (zkConnectionManagerCallback-4232-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 452186 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 452189 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 452195 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57448/solr ready
[junit4] 2> 452195 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 452197 INFO (qtp1032772393-6886) [n:127.0.0.1:57453_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 452205 INFO (OverseerThreadFactory-4211-thread-2-processing-n:127.0.0.1:57453_) [n:127.0.0.1:57453_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 452206 INFO (OverseerCollectionConfigSetProcessor-72230829313949700-127.0.0.1:57453_-n_0000000000) [n:127.0.0.1:57453_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 452417 WARN (OverseerThreadFactory-4211-thread-2-processing-n:127.0.0.1:57453_) [n:127.0.0.1:57453_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 452420 INFO (qtp1032772393-6886) [n:127.0.0.1:57453_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 452422 INFO (qtp1032772393-6886) [n:127.0.0.1:57453_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=224
[junit4] 2> 452424 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected: 1
[junit4] 2> 452424 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 452424 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected: 1
[junit4] 2> 452424 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 452424 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected: 1
[junit4] 2> 452424 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 452424 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=1 numOtherReplicas=1
[junit4] 2> 452769 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-1-001 of type NRT for shard1
[junit4] 2> 452774 WARN (closeThreadPool-4233-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 452774 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 452774 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 452774 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 452778 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 452778 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 452778 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 452779 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@41ea6f23{/,null,AVAILABLE}
[junit4] 2> 452785 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@12e4973c{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:57480}
[junit4] 2> 452785 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.Server Started @452872ms
[junit4] 2> 452785 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/tempDir-001/jetty1, hostPort=57480, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-1-001/cores, replicaType=NRT}
[junit4] 2> 452786 ERROR (closeThreadPool-4233-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 452786 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 452786 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.6.0
[junit4] 2> 452786 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 452786 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 452786 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-07T01:26:55.094526Z
[junit4] 2> 452787 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 452791 INFO (zkConnectionManagerCallback-4235-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 452791 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 452894 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 452894 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-1-001/solr.xml
[junit4] 2> 452897 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 452897 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 452898 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 452947 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 452949 WARN (closeThreadPool-4233-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@71757811[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 452949 WARN (closeThreadPool-4233-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@71757811[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 452960 WARN (closeThreadPool-4233-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@62fd37a7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 452960 WARN (closeThreadPool-4233-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@62fd37a7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 452961 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57448/solr
[junit4] 2> 452962 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 452972 INFO (zkConnectionManagerCallback-4246-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 452973 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 453080 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 453084 INFO (zkConnectionManagerCallback-4248-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 453084 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 453128 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 453150 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.c.ZkController Publish node=127.0.0.1:57480_ as DOWN
[junit4] 2> 453157 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 453158 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57480_
[junit4] 2> 453168 INFO (zkCallback-4203-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 453168 INFO (zkCallback-4231-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 453169 INFO (zkCallback-4247-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 453178 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 453178 WARN (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 453210 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 453245 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 453258 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 453259 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 453260 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57480_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-1-001/cores
[junit4] 2> 453290 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:57480_
[junit4] 2> 453448 INFO (TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[EE6D7537832728C5]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-2-001 of type PULL for shard1
[junit4] 2> 453458 WARN (closeThreadPool-4233-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 453458 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 453458 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 453459 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 453464 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 453464 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 453464 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 453464 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@54544a48{/,null,AVAILABLE}
[junit4] 2> 453472 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@74ed9ee8{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:57486}
[junit4] 2> 453472 INFO (closeThreadPool-4233-thread-1) [ ] o.e.j.s.Server Started @453559ms
[junit4] 2> 453472 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/tempDir-001/jetty2, hostPort=57486, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-2-001/cores, replicaType=PULL}
[junit4] 2> 453472 ERROR (closeThreadPool-4233-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 453472 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 453472 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.6.0
[junit4] 2> 453472 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 453472 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 453472 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-07T01:26:55.780977Z
[junit4] 2> 453475 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 453478 INFO (zkConnectionManagerCallback-4258-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 453478 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 453581 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 453581 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-2-001/solr.xml
[junit4] 2> 453587 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 453587 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 453588 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 453918 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 453927 WARN (closeThreadPool-4233-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7f051183[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 453927 WARN (closeThreadPool-4233-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7f051183[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 453932 WARN (closeThreadPool-4233-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@10bdc056[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 453932 WARN (closeThreadPool-4233-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@10bdc056[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 453946 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57448/solr
[junit4] 2> 453947 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 453955 INFO (zkConnectionManagerCallback-4269-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 453977 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 454089 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 454091 INFO (zkConnectionManagerCallback-4271-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 454092 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 454118 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 454141 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.c.ZkController Publish node=127.0.0.1:57486_ as DOWN
[junit4] 2> 454150 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 454150 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57486_
[junit4] 2> 454157 INFO (zkCallback-4231-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 454157 INFO (zkCallback-4203-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 454157 INFO (zkCallback-4247-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 454157 INFO (zkCallback-4270-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 454173 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 454173 WARN (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 454197 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 454221 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 454223 INFO (OverseerCollectionConfigSetProcessor-72230829313949700-127.0.0.1:57453_-n_0000000000) [n:127.0.0.1:57453_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 454231 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 454231 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 454232 INFO (closeThreadPool-4233-thread-1) [n:127.0.0.1:57486_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-2-001/cores
[junit4] 2> 454247 INFO (closeThreadPool-4233-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:57486_
[junit4] 2> 454251 INFO (qtp1032772393-6887) [n:127.0.0.1:57453_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:57480_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 454271 INFO (qtp1032772393-6888) [n:127.0.0.1:57453_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=1
[junit4] 2> 454273 INFO (qtp1032772393-6885) [n:127.0.0.1:57453_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 454274 INFO (qtp383455551-6944) [n:127.0.0.1:57480_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 454280 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 454281 INFO (OverseerThreadFactory-4211-thread-3-processing-n:127.0.0.1:57453_) [n:127.0.0.1:57453_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:57480_ for creating new replica of shard shard1 for collection collection1
[junit4] 2> 454287 INFO (OverseerThreadFactory-4211-thread-3-processing-n:127.0.0.1:57453_) [n:127.0.0.1:57453_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 454292 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ x:collection1_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 455328 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 455347 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 455420 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 455497 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 455498 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 455499 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-1-001/cores/collection1_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-1-001/cores/collection1_shard1_replica_n1/data/]
[junit4] 2> 455503 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=21.203125, floorSegmentMB=0.365234375, forceMergeDeletesPctAllowed=19.410163653243306, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6574324557261713, deletesPctAllowed=45.862207326831964
[junit4] 2> 455540 WARN (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 455624 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 455624 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 455625 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms;
[junit4] 2> 455625 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 455627 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 455630 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 455631 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 455632 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 455632 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1671519501486653440
[junit4] 2> 455634 INFO (searcherExecutor-4282-thread-1-processing-n:127.0.0.1:57480_ x:collection1_shard1_replica_n1 c:collection1 s:shard1) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 455644 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 455644 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 455654 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 455654 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 455654 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:57480/collection1_shard1_replica_n1/
[junit4] 2> 455654 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 455654 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:57480/collection1_shard1_replica_n1/ has no replicas
[junit4] 2> 455654 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72230829313949705-core_node2-n_0000000000
[junit4] 2> 455657 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:57480/collection1_shard1_replica_n1/ shard1
[junit4] 2> 455769 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 455785 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1492
[junit4] 2> 455791 INFO (qtp1032772393-6887) [n:127.0.0.1:57453_ c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:57480_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1539
[junit4] 2> 455794 INFO (qtp383455551-6945) [n:127.0.0.1:57480_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:57486_&action=ADDREPLICA&collection=collection1&shard=shard1&type=PULL&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 455805 INFO (OverseerCollectionConfigSetProcessor-72230829313949700-127.0.0.1:57453_-n_0000000000) [n:127.0.0.1:57453_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 455808 INFO (qtp383455551-6946) [n:127.0.0.1:57480_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.collection1.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=1
[junit4] 2> 455810 INFO (qtp383455551-6943) [n:127.0.0.1:57480_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 455811 INFO (qtp1032772393-6886) [n:127.0.0.1:57453_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 455813 INFO (qtp1032772393-6888) [n:127.0.0.1:57453_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 455814 INFO (qtp1729074956-6974) [n:127.0.0.1:57486_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 455817 INFO (qtp383455551-6944) [n:127.0.0.1:57480_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.collection1.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=2
[junit4] 2> 455818 INFO (OverseerThreadFactory-4211-thread-4-processing-n:127.0.0.1:57453_) [n:127.0.0.1:57453_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:57486_ for creating new replica of shard shard1 for collection collection1
[junit4] 2> 455823 INFO (OverseerThreadFactory-4211-thread-4-processing-n:127.0.0.1:57453_) [n:127.0.0.1:57453_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 455825 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ x:collection1_shard1_replica_p3 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_p3&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 456856 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 456869 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 456918 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 456964 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_p3' using configuration from configset conf1, trusted=true
[junit4] 2> 456965 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_p3' (registry 'solr.core.collection1.shard1.replica_p3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f7844fc
[junit4] 2> 456965 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.c.SolrCore [[collection1_shard1_replica_p3] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-2-001/cores/collection1_shard1_replica_p3], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_EE6D7537832728C5-001/shard-2-001/cores/collection1_shard1_replica_p3/data/]
[junit4] 2> 456968 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=21.203125, floorSegmentMB=0.365234375, forceMergeDeletesPctAllowed=19.410163653243306, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6574324557261713, deletesPctAllowed=45.862207326831964
[junit4] 2> 456986 WARN (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 457049 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms;
[junit4] 2> 457049 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 457050 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 457053 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 457055 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 457056 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 457057 INFO (searcherExecutor-4289-thread-1-processing-n:127.0.0.1:57486_ x:collection1_shard1_replica_p3 c:collection1 s:shard1) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.c.SolrCore [collection1_shard1_replica_p3] Registered new searcher autowarm time: 0 ms
[junit4] 2> 457066 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.c.ZkController collection1_shard1_replica_p3 starting background replication from leader
[junit4] 2> 457066 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 0:0:7
[junit4] 2> 457068 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 7000ms
[junit4] 2> 457068 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 457070 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ c:collection1 s:shard1 x:collection1_shard1_replica_p3 ] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_p3
[junit4] 2> 457070 INFO (updateExecutor-4265-thread-1-processing-n:127.0.0.1:57486_ x:collection1_shard1_replica_p3 c:collection1 s:shard1) [n:127.0.0.1:57486_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_p3 ] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 457071 INFO (recoveryExecutor-4267-thread-1-processing-n:127.0.0.1:57486_ x:collection1_shard1_replica_p3 c:collection1 s:shard1 r:core_node4) [n:127.0.0.1:57486_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_p3 ] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 457073 INFO (recoveryExecutor-4267-thread-1-processing-n:127.0.0.1:57486_ x:collection1_shard1_replica_p3 c:collection1 s:shard1 r:core_node4) [n:127.0.0.1:57486_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_p3 ] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard1_replica_p3] as recovering, leader is [http://127.0.0.1:57480/collection1_shard1_replica_n1/] and I am [http://127.0.0.1:57486/collection1_shard1_replica_p3/]
[junit4] 2> 457074 INFO (qtp1729074956-6973) [n:127.0.0.1:57486_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_p3&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=1248
[junit4] 2> 457074 INFO (recoveryExecutor-4267-thread-1-processing-n:127.0.0.1:57486_ x:collection1_shard1_replica_p3 c:collection1 s:shard1 r:core_node4) [n:127.0.0.1:57486_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_p3 ] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
[junit4] 2> 457074 INFO (recoveryExecutor-4267-thread-
[...truncated too long message...]
ush(BufferedOutputStream.java:142)
[junit4] 2> at java.base@13.0.2/java.io.PrintStream.flush(PrintStream.java:417)
[junit4] 2> at app//org.apache.lucene.util.TestRuleLimitSysouts$DelegateStream.flush(TestRuleLimitSysouts.java:189)
[junit4] 2> at java.base@13.0.2/java.io.PrintStream.write(PrintStream.java:561)
[junit4] 2> at java.base@13.0.2/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:242)
[junit4] 2> at java.base@13.0.2/sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:321)
[junit4] 2> at java.base@13.0.2/sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:110)
[junit4] 2> at java.base@13.0.2/java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:184)
[junit4] 2> at java.base@13.0.2/java.io.PrintStream.writeln(PrintStream.java:654)
[junit4] 2> at java.base@13.0.2/java.io.PrintStream.println(PrintStream.java:981)
[junit4] 2> at java.base@13.0.2/java.lang.Throwable$WrappedPrintStream.println(Throwable.java:762)
[junit4] 2> at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:672)
[junit4] 2> at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:658)
[junit4] 2> at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:649)
[junit4] 2> at app//org.apache.solr.cloud.StoppableSearchThread.run(StoppableSearchThread.java:57)
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=lg-UG, timezone=Europe/Tirane
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=6,threads=2,free=151455760,total=376963072
[junit4] 2> NOTE: All tests run in this JVM: [TestPayloadScoreQParserPlugin, TestFunctionQuery, TemplateUpdateProcessorTest, TestPolicyCloud, TestNumericRangeQuery64, ZkDynamicConfigTest, TestRequestStatusCollectionAPI, CachingDirectoryFactoryTest, TestCustomStream, TestComplexPhraseQParserPlugin, DistributedMLTComponentTest, RoutingToNodesWithPropertiesTest, TestSimPolicyCloud, TestExtendedDismaxParser, TestSchemaNameResource, TestHttpShardHandlerFactory, ExecutePlanActionTest, EmbeddedSolrNoSerializeTest, SplitShardTest, TestConfigSetsAPIExclusivity, ForceLeaderWithTlogReplicasTest, TestCollectionAPI, PreAnalyzedFieldTest, DistributedFacetPivotLargeTest, AnalysisAfterCoreReloadTest, ZkStateReaderTest, TestSolrCoreParser, TermVectorComponentDistributedTest, TestUnInvertedFieldException, SharedFSAutoReplicaFailoverTest, TokenizerChainTest, AssignBackwardCompatibilityTest, TestImplicitCoreProperties, LeaderElectionContextKeyTest, ResourceLoaderTest, DataDrivenBlockJoinTest, OverriddenZkACLAndCredentialsProvidersTest, SpatialFilterTest, TestShardHandlerFactory, PeerSyncWithBufferUpdatesTest, TestCloudRecovery, BlockCacheTest, SegmentsInfoRequestHandlerTest, TestStressVersions, ChaosMonkeyNothingIsSafeWithPullReplicasTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeyNothingIsSafeWithPullReplicasTest -Dtests.seed=EE6D7537832728C5 -Dtests.slow=true -Dtests.locale=lg-UG -Dtests.timezone=Europe/Tirane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | ChaosMonkeyNothingIsSafeWithPullReplicasTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest:
[junit4] > 1) Thread[id=7023, name=StoppableCommitThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
[junit4] > at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
[junit4] > at app//org.apache.solr.cloud.StoppableCommitThread.run(StoppableCommitThread.java:55)
[junit4] > 2) Thread[id=7022, name=StoppableSearchThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
[junit4] > at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
[junit4] > at app//org.apache.solr.cloud.StoppableSearchThread.run(StoppableSearchThread.java:65)
[junit4] > at __randomizedtesting.SeedInfo.seed([EE6D7537832728C5]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=7022, name=StoppableSearchThread, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
[junit4] > at java.base@13.0.2/sun.nio.cs.UTF_8$Encoder.encodeLoop(UTF_8.java:564)
[junit4] > at java.base@13.0.2/java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:578)
[junit4] > at java.base@13.0.2/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:301)
[junit4] > at java.base@13.0.2/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:290)
[junit4] > at java.base@13.0.2/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:131)
[junit4] > at java.base@13.0.2/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:141)
[junit4] > at java.base@13.0.2/java.io.OutputStreamWriter.write(OutputStreamWriter.java:229)
[junit4] > at java.base@13.0.2/java.io.Writer.write(Writer.java:249)
[junit4] > at app//com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.close(JsonWriter.java:345)
[junit4] > at app//com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.endObject(JsonWriter.java:313)
[junit4] > at app//com.carrotsearch.ant.tasks.junit4.events.AppendStdErrEvent.serialize(AppendStdErrEvent.java:31)
[junit4] > at app//com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:129)
[junit4] > at app//com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:124)
[junit4] > at java.base@13.0.2/java.security.AccessController.executePrivileged(AccessController.java:784)
[junit4] > at java.base@13.0.2/java.security.AccessController.doPrivileged(AccessController.java:554)
[junit4] > at app//com.carrotsearch.ant.tasks.junit4.events.Serializer.flushQueue(Serializer.java:124)
[junit4] > at app//com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:98)
[junit4] > at app//com.carrotsearch.ant.tasks.junit4.slave.SlaveMain$3$2.write(SlaveMain.java:498)
[junit4] > at java.base@13.0.2/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81)
[junit4] > at java.base@13.0.2/java.io.BufferedOutputStream.flush(BufferedOutputStream.java:142)
[junit4] > at java.base@13.0.2/java.io.PrintStream.flush(PrintStream.java:417)
[junit4] > at app//org.apache.lucene.util.TestRuleLimitSysouts$DelegateStream.flush(TestRuleLimitSysouts.java:189)
[junit4] > at java.base@13.0.2/java.io.PrintStream.write(PrintStream.java:561)
[junit4] > at java.base@13.0.2/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:242)
[junit4] > at java.base@13.0.2/sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:321)
[junit4] > at java.base@13.0.2/sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:110)
[junit4] > at java.base@13.0.2/java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:184)
[junit4] > at java.base@13.0.2/java.io.PrintStream.writeln(PrintStream.java:654)
[junit4] > at java.base@13.0.2/java.io.PrintStream.println(PrintStream.java:981)
[junit4] > at java.base@13.0.2/java.lang.Throwable$WrappedPrintStream.println(Throwable.java:762)
[junit4] > at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:672)
[junit4] > at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:658)
[junit4] > at java.base@13.0.2/java.lang.Throwable.printStackTrace(Throwable.java:649)
[junit4] > at app//org.apache.solr.cloud.StoppableSearchThread.run(StoppableSearchThread.java:57)
[junit4] > at __randomizedtesting.SeedInfo.seed([EE6D7537832728C5]:0)
[junit4] Completed [198/914 (1!)] on J0 in 34.73s, 1 test, 3 errors <<< FAILURES!
[...truncated 49844 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/99/consoleText
[repro] Revision: 83191eb2f77567d7d7c5ca85c87d18a1c6bc74ae
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line: ant test -Dtestcase=ChaosMonkeyNothingIsSafeWithPullReplicasTest -Dtests.method=test -Dtests.seed=EE6D7537832728C5 -Dtests.slow=true -Dtests.locale=lg-UG -Dtests.timezone=Europe/Tirane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] Repro line: ant test -Dtestcase=ChaosMonkeyNothingIsSafeWithPullReplicasTest -Dtests.seed=EE6D7537832728C5 -Dtests.slow=true -Dtests.locale=lg-UG -Dtests.timezone=Europe/Tirane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] ChaosMonkeyNothingIsSafeWithPullReplicasTest
[repro] ant compile-test
[...truncated 3472 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.ChaosMonkeyNothingIsSafeWithPullReplicasTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=EE6D7537832728C5 -Dtests.slow=true -Dtests.locale=lg-UG -Dtests.timezone=Europe/Tirane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 81 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
[repro] Exiting with code 0
[...truncated 91 lines...]
[JENKINS] Lucene-Solr-8.6-MacOSX (64bit/jdk-12.0.2) - Build # 98 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/98/
Java: 64bit/jdk-12.0.2 -XX:-UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler
Error Message:
ObjectTracker found 5 object(s) that were not released!!! [SolrCore, MockDirectoryWrapper, InternalHttpClient, MockDirectoryWrapper, MockDirectoryWrapper] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1077) at org.apache.solr.core.SolrCore.reload(SolrCore.java:697) at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1641) at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:951) at java.base/java.lang.Thread.run(Thread.java:835) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354) at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:802) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:988) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:906) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1387) at org.apache.solr.core.CoreContainer.lambda$load$14(CoreContainer.java:837) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:212) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:835) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:339) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:348) at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.java:230) at org.apache.solr.handler.IndexFetcher.<init>(IndexFetcher.java:272) at org.apache.solr.handler.ReplicationHandler.inform(ReplicationHandler.java:1251) at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:657) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1022) at org.apache.solr.core.SolrCore.reload(SolrCore.java:697) at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1641) at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:951) at java.base/java.lang.Thread.run(Thread.java:835) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:523) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:354) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:427) at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$13(ReplicationHandler.java:1219) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:835) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354) at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:542) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:980) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:906) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1387) at org.apache.solr.core.CoreContainer.lambda$load$14(CoreContainer.java:837) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:212) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:835) expected null, but was:<ObjectTracker found 5 object(s) that were not released!!! [SolrCore, MockDirectoryWrapper, InternalHttpClient, MockDirectoryWrapper, MockDirectoryWrapper] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1077) at org.apache.solr.core.SolrCore.reload(SolrCore.java:697) at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1641) at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:951) at java.base/java.lang.Thread.run(Thread.java:835) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354) at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:802) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:988) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:906) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1387) at org.apache.solr.core.CoreContainer.lambda$load$14(CoreContainer.java:837) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:212) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:835) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:339) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:348) at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.java:230) at org.apache.solr.handler.IndexFetcher.<init>(IndexFetcher.java:272) at org.apache.solr.handler.ReplicationHandler.inform(ReplicationHandler.java:1251) at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:657) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1022) at org.apache.solr.core.SolrCore.reload(SolrCore.java:697) at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1641) at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:951) at java.base/java.lang.Thread.run(Thread.java:835) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:523) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:354) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:427) at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$13(ReplicationHandler.java:1219) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:835) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354) at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:542) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:980) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:906) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1387) at org.apache.solr.core.CoreContainer.lambda$load$14(CoreContainer.java:837) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:212) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:835) >
Stack Trace:
java.lang.AssertionError: ObjectTracker found 5 object(s) that were not released!!! [SolrCore, MockDirectoryWrapper, InternalHttpClient, MockDirectoryWrapper, MockDirectoryWrapper]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1077)
at org.apache.solr.core.SolrCore.reload(SolrCore.java:697)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1641)
at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:951)
at java.base/java.lang.Thread.run(Thread.java:835)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:802)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:988)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:906)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1387)
at org.apache.solr.core.CoreContainer.lambda$load$14(CoreContainer.java:837)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:212)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:835)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:339)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:348)
at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.java:230)
at org.apache.solr.handler.IndexFetcher.<init>(IndexFetcher.java:272)
at org.apache.solr.handler.ReplicationHandler.inform(ReplicationHandler.java:1251)
at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:657)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1022)
at org.apache.solr.core.SolrCore.reload(SolrCore.java:697)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1641)
at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:951)
at java.base/java.lang.Thread.run(Thread.java:835)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:523)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:354)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:427)
at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$13(ReplicationHandler.java:1219)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:835)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:542)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:980)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:906)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1387)
at org.apache.solr.core.CoreContainer.lambda$load$14(CoreContainer.java:837)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:212)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:835)
expected null, but was:<ObjectTracker found 5 object(s) that were not released!!! [SolrCore, MockDirectoryWrapper, InternalHttpClient, MockDirectoryWrapper, MockDirectoryWrapper]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1077)
at org.apache.solr.core.SolrCore.reload(SolrCore.java:697)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1641)
at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:951)
at java.base/java.lang.Thread.run(Thread.java:835)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:802)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:988)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:906)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1387)
at org.apache.solr.core.CoreContainer.lambda$load$14(CoreContainer.java:837)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:212)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:835)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:339)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:348)
at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.java:230)
at org.apache.solr.handler.IndexFetcher.<init>(IndexFetcher.java:272)
at org.apache.solr.handler.ReplicationHandler.inform(ReplicationHandler.java:1251)
at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:657)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1022)
at org.apache.solr.core.SolrCore.reload(SolrCore.java:697)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1641)
at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:951)
at java.base/java.lang.Thread.run(Thread.java:835)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:523)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:354)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:427)
at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$13(ReplicationHandler.java:1219)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:835)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:542)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:980)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:906)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1387)
at org.apache.solr.core.CoreContainer.lambda$load$14(CoreContainer.java:837)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:212)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:835)
>
at __randomizedtesting.SeedInfo.seed([5D4A0F4E9648995D]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotNull(Assert.java:755)
at org.junit.Assert.assertNull(Assert.java:737)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:334)
at jdk.internal.reflect.GeneratedMethodAccessor62.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:901)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:835)
Build Log:
[...truncated 14429 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> 586882 INFO (SUITE-TestReplicationHandler-seed#[5D4A0F4E9648995D]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 586882 INFO (SUITE-TestReplicationHandler-seed#[5D4A0F4E9648995D]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 586882 INFO (SUITE-TestReplicationHandler-seed#[5D4A0F4E9648995D]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/data-dir-44-001
[junit4] 2> 586882 WARN (SUITE-TestReplicationHandler-seed#[5D4A0F4E9648995D]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=24 numCloses=24
[junit4] 2> 586882 INFO (SUITE-TestReplicationHandler-seed#[5D4A0F4E9648995D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 586883 INFO (SUITE-TestReplicationHandler-seed#[5D4A0F4E9648995D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="None") w/ MAC_OS_X supressed clientAuth
[junit4] 2> 586890 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testFileListShouldReportErrorsWhenTheyOccur
[junit4] 2> 586890 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-001/collection1
[junit4] 2> 586894 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 586895 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 586895 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 586895 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
[junit4] 2> 586926 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 586926 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 586926 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 586926 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ac3b718{/solr,null,AVAILABLE}
[junit4] 2> 586927 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@21392ada{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:53809}
[junit4] 2> 586927 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.Server Started @586997ms
[junit4] 2> 586927 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-001/collection1/data, hostPort=53809}
[junit4] 2> 586927 ERROR (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 586927 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 586927 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.6.0
[junit4] 2> 586928 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 586928 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 586928 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-06T15:01:12.193048Z
[junit4] 2> 586928 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-001/solr.xml
[junit4] 2> 586931 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 586931 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 586932 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 587317 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 587321 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@218d396[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 587321 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@218d396[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 587326 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@30ab4766[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 587326 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@30ab4766[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 587329 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 587461 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 587461 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 587556 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 587591 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 587591 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 587594 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-001
[junit4] 2> 587596 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 587603 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 587615 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 587618 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 587618 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-001/collection1, trusted=true
[junit4] 2> 587619 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 587619 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-001/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-001/collection1/data/]
[junit4] 2> 587627 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.369140625, noCFSRatio=0.0]
[junit4] 2> 587805 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 587805 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 587808 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=13, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 587822 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-001/collection1/conf
[junit4] 2> 587823 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 587823 INFO (coreLoadExecutor-7629-thread-1) [ x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 587824 INFO (searcherExecutor-7631-thread-1-processing-x:collection1) [ x:collection1 ] o.a.s.c.SolrCore [collection1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 587826 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-002/collection1
[junit4] 2> 587830 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 587830 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 587830 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 587831 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
[junit4] 2> 587842 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 587843 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 587843 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 587849 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@44573517{/solr,null,AVAILABLE}
[junit4] 2> 587858 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4e6bccd0{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:53845}
[junit4] 2> 587859 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.Server Started @587928ms
[junit4] 2> 587859 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-002/collection1/data, hostPort=53845}
[junit4] 2> 587859 ERROR (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 587859 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 587859 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.6.0
[junit4] 2> 587859 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 587859 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 587859 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-06T15:01:13.124649Z
[junit4] 2> 587859 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-002/solr.xml
[junit4] 2> 587862 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 587862 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 587863 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 587933 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 587941 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7165be65[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 587941 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7165be65[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 587955 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1c29b5fb[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 587955 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1c29b5fb[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 587957 WARN (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 588006 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 588006 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 588084 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 588164 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 588164 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 588168 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-002
[junit4] 2> 588168 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 588173 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 588194 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 588195 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 588196 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-002/collection1, trusted=true
[junit4] 2> 588196 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 588196 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-002/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-002/collection1/data/]
[junit4] 2> 588207 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.369140625, noCFSRatio=0.0]
[junit4] 2> 588291 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 588291 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 588293 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=13, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 588294 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-002/collection1/conf
[junit4] 2> 588307 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 588307 INFO (coreLoadExecutor-7647-thread-1) [ x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 588308 INFO (searcherExecutor-7649-thread-1-processing-x:collection1) [ x:collection1 ] o.a.s.c.SolrCore [collection1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 588812 INFO (qtp1985981673-13731) [ x:collection1 ] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={generation=-2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=1
[junit4] 2> 588813 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testFileListShouldReportErrorsWhenTheyOccur
[junit4] 2> 588813 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=933284908
[junit4] 2> 588814 INFO (coreCloseExecutor-7656-thread-1) [ ] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@122e8a0c
[junit4] 2> 588814 INFO (coreCloseExecutor-7656-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@122e8a0c
[junit4] 2> 588814 INFO (coreCloseExecutor-7656-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@41233db: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@41acd144
[junit4] 2> 588829 INFO (coreCloseExecutor-7656-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary).
[junit4] 2> 588839 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
[junit4] 2> 588839 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5b9ce408: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@668fe9a3
[junit4] 2> 588844 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
[junit4] 2> 588844 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@68574853: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1547fa65
[junit4] 2> 588846 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
[junit4] 2> 588846 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@551318ea: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@1b6a7893
[junit4] 2> 588851 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@21392ada{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 588851 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6ac3b718{/solr,null,UNAVAILABLE}
[junit4] 2> 588851 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 588854 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1613320969
[junit4] 2> 588855 INFO (coreCloseExecutor-7660-thread-1) [ ] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1fd9c319
[junit4] 2> 588855 INFO (coreCloseExecutor-7660-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@1fd9c319
[junit4] 2> 588855 INFO (coreCloseExecutor-7660-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3ee0d9cb: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@273a5506
[junit4] 2> 588867 INFO (coreCloseExecutor-7660-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary).
[junit4] 2> 588875 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
[junit4] 2> 588875 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1ec1ec53: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@37ea748d
[junit4] 2> 588881 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
[junit4] 2> 588881 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@56fc6a81: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1547fa65
[junit4] 2> 588884 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
[junit4] 2> 588884 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@65b45f9f: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@1b6a7893
[junit4] 2> 588889 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@4e6bccd0{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 588889 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@44573517{/solr,null,UNAVAILABLE}
[junit4] 2> 588889 INFO (TEST-TestReplicationHandler.testFileListShouldReportErrorsWhenTheyOccur-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 588897 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testShouldReportErrorWhenDeletingBackupButNameMissing
[junit4] 2> 588898 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-003/collection1
[junit4] 2> 588901 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 588901 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 588901 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 588901 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
[junit4] 2> 588903 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 588903 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 588903 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 588903 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3bf8f987{/solr,null,AVAILABLE}
[junit4] 2> 588905 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@c6edb3d{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:53859}
[junit4] 2> 588905 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.Server Started @588974ms
[junit4] 2> 588905 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-003/collection1/data, hostPort=53859}
[junit4] 2> 588905 ERROR (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 588905 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 588905 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.6.0
[junit4] 2> 588905 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 588905 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 588905 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-06T15:01:14.170556Z
[junit4] 2> 588905 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-003/solr.xml
[junit4] 2> 588908 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 588908 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 588909 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 588957 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 588959 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3f9bc281[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 588959 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3f9bc281[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 588970 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@12842e4e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 588970 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@12842e4e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 588973 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 589020 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 589020 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 589047 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 589066 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 589066 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 589069 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-003
[junit4] 2> 589069 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 589074 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 589082 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 589083 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 589083 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-003/collection1, trusted=true
[junit4] 2> 589083 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 589083 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-003/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-003/collection1/data/]
[junit4] 2> 589085 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.369140625, noCFSRatio=0.0]
[junit4] 2> 589322 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 589322 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 589334 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=13, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 589349 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-003/collection1/conf
[junit4] 2> 589349 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 589349 INFO (coreLoadExecutor-7674-thread-1) [ x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 589351 INFO (searcherExecutor-7676-thread-1-processing-x:collection1) [ x:collection1 ] o.a.s.c.SolrCore [collection1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 589358 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-004/collection1
[junit4] 2> 589373 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 589373 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 589374 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 589374 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
[junit4] 2> 589386 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 589386 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 589386 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 589388 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ab61af1{/solr,null,AVAILABLE}
[junit4] 2> 589391 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1816760a{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:53860}
[junit4] 2> 589391 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.s.Server Started @589460ms
[junit4] 2> 589391 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-004/collection1/data, hostPort=53860}
[junit4] 2> 589391 ERROR (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 589391 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 589391 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.6.0
[junit4] 2> 589391 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 589391 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr
[junit4] 2> 589391 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-07-06T15:01:14.656874Z
[junit4] 2> 589391 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-004/solr.xml
[junit4] 2> 589394 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 589394 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 589395 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 589813 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 589817 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@41d5d684[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 589817 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@41d5d684[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 589829 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@317ad764[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 589829 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@317ad764[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 589831 WARN (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 589873 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 589873 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 589919 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 589934 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 589934 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 589936 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-004
[junit4] 2> 589936 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 589943 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0
[junit4] 2> 589950 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 589951 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 589951 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-004/collection1, trusted=true
[junit4] 2> 589952 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@502134f4
[junit4] 2> 589952 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-004/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-004/collection1/data/]
[junit4] 2> 589953 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.369140625, noCFSRatio=0.0]
[junit4] 2> 590031 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 590031 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 590032 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=13, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 590033 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-8.6-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler_5D4A0F4E9648995D-001/solr-instance-004/collection1/conf
[junit4] 2> 590035 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 590035 INFO (coreLoadExecutor-7692-thread-1) [ x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 590036 INFO (searcherExecutor-7694-thread-1-processing-x:collection1) [ x:collection1 ] o.a.s.c.SolrCore [collection1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 590037 INFO (qtp1757709492-13762) [ x:collection1 ] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 590037 INFO (indexFetcher-7698-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 590037 INFO (indexFetcher-7698-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 590037 INFO (indexFetcher-7698-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 590037 INFO (indexFetcher-7698-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 590037 INFO (indexFetcher-7698-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 590045 INFO (searcherExecutor-7694-thread-1-processing-x:collection1) [ x:collection1 ] o.a.s.c.SolrCore [collection1] Registered new searcher autowarm time: 0 ms
[junit4] 2> 590047 ERROR (qtp1475939499-13783) [ x:collection1 ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Missing required parameter: name
[junit4] 2> at org.apache.solr.common.params.RequiredSolrParams.get(RequiredSolrParams.java:48)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.deleteSnapshot(ReplicationHandler.java:331)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:285)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
[junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2606)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:812)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:588)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
[junit4] 2> at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:767)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:500)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:835)
[junit4] 2>
[junit4] 2> 590048 INFO (qtp1475939499-13783) [ x:collection1 ] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=deletebackup} status=400 QTime=1
[junit4] 2> 590053 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testShouldReportErrorWhenDeletingBackupButNameMissing
[junit4] 2> 590053 INFO (TEST-TestReplicationHandler.testShouldReportErrorWhenDeletingBackupButNameMissing-seed#[5D4A0F4E9648995D]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1414984112
[junit4] 2> 590056 INFO (coreCloseExecutor-7701-thread-1) [ ] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@35c03edf
[junit4] 2> 590056 INFO (coreCloseExecutor-7701-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1
[...truncated too long message...]
rent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:835)
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
[junit4] > at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:542)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:980)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:906)
[junit4] > at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1387)
[junit4] > at org.apache.solr.core.CoreContainer.lambda$load$14(CoreContainer.java:837)
[junit4] > at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202)
[junit4] > at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:212)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:835)
[junit4] > expected null, but was:<ObjectTracker found 5 object(s) that were not released!!! [SolrCore, MockDirectoryWrapper, InternalHttpClient, MockDirectoryWrapper, MockDirectoryWrapper]
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1077)
[junit4] > at org.apache.solr.core.SolrCore.reload(SolrCore.java:697)
[junit4] > at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1641)
[junit4] > at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:951)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:835)
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
[junit4] > at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)
[junit4] > at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:802)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:988)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:906)
[junit4] > at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1387)
[junit4] > at org.apache.solr.core.CoreContainer.lambda$load$14(CoreContainer.java:837)
[junit4] > at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202)
[junit4] > at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:212)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:835)
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:339)
[junit4] > at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:348)
[junit4] > at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.java:230)
[junit4] > at org.apache.solr.handler.IndexFetcher.<init>(IndexFetcher.java:272)
[junit4] > at org.apache.solr.handler.ReplicationHandler.inform(ReplicationHandler.java:1251)
[junit4] > at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:657)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1022)
[junit4] > at org.apache.solr.core.SolrCore.reload(SolrCore.java:697)
[junit4] > at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1641)
[junit4] > at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:951)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:835)
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
[junit4] > at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:523)
[junit4] > at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:354)
[junit4] > at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:427)
[junit4] > at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$13(ReplicationHandler.java:1219)
[junit4] > at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
[junit4] > at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
[junit4] > at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:835)
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
[junit4] > at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:542)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:980)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:906)
[junit4] > at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1387)
[junit4] > at org.apache.solr.core.CoreContainer.lambda$load$14(CoreContainer.java:837)
[junit4] > at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202)
[junit4] > at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:212)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:835)
[junit4] > >
[junit4] > at __randomizedtesting.SeedInfo.seed([5D4A0F4E9648995D]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:334)
[junit4] > at jdk.internal.reflect.GeneratedMethodAccessor62.invoke(Unknown Source)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:567)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:835)
[junit4] Completed [333/914 (1!)] on J2 in 149.29s, 21 tests, 1 failure <<< FAILURES!
[...truncated 49697 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/98/consoleText
[repro] Revision: 6a715e2ecc3ff8a1d0312314d16196c5639881d0
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseG1GC"
[repro] Repro line: ant test -Dtestcase=TestReplicationHandler -Dtests.seed=5D4A0F4E9648995D -Dtests.slow=true -Dtests.locale=en-AG -Dtests.timezone=Africa/Kinshasa -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestReplicationHandler
[repro] ant compile-test
[...truncated 3472 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestReplicationHandler" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseG1GC" -Dtests.seed=5D4A0F4E9648995D -Dtests.slow=true -Dtests.locale=en-AG -Dtests.timezone=Africa/Kinshasa -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 181 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.handler.TestReplicationHandler
[repro] Exiting with code 0
[...truncated 91 lines...]