You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/11/14 10:09:23 UTC
[JENKINS] Lucene-Solr-Tests-master - Build # 2173 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2173/
All tests passed
Build Log:
[...truncated 891 lines...]
[junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171114_091930_8237083462653380337650.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # There is insufficient memory for the Java Runtime Environment to continue.
[junit4] # Native memory allocation (mmap) failed to map 1048576 bytes for committing reserved memory.
[junit4] # An error report file with more information is saved as:
[junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/J1/hs_err_pid28302.log
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J1: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171114_091930_8231215022918631988613.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000fff00000, 1048576, 0) failed; error='Cannot allocate memory' (errno=12)
[junit4] <<< JVM J1: EOF ----
[...truncated 914 lines...]
[junit4] ERROR: JVM J1 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=EB46FA591F524495 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=8.0.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=8.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/J1 -Djunit4.childvm.id=1 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171114_091930_8235094713458199537727.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171114_091930_8235077968734595489008.suites -stdin
[junit4] ERROR: JVM J1 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171114_091930_8237083462653380337650.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171114_091930_8231215022918631988613.syserr
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] at java.lang.Thread.run(Thread.java:748)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:835: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:779: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1512: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1038: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171114_091930_8237083462653380337650.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171114_091930_8231215022918631988613.syserr
Total time: 51 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-master #2172 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2176 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2176/
1 tests failed.
FAILED: org.apache.solr.client.solrj.impl.CloudSolrClientTest.preferLocalShardsTest
Error Message:
Could not load collection from ZK: localShardsTestColl
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: localShardsTestColl
at __randomizedtesting.SeedInfo.seed([61F79A1E73223DE:FAD2E11819E5B424]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.client.solrj.impl.CloudSolrClient.getDocCollection(CloudSolrClient.java:1206)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:848)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
at org.apache.solr.client.solrj.impl.CloudSolrClientTest.queryWithPreferLocalShards(CloudSolrClientTest.java:458)
at org.apache.solr.client.solrj.impl.CloudSolrClientTest.preferLocalShardsTest(CloudSolrClientTest.java:439)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/localShardsTestColl/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 48 more
Build Log:
[...truncated 14978 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrClientTest
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/init-core-data-001
[junit4] 2> 359592 INFO (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 359626 INFO (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 359626 INFO (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 359627 INFO (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001
[junit4] 2> 359627 INFO (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 359642 INFO (Thread-278) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 359642 INFO (Thread-278) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 359751 INFO (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:39491
[junit4] 2> 359899 ERROR (Thread-278) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 360740 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15fc21721bd0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 360926 INFO (jetty-launcher-169-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 360759 INFO (jetty-launcher-169-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 360977 INFO (jetty-launcher-169-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@48ed31f6{/solr,null,AVAILABLE}
[junit4] 2> 360978 INFO (jetty-launcher-169-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1262327{HTTP/1.1,[http/1.1]}{127.0.0.1:36071}
[junit4] 2> 360978 INFO (jetty-launcher-169-thread-1) [ ] o.e.j.s.Server Started @375435ms
[junit4] 2> 360978 INFO (jetty-launcher-169-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36071}
[junit4] 2> 360978 ERROR (jetty-launcher-169-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 360978 INFO (jetty-launcher-169-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 360978 INFO (jetty-launcher-169-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 360978 INFO (jetty-launcher-169-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 360978 INFO (jetty-launcher-169-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-15T23:50:18.081Z
[junit4] 2> 361143 INFO (jetty-launcher-169-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 361157 INFO (jetty-launcher-169-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@31b16d60{/solr,null,AVAILABLE}
[junit4] 2> 361158 INFO (jetty-launcher-169-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@29b6bf97{HTTP/1.1,[http/1.1]}{127.0.0.1:46208}
[junit4] 2> 361158 INFO (jetty-launcher-169-thread-2) [ ] o.e.j.s.Server Started @375615ms
[junit4] 2> 361158 INFO (jetty-launcher-169-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46208}
[junit4] 2> 361158 ERROR (jetty-launcher-169-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 361158 INFO (jetty-launcher-169-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 361158 INFO (jetty-launcher-169-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 361158 INFO (jetty-launcher-169-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 361158 INFO (jetty-launcher-169-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-15T23:50:18.261Z
[junit4] 2> 361251 INFO (jetty-launcher-169-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7a4fb81{/solr,null,AVAILABLE}
[junit4] 2> 361251 INFO (jetty-launcher-169-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5232fce1{HTTP/1.1,[http/1.1]}{127.0.0.1:34219}
[junit4] 2> 361251 INFO (jetty-launcher-169-thread-3) [ ] o.e.j.s.Server Started @375708ms
[junit4] 2> 361251 INFO (jetty-launcher-169-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34219}
[junit4] 2> 361252 ERROR (jetty-launcher-169-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 361252 INFO (jetty-launcher-169-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 361252 INFO (jetty-launcher-169-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 361252 INFO (jetty-launcher-169-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 361252 INFO (jetty-launcher-169-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-15T23:50:18.355Z
[junit4] 2> 361581 INFO (jetty-launcher-169-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 361617 INFO (jetty-launcher-169-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 361670 INFO (jetty-launcher-169-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 361910 INFO (jetty-launcher-169-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39491/solr
[junit4] 2> 362110 INFO (jetty-launcher-169-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39491/solr
[junit4] 2> 362178 INFO (jetty-launcher-169-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39491/solr
[junit4] 2> 363890 WARN (jetty-launcher-169-thread-2) [n:127.0.0.1:46208_solr ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 364015 WARN (jetty-launcher-169-thread-1) [n:127.0.0.1:36071_solr ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 363999 WARN (jetty-launcher-169-thread-3) [n:127.0.0.1:34219_solr ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 364038 INFO (jetty-launcher-169-thread-3) [n:127.0.0.1:34219_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 364039 INFO (jetty-launcher-169-thread-1) [n:127.0.0.1:36071_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 364052 INFO (jetty-launcher-169-thread-3) [n:127.0.0.1:34219_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34219_solr
[junit4] 2> 364052 INFO (jetty-launcher-169-thread-1) [n:127.0.0.1:36071_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36071_solr
[junit4] 2> 364053 INFO (jetty-launcher-169-thread-3) [n:127.0.0.1:34219_solr ] o.a.s.c.Overseer Overseer (id=99011121431511049-127.0.0.1:34219_solr-n_0000000000) starting
[junit4] 2> 364148 INFO (jetty-launcher-169-thread-2) [n:127.0.0.1:46208_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 364185 INFO (zkCallback-184-thread-1-processing-n:127.0.0.1:36071_solr) [n:127.0.0.1:36071_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 364309 INFO (jetty-launcher-169-thread-2) [n:127.0.0.1:46208_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46208_solr
[junit4] 2> 364309 INFO (zkCallback-184-thread-1-processing-n:127.0.0.1:36071_solr) [n:127.0.0.1:36071_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 364344 INFO (zkCallback-186-thread-1-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 364436 INFO (OverseerStateUpdate-99011121431511049-127.0.0.1:34219_solr-n_0000000000) [n:127.0.0.1:34219_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 364543 INFO (zkCallback-185-thread-1-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 364726 INFO (zkCallback-185-thread-2-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 364730 INFO (jetty-launcher-169-thread-3) [n:127.0.0.1:34219_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34219_solr
[junit4] 2> 364948 INFO (zkCallback-184-thread-1-processing-n:127.0.0.1:36071_solr) [n:127.0.0.1:36071_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 364948 INFO (zkCallback-185-thread-2-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 364966 INFO (zkCallback-186-thread-2-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 365608 INFO (jetty-launcher-169-thread-1) [n:127.0.0.1:36071_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36071.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 365899 INFO (jetty-launcher-169-thread-1) [n:127.0.0.1:36071_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36071.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 365899 INFO (jetty-launcher-169-thread-1) [n:127.0.0.1:36071_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36071.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 365938 INFO (jetty-launcher-169-thread-1) [n:127.0.0.1:36071_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001/node1/.
[junit4] 2> 366510 INFO (jetty-launcher-169-thread-3) [n:127.0.0.1:34219_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34219.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 366694 INFO (jetty-launcher-169-thread-2) [n:127.0.0.1:46208_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46208.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 366854 INFO (jetty-launcher-169-thread-3) [n:127.0.0.1:34219_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34219.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 366854 INFO (jetty-launcher-169-thread-3) [n:127.0.0.1:34219_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34219.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 366855 INFO (jetty-launcher-169-thread-3) [n:127.0.0.1:34219_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001/node3/.
[junit4] 2> 366892 INFO (jetty-launcher-169-thread-2) [n:127.0.0.1:46208_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46208.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 366913 INFO (jetty-launcher-169-thread-2) [n:127.0.0.1:46208_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46208.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 367138 INFO (jetty-launcher-169-thread-2) [n:127.0.0.1:46208_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001/node2/.
[junit4] 2> 368303 INFO (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 368304 INFO (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39491/solr ready
[junit4] 2> 368484 INFO (qtp2116350560-1281) [n:127.0.0.1:34219_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 368686 INFO (OverseerThreadFactory-663-thread-1-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 368961 INFO (OverseerStateUpdate-99011121431511049-127.0.0.1:34219_solr-n_0000000000) [n:127.0.0.1:34219_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46208/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 368996 INFO (OverseerStateUpdate-99011121431511049-127.0.0.1:34219_solr-n_0000000000) [n:127.0.0.1:34219_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"collection1_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34219/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 369744 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=collection1_shard2_replica_n2&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 369745 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 369872 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 369872 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 370037 INFO (zkCallback-185-thread-2-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 370037 INFO (zkCallback-186-thread-2-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 370037 INFO (zkCallback-185-thread-1-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 370037 INFO (zkCallback-186-thread-1-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 371115 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 371187 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 371442 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.s.IndexSchema [collection1_shard2_replica_n2] Schema name=test
[junit4] 2> 371443 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema [collection1_shard1_replica_n1] Schema name=test
[junit4] 2> 372581 WARN (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 372581 WARN (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 372599 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 372599 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n2' using configuration from collection collection1, trusted=true
[junit4] 2> 372600 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34219.solr.core.collection1.shard2.replica_n2' (registry 'solr.core.collection1.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 372600 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 372600 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SolrCore [[collection1_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001/node3/collection1_shard2_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001/node3/./collection1_shard2_replica_n2/data/]
[junit4] 2> 372706 WARN (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 372706 WARN (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 372707 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 372707 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from collection collection1, trusted=true
[junit4] 2> 372707 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46208.solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 372707 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 372707 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001/node2/collection1_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001/node2/./collection1_shard1_replica_n1/data/]
[junit4] 2> 373917 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 373917 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 373918 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 373918 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 374025 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b63c5fc[collection1_shard2_replica_n2] main]
[junit4] 2> 374026 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 374027 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 374171 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 374172 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584177958119014400
[junit4] 2> 374174 INFO (searcherExecutor-670-thread-1-processing-n:127.0.0.1:34219_solr x:collection1_shard2_replica_n2 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SolrCore [collection1_shard2_replica_n2] Registered new searcher Searcher@5b63c5fc[collection1_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 374300 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 374300 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 374300 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34219/solr/collection1_shard2_replica_n2/
[junit4] 2> 374300 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 374300 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SyncStrategy http://127.0.0.1:34219/solr/collection1_shard2_replica_n2/ has no replicas
[junit4] 2> 374300 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 374354 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 374354 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 374355 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 374355 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 374356 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b6a6754[collection1_shard1_replica_n1] main]
[junit4] 2> 374357 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 374357 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 374358 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 374393 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34219/solr/collection1_shard2_replica_n2/ shard2
[junit4] 2> 374407 INFO (searcherExecutor-671-thread-1-processing-n:127.0.0.1:46208_solr x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@2b6a6754[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 374407 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584177958365429760
[junit4] 2> 374518 INFO (zkCallback-186-thread-3-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374518 INFO (zkCallback-186-thread-2-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374553 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 374555 INFO (qtp2116350560-1278) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=collection1_shard2_replica_n2&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4810
[junit4] 2> 374574 INFO (zkCallback-185-thread-2-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374574 INFO (zkCallback-185-thread-1-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374610 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 374611 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 374611 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46208/solr/collection1_shard1_replica_n1/
[junit4] 2> 374611 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 374611 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:46208/solr/collection1_shard1_replica_n1/ has no replicas
[junit4] 2> 374611 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 374613 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46208/solr/collection1_shard1_replica_n1/ shard1
[junit4] 2> 374757 INFO (zkCallback-185-thread-1-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374757 INFO (zkCallback-186-thread-1-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374757 INFO (zkCallback-185-thread-2-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374757 INFO (zkCallback-186-thread-3-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374773 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 374774 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4902
[junit4] 2> 374810 INFO (qtp2116350560-1281) [n:127.0.0.1:34219_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 374940 INFO (zkCallback-185-thread-2-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374940 INFO (zkCallback-186-thread-2-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374940 INFO (zkCallback-185-thread-1-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 374940 INFO (zkCallback-186-thread-3-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 375850 INFO (qtp2116350560-1281) [n:127.0.0.1:34219_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=7365
[junit4] 2> 375927 INFO (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30
[junit4] 2> 375977 INFO (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1
[junit4] 2> 376567 INFO (qtp213812002-1259) [n:127.0.0.1:36071_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 376680 INFO (qtp213812002-1259) [n:127.0.0.1:36071_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=112
[junit4] 2> 376748 INFO (OverseerCollectionConfigSetProcessor-99011121431511049-127.0.0.1:34219_solr-n_0000000000) [n:127.0.0.1:34219_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 376929 INFO (TEST-CloudSolrClientTest.testAliasHandling-seed#[61F79A1E73223DE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testAliasHandling
[junit4] 2> 377256 INFO (qtp1389436075-1266) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:34219/solr/collection1_shard2_replica_n2/&wt=javabin&version=2}{deleteByQuery=*:* (-1584177961279422464)} 0 70
[junit4] 2> 377293 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1584177961391620096,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 377293 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 377296 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 377296 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:34219/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 3
[junit4] 2> 377330 INFO (qtp2116350560-1284) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1584177961430417408,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 377330 INFO (qtp2116350560-1284) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 377333 INFO (qtp2116350560-1284) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 377333 INFO (qtp2116350560-1284) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:34219/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 3
[junit4] 2> 377406 INFO (qtp2116350560-1282) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:5&commit=true&wt=javabin&version=2}{deleteByQuery=*:* (-1584177961254256640),commit=} 0 461
[junit4] 2> 377419 INFO (qtp2116350560-1282) [n:127.0.0.1:34219_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=2nd_collection&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 377464 INFO (OverseerThreadFactory-663-thread-2-processing-n:127.0.0.1:34219_solr) [n:127.0.0.1:34219_solr ] o.a.s.c.CreateCollectionCmd Create collection 2nd_collection
[junit4] 2> 377858 INFO (OverseerStateUpdate-99011121431511049-127.0.0.1:34219_solr-n_0000000000) [n:127.0.0.1:34219_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"2nd_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"2nd_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36071/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 377983 INFO (OverseerStateUpdate-99011121431511049-127.0.0.1:34219_solr-n_0000000000) [n:127.0.0.1:34219_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"2nd_collection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"2nd_collection_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46208/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 378240 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=2nd_collection_shard1_replica_n1&action=CREATE&numShards=2&collection=2nd_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 378241 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 378260 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=2nd_collection_shard2_replica_n2&action=CREATE&numShards=2&collection=2nd_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 378598 INFO (zkCallback-185-thread-1-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 378598 INFO (zkCallback-185-thread-2-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 378598 INFO (zkCallback-184-thread-1-processing-n:127.0.0.1:36071_solr) [n:127.0.0.1:36071_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 378610 INFO (zkCallback-184-thread-2-processing-n:127.0.0.1:36071_solr) [n:127.0.0.1:36071_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 379477 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 379640 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 379695 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.s.IndexSchema [2nd_collection_shard2_replica_n2] Schema name=test
[junit4] 2> 379841 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.s.IndexSchema [2nd_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 380943 WARN (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 380943 WARN (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 380944 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 380944 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore '2nd_collection_shard2_replica_n2' using configuration from collection 2nd_collection, trusted=true
[junit4] 2> 380944 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46208.solr.core.2nd_collection.shard2.replica_n2' (registry 'solr.core.2nd_collection.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 380944 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 380944 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.SolrCore [[2nd_collection_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001/node2/2nd_collection_shard2_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001/node2/./2nd_collection_shard2_replica_n2/data/]
[junit4] 2> 381068 WARN (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 381068 WARN (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 381068 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 381068 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore '2nd_collection_shard1_replica_n1' using configuration from collection 2nd_collection, trusted=true
[junit4] 2> 381105 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36071.solr.core.2nd_collection.shard1.replica_n1' (registry 'solr.core.2nd_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325c4534
[junit4] 2> 381105 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 381105 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.SolrCore [[2nd_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001/node1/2nd_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001/tempDir-001/node1/./2nd_collection_shard1_replica_n1/data/]
[junit4] 2> 382194 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 382194 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 382195 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 382195 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 382197 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c009757[2nd_collection_shard1_replica_n1] main]
[junit4] 2> 382211 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 382211 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 382212 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 382212 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584177966549565440
[junit4] 2> 382322 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 382322 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 382322 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36071/solr/2nd_collection_shard1_replica_n1/
[junit4] 2> 382322 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 382322 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:36071/solr/2nd_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 382322 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 382341 INFO (searcherExecutor-681-thread-1-processing-n:127.0.0.1:36071_solr x:2nd_collection_shard1_replica_n1 s:shard1 c:2nd_collection r:core_node3) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.SolrCore [2nd_collection_shard1_replica_n1] Registered new searcher Searcher@1c009757[2nd_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 382359 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 382360 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 382415 INFO (zkCallback-185-thread-1-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 382415 INFO (zkCallback-185-thread-2-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 382416 INFO (zkCallback-184-thread-2-processing-n:127.0.0.1:36071_solr) [n:127.0.0.1:36071_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 382416 INFO (zkCallback-184-thread-1-processing-n:127.0.0.1:36071_solr) [n:127.0.0.1:36071_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 382417 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36071/solr/2nd_collection_shard1_replica_n1/ shard1
[junit4] 2> 382429 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 382431 INFO (qtp213812002-1257) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=2nd_collection_shard1_replica_n1&action=CREATE&numShards=2&collection=2nd_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4190
[junit4] 2> 382431 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 382431 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 382450 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@144d3007[2nd_collection_shard2_replica_n2] main]
[junit4] 2> 382451 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 382451 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 382452 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 382453 INFO (searcherExecutor-680-thread-1-processing-n:127.0.0.1:46208_solr x:2nd_collection_shard2_replica_n2 s:shard2 c:2nd_collection r:core_node4) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.SolrCore [2nd_collection_shard2_replica_n2] Registered new searcher Searcher@144d3007[2nd_collection_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 382453 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584177966802272256
[junit4] 2> 382490 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 382490 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 382490 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46208/solr/2nd_collection_shard2_replica_n2/
[junit4] 2> 382490 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 382490 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.SyncStrategy http://127.0.0.1:46208/solr/2nd_collection_shard2_replica_n2/ has no replicas
[junit4] 2> 382490 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 382525 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46208/solr/2nd_collection_shard2_replica_n2/ shard2
[junit4] 2> 382635 INFO (zkCallback-185-thread-2-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 382635 INFO (zkCallback-185-thread-1-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 382635 INFO (zkCallback-184-thread-2-processing-n:127.0.0.1:36071_solr) [n:127.0.0.1:36071_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 382635 INFO (zkCallback-184-thread-1-processing-n:127.0.0.1:36071_solr) [n:127.0.0.1:36071_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 382685 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 382687 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=2nd_collection_shard2_replica_n2&action=CREATE&numShards=2&collection=2nd_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4426
[junit4] 2> 382707 INFO (qtp2116350560-1282) [n:127.0.0.1:34219_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 382796 INFO (zkCallback-185-thread-2-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 382796 INFO (zkCallback-185-thread-1-processing-n:127.0.0.1:46208_solr) [n:127.0.0.1:46208_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 382796 INFO (zkCallback-184-thread-2-processing-n:127.0.0.1:36071_solr) [n:127.0.0.1:36071_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 382796 INFO (zkCallback-184-thread-1-processing-n:127.0.0.1:36071_solr) [n:127.0.0.1:36071_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/2nd_collection/state.json] for collection [2nd_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 383511 INFO (OverseerCollectionConfigSetProcessor-99011121431511049-127.0.0.1:34219_solr-n_0000000000) [n:127.0.0.1:34219_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 383710 INFO (qtp2116350560-1282) [n:127.0.0.1:34219_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=2nd_collection&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=6290
[junit4] 2> 383710 INFO (TEST-CloudSolrClientTest.testAliasHandling-seed#[61F79A1E73223DE]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: 2nd_collection failOnTimeout:true timeout (sec):30
[junit4] 2> 383710 INFO (TEST-CloudSolrClientTest.testAliasHandling-seed#[61F79A1E73223DE]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: 2nd_collection
[junit4] 2> 383726 INFO (qtp1389436075-1272) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 383727 INFO (qtp1389436075-1272) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 383727 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 383728 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 383729 INFO (qtp1389436075-1270) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :listaliases with params action=LISTALIASES&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 383729 INFO (qtp1389436075-1270) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LISTALIASES&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 383746 INFO (qtp1389436075-1270) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 383747 INFO (qtp1389436075-1270) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 383968 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1584177968197926912)]} 0 184
[junit4] 2> 383969 INFO (qtp1389436075-1272) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 383982 INFO (qtp1389436075-1272) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2} status=0 QTime=13
[junit4] 2> 383983 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 383983 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 383984 INFO (qtp1389436075-1266) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 383984 INFO (qtp1389436075-1266) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 383985 INFO (qtp1389436075-1270) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 384038 INFO (qtp1389436075-1270) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2} status=0 QTime=53
[junit4] 2> 384039 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 384040 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=collection1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 384112 INFO (qtp2116350560-1283) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1584177968541859840,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 384112 INFO (qtp1389436075-1272) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1584177968541859840,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 384113 INFO (qtp2116350560-1283) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 384113 INFO (qtp2116350560-1283) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 384113 INFO (qtp1389436075-1272) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@35031fc9 commitCommandVersion:1584177968541859840
[junit4] 2> 384114 INFO (qtp2116350560-1283) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:34219/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 2
[junit4] 2> 384789 INFO (qtp1389436075-1272) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@70cea71d[collection1_shard1_replica_n1] main]
[junit4] 2> 384807 INFO (searcherExecutor-671-thread-1-processing-n:127.0.0.1:46208_solr x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@70cea71d[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):c1)))}
[junit4] 2> 384808 INFO (qtp1389436075-1272) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 384808 INFO (qtp1389436075-1272) [n:127.0.0.1:46208_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:34219/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 695
[junit4] 2> 384825 INFO (qtp2116350560-1279) [n:127.0.0.1:34219_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 741
[junit4] 2> 384826 INFO (qtp2116350560-1285) [n:127.0.0.1:34219_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createalias with params collections=collection1&name=testalias&action=CREATEALIAS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 385027 INFO (qtp2116350560-1285) [n:127.0.0.1:34219_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collections=collection1&name=testalias&action=CREATEALIAS&wt=javabin&version=2} status=0 QTime=201
[junit4] 2> 385028 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 385029 INFO (qtp1389436075-1268) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 385029 INFO (qtp1389436075-1266) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 385043 INFO (qtp1389436075-1266) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2} status=0 QTime=13
[junit4] 2> 385044 INFO (qtp1389436075-1266) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 385045 INFO (qtp1389436075-1266) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 385081 INFO (qtp1389436075-1269) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [2nd_collection_shard2_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2 (1584177969521229824)]} 0 35
[junit4] 2> 385301 INFO (qtp1389436075-1270) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 385315 INFO (qtp1389436075-1270) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2} status=0 QTime=13
[junit4] 2> 385318 INFO (qtp1389436075-1270) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 385337 INFO (qtp1389436075-1270) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2} status=0 QTime=19
[junit4] 2> 385350 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 385351 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2} status=0 QTime=13
[junit4] 2> 385353 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 385354 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 385354 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 385372 INFO (qtp1389436075-1271) [n:127.0.0.1:46208_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=2nd_collection&wt=javabin&version=2} status=0 QTime=17
[junit4] 2> 385447 INFO (qtp213812002-1260) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1584177969940660224,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 385447 INFO (qtp1389436075-1265) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1584177969940660224,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 385447 INFO (qtp213812002-1260) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 385447 INFO (qtp1389436075-1265) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@691efd4b commitCommandVersion:1584177969940660224
[junit4] 2> 385448 INFO (qtp213812002-1260) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 385448 INFO (qtp213812002-1260) [n:127.0.0.1:36071_solr c:2nd_collection s:shard1 r:core_node3 x:2nd_collection_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [2nd_collection_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46208/solr/2nd_collection_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 1
[junit4] 2> 385718 INFO (qtp1389436075-1265) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@222ee25d[2nd_collection_shard2_replica_n2] main]
[junit4] 2> 385720 INFO (searcherExecutor-680-thread-1-processing-n:127.0.0.1:46208_solr x:2nd_collection_shard2_replica_n2 s:shard2 c:2nd_collection r:core_node4) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.c.SolrCore [2nd_collection_shard2_replica_n2] Registered new searcher Searcher@222ee25d[2nd_collection_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):c1)))}
[junit4] 2> 385720 INFO (qtp1389436075-1265) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 385720 INFO (qtp1389436075-1265) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [2nd_collection_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46208/solr/2nd_collection_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 273
[junit4] 2> 385770 INFO (qtp1389436075-1272) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [2nd_collection_shard2_replica_n2] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0
[...truncated too long message...]
s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6c0b72d: rootName = solr_46208, domain = solr.core.multicollection2.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.multicollection2.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@cefe7dd
[junit4] 2> 476726 INFO (coreCloseExecutor-797-thread-4) [n:127.0.0.1:36071_solr c:localShardsTestColl s:shard1 r:core_node9 x:localShardsTestColl_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.localShardsTestColl.shard1.leader, tag=197024103
[junit4] 2> 476726 INFO (coreCloseExecutor-797-thread-5) [n:127.0.0.1:36071_solr c:localShardsTestColl s:shard3 r:core_node18 x:localShardsTestColl_shard3_replica_n16] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.localShardsTestColl.shard3.replica_n16, tag=628519673
[junit4] 2> 476726 INFO (coreCloseExecutor-797-thread-5) [n:127.0.0.1:36071_solr c:localShardsTestColl s:shard3 r:core_node18 x:localShardsTestColl_shard3_replica_n16] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@21f11008: rootName = solr_36071, domain = solr.core.localShardsTestColl.shard3.replica_n16, service url = null, agent id = null] for registry solr.core.localShardsTestColl.shard3.replica_n16 / com.codahale.metrics.MetricRegistry@d6c81d0
[junit4] 2> 476768 INFO (coreCloseExecutor-796-thread-4) [n:127.0.0.1:46208_solr c:multicollection2 s:shard1 r:core_node3 x:multicollection2_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.multicollection2.shard1.leader, tag=1818985640
[junit4] 2> 476783 INFO (coreCloseExecutor-796-thread-3) [n:127.0.0.1:46208_solr c:foo s:shard1 r:core_node5 x:foo_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.foo.shard1.replica_n2, tag=2112960944
[junit4] 2> 476783 INFO (coreCloseExecutor-796-thread-3) [n:127.0.0.1:46208_solr c:foo s:shard1 r:core_node5 x:foo_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5ff5fa94: rootName = solr_46208, domain = solr.core.foo.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.foo.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@8a10ddc
[junit4] 2> 476835 INFO (coreCloseExecutor-797-thread-5) [n:127.0.0.1:36071_solr c:localShardsTestColl s:shard3 r:core_node18 x:localShardsTestColl_shard3_replica_n16] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.localShardsTestColl.shard3.leader, tag=628519673
[junit4] 2> 476841 INFO (coreCloseExecutor-797-thread-6) [n:127.0.0.1:36071_solr c:localShardsTestColl s:shard2 r:core_node12 x:localShardsTestColl_shard2_replica_n7] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.localShardsTestColl.shard2.replica_n7, tag=1823664364
[junit4] 2> 476841 INFO (coreCloseExecutor-797-thread-6) [n:127.0.0.1:36071_solr c:localShardsTestColl s:shard2 r:core_node12 x:localShardsTestColl_shard2_replica_n7] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4be05ae4: rootName = solr_36071, domain = solr.core.localShardsTestColl.shard2.replica_n7, service url = null, agent id = null] for registry solr.core.localShardsTestColl.shard2.replica_n7 / com.codahale.metrics.MetricRegistry@418f0365
[junit4] 2> 477003 INFO (coreCloseExecutor-797-thread-6) [n:127.0.0.1:36071_solr c:localShardsTestColl s:shard2 r:core_node12 x:localShardsTestColl_shard2_replica_n7] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.localShardsTestColl.shard2.leader, tag=1823664364
[junit4] 2> 477023 INFO (coreCloseExecutor-796-thread-2) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.2nd_collection.shard2.replica_n2, tag=1084750306
[junit4] 2> 477023 INFO (coreCloseExecutor-796-thread-2) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3612fd8: rootName = solr_46208, domain = solr.core.2nd_collection.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.2nd_collection.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@23f657ad
[junit4] 2> 477041 INFO (coreCloseExecutor-796-thread-3) [n:127.0.0.1:46208_solr c:foo s:shard1 r:core_node5 x:foo_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.foo.shard1.leader, tag=2112960944
[junit4] 2> 477041 INFO (coreCloseExecutor-796-thread-2) [n:127.0.0.1:46208_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.2nd_collection.shard2.leader, tag=1084750306
[junit4] 2> 477202 INFO (jetty-closer-170-thread-2) [ ] o.a.s.c.Overseer Overseer (id=99011121431511049-127.0.0.1:34219_solr-n_0000000000) closing
[junit4] 2> 477203 INFO (OverseerStateUpdate-99011121431511049-127.0.0.1:34219_solr-n_0000000000) [n:127.0.0.1:34219_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34219_solr
[junit4] 2> 477316 WARN (OverseerAutoScalingTriggerThread-99011121431511049-127.0.0.1:34219_solr-n_0000000000) [n:127.0.0.1:34219_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 477703 INFO (jetty-closer-170-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7a4fb81{/solr,null,UNAVAILABLE}
[junit4] 2> 477706 INFO (jetty-closer-170-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@48ed31f6{/solr,null,UNAVAILABLE}
[junit4] 2> 478997 INFO (jetty-closer-170-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@31b16d60{/solr,null,UNAVAILABLE}
[junit4] 2> 479053 ERROR (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 479053 INFO (SUITE-CloudSolrClientTest-seed#[61F79A1E73223DE]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39491 39491
[junit4] 2> 479361 INFO (Thread-278) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39491 39491
[junit4] 2> 479363 WARN (Thread-278) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 9 /solr/aliases.json
[junit4] 2> 3 /solr/security.json
[junit4] 2> 3 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 36 /solr/collections/localShardsTestColl/state.json
[junit4] 2> 27 /solr/collections/foo/state.json
[junit4] 2> 17 /solr/collections/multicollection1/state.json
[junit4] 2> 16 /solr/collections/stale_state_test_col/state.json
[junit4] 2> 16 /solr/collections/collection1/state.json
[junit4] 2> 16 /solr/collections/multicollection2/state.json
[junit4] 2> 14 /solr/collections/2nd_collection/state.json
[junit4] 2> 12 /solr/collections/nemesis/state.json
[junit4] 2> 9 /solr/clusterstate.json
[junit4] 2> 6 /solr/collections/overwrite/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/live_nodes
[junit4] 2> 9 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.impl.CloudSolrClientTest_61F79A1E73223DE-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {multiDefault=PostingsFormat(name=Memory), a_t=PostingsFormat(name=Direct), title_s=PostingsFormat(name=Memory), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), text=BlockTreeOrds(blocksize=128)}, docValues:{_version_=DocValuesFormat(name=Memory), multiDefault=DocValuesFormat(name=Direct), title_s=DocValuesFormat(name=Direct), intDefault=DocValuesFormat(name=Memory), id=DocValuesFormat(name=Lucene70), timestamp=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=432, maxMBSortInHeap=6.792092636240911, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@76d87bd0), locale=es-CL, timezone=America/Martinique
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=267644128,total=482869248
[junit4] 2> NOTE: All tests run in this JVM: [SineEvaluatorTest, TestCollectionStateWatchers, RegressionEvaluatorTest, ArcCosineEvaluatorTest, StreamExpressionToExplanationTest, LessThanEqualToEvaluatorTest, DocumentAnalysisResponseTest, CoalesceEvaluatorTest, HyperbolicSineEvaluatorTest, ExclusiveOrEvaluatorTest, UuidEvaluatorTest, CosineEvaluatorTest, TestSuggesterResponse, NormalizeEvaluatorTest, GreaterThanEqualToEvaluatorTest, TestBatchUpdate, DivideEvaluatorTest, TestValidatingJsonMap, NamedListTest, ModifiableSolrParamsTest, AddEvaluatorTest, TestCollectionAdminRequest, TangentEvaluatorTest, SolrParamTest, SolrExampleStreamingTest, SolrExampleBinaryTest, SolrExampleJettyTest, JettyWebappTest, LargeVolumeJettyTest, TestCoreAdmin, TestLBHttpSolrClient, TestPolicy, CloudSolrClientBuilderTest, CloudSolrClientTest]
[junit4] Completed [99/146 (1!)] on J2 in 120.45s, 16 tests, 1 error <<< FAILURES!
[...truncated 46423 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2175 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2175/
9 tests failed.
FAILED: org.apache.lucene.search.similarities.TestBasicModelIn.testRandomScoring
Error Message:
score(1.0,64)=3.71548595E9 < score(1.0,65)=3.71548621E9
Stack Trace:
java.lang.AssertionError: score(1.0,64)=3.71548595E9 < score(1.0,65)=3.71548621E9
at __randomizedtesting.SeedInfo.seed([202899A39BA9FDD9:ABB7C01181DE1BD3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.search.similarities.BaseSimilarityTestCase.doTestScoring(BaseSimilarityTestCase.java:423)
at org.apache.lucene.search.similarities.BaseSimilarityTestCase.testRandomScoring(BaseSimilarityTestCase.java:355)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
Error Message:
*:* found unexpected number of documents expected:<32> but was:<30>
Stack Trace:
java.lang.AssertionError: *:* found unexpected number of documents expected:<32> but was:<30>
at __randomizedtesting.SeedInfo.seed([19B341F0295B3818:AD0739F183481BE]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection(SolrCloudExampleTest.java:159)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestCloudPivotFacet.test
Error Message:
Could not load collection from ZK: collection1
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([19B341F0295B3818:91E77E2A87A755E0]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.getTotalReplicas(AbstractFullDistribZkTestBase.java:487)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:440)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:333)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 38 more
FAILED: org.apache.solr.cloud.TestLocalFSCloudBackupRestore.test
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([19B341F0295B3818:91E77E2A87A755E0]:0)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.getShardToDocCountMap(AbstractCloudBackupRestoreTestCase.java:338)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:224)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:140)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration
Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:58297_solr wasn't created
Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:58297_solr wasn't created
at __randomizedtesting.SeedInfo.seed([19B341F0295B3818:109C9FC276EF5F7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:919)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest.test
Error Message:
Stack Trace:
java.util.concurrent.TimeoutException
at __randomizedtesting.SeedInfo.seed([19B341F0295B3818:91E77E2A87A755E0]:0)
at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:448)
at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:122)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.TestSQLHandler.doTest
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([19B341F0295B3818:BEF7F95444E02BA1]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.handler.TestSQLHandler.assertResponseContains(TestSQLHandler.java:2567)
at org.apache.solr.handler.TestSQLHandler.testBasicSelect(TestSQLHandler.java:170)
at org.apache.solr.handler.TestSQLHandler.doTest(TestSQLHandler.java:82)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.security.TestPKIAuthenticationPlugin.test
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([19B341F0295B3818:91E77E2A87A755E0]:0)
at org.apache.solr.security.TestPKIAuthenticationPlugin.test(TestPKIAuthenticationPlugin.java:102)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.testReadApi
Error Message:
expected:<1> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
at __randomizedtesting.SeedInfo.seed([19B341F0295B3818:4E9ABA45F2A9DA03]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.testReadApi(AutoScalingHandlerTest.java:709)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 1707 lines...]
[junit4] Suite: org.apache.lucene.search.similarities.TestBasicModelIn
[junit4] 1> 3.71548595E9 = score(DFRSimilarity, doc=0, freq=1.0), computed from:
[junit4] 1> 7.4309722E8 = boost
[junit4] 1> 2.38839373E16 = NormalizationH1, computed from:
[junit4] 1> 1.0 = tf
[junit4] 1> 1.69051738E9 = avgFieldLength
[junit4] 1> 152.0 = len
[junit4] 1> 1.19419684E17 = BasicModelIn, computed from:
[junit4] 1> 47.0 = numberOfDocuments
[junit4] 1> 1.0 = docFreq
[junit4] 1> 4.1869143E-17 = AfterEffectL, computed from:
[junit4] 1> 2.38839373E16 = tfn
[junit4] 1>
[junit4] 1> 3.71548621E9 = score(DFRSimilarity, doc=0, freq=1.0), computed from:
[junit4] 1> 7.4309722E8 = boost
[junit4] 1> 2.16092775E16 = NormalizationH1, computed from:
[junit4] 1> 1.0 = tf
[junit4] 1> 1.69051738E9 = avgFieldLength
[junit4] 1> 168.0 = len
[junit4] 1> 1.08046388E17 = BasicModelIn, computed from:
[junit4] 1> 47.0 = numberOfDocuments
[junit4] 1> 1.0 = docFreq
[junit4] 1> 4.627642E-17 = AfterEffectL, computed from:
[junit4] 1> 2.16092775E16 = tfn
[junit4] 1>
[junit4] 1> DFR I(n)L1
[junit4] 1> field="field",maxDoc=103,docCount=47,sumTotalTermFreq=79454319043,sumDocFreq=79454319043
[junit4] 1> term="term",docFreq=1,totalTermFreq=1
[junit4] 1> norm=65 (doc length ~ 168)
[junit4] 1> freq=1.0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestBasicModelIn -Dtests.method=testRandomScoring -Dtests.seed=202899A39BA9FDD9 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=fi-FI -Dtests.timezone=Etc/GMT+9 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 46.2s J0 | TestBasicModelIn.testRandomScoring <<<
[junit4] > Throwable #1: java.lang.AssertionError: score(1.0,64)=3.71548595E9 < score(1.0,65)=3.71548621E9
[junit4] > at __randomizedtesting.SeedInfo.seed([202899A39BA9FDD9:ABB7C01181DE1BD3]:0)
[junit4] > at org.apache.lucene.search.similarities.BaseSimilarityTestCase.doTestScoring(BaseSimilarityTestCase.java:423)
[junit4] > at org.apache.lucene.search.similarities.BaseSimilarityTestCase.testRandomScoring(BaseSimilarityTestCase.java:355)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@26a8824c), locale=fi-FI, timezone=Etc/GMT+9
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=121054888,total=300417024
[junit4] 2> NOTE: All tests run in this JVM: [TestSpanTermQuery, TestIntBlockPool, TestTermQuery, TestDocsAndPositions, TestIndexableField, TestBoolean2, TestSimpleExplanations, TestIndexWriterExceptions, TestEarlyTermination, TestNot, TestBytesStore, TestSimpleSearchEquivalence, TestTerms, TestUnicodeUtil, TestBasicModelIne, TestGeoUtils, TestNGramPhraseQuery, TestStandardAnalyzer, TestIndexWriter, TestDocValuesIndexing, TestSpanMultiTermQueryWrapper, TestCharFilter, TestMultiPhraseQuery, TestSearch, TestDoubleRangeFieldQueries, TestClassicSimilarity, TestAutomatonQuery, TestBasicModelG, TestSimpleAttributeImpl, TestMultiCollector, TestDocIDMerger, TestIndexWriterOnVMError, TestLongValuesSource, TestLMDirichletSimilarity, TestTermVectorsWriter, TestSegmentMerger, TestOrdinalMap, TestStringHelper, TestTotalHitCountCollector, TestPagedBytes, TestCachingCollector, TestConstantScoreQuery, TestSimilarity, TestNRTReaderCleanup, TestSortedSetSelector, TestLucene50CompoundFormat, TestFilterDirectory, TestIndependenceChiSquared, TestMutablePointsReaderUtils, TestDocCount, TestFilterCodecReader, TestFuzzyQuery, TestReaderWrapperDVTypeCheck, TestNeedsScores, TestAutomaton, TestSmallFloat, TestNumericUtils, TestStressIndexing, TestBinaryDocValuesUpdates, TestLiveFieldValues, TestTimSorterWorstCase, TestDeterminizeLexicon, TestTopFieldCollector, TestIndexWriterWithThreads, TestIndexingSequenceNumbers, TestIntRangeFieldQueries, TestAllFilesCheckIndexHeader, TestDocsWithFieldSet, TestRadixSelector, TestNewestSegment, TestCharsRefBuilder, TestSpanBoostQuery, TestDelegatingAnalyzerWrapper, TestBooleanQueryVisitSubscorers, TestTermsEnum, TestApproximationSearchEquivalence, TestDirectoryReaderReopen, TestIndexWriterConfig, TestSegmentInfos, TestStressDeletes, TestSwappedIndexFiles, TestUpgradeIndexMergePolicy, FuzzyTermOnShortTermsTest, TestBooleanRewrites, TestBoostQuery, TestConjunctionDISI, TestDocValuesQueries, TestFieldValueQuery, TestIndexSearcher, TestMatchNoDocsQuery, TestMultiset, TestPointQueries, TestSortedNumericSortField, TestSortedSetSortField, TestUsageTrackingFilterCachingPolicy, TestAxiomaticF1LOG, TestAxiomaticF2EXP, TestBasicModelIn]
[junit4] Completed [439/476 (1!)] on J0 in 46.30s, 1 test, 1 failure <<< FAILURES!
[...truncated 10435 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest
[junit4] 2> 2499932 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_19B341F0295B3818-001/init-core-data-001
[junit4] 2> 2499954 WARN (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 2499954 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 2499955 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 2499956 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_19B341F0295B3818-001/tempDir-001
[junit4] 2> 2499956 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2500099 INFO (Thread-812) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2500099 INFO (Thread-812) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2500201 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:58064
[junit4] 2> 2500470 ERROR (Thread-812) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2500747 INFO (jetty-launcher-546-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2500774 INFO (jetty-launcher-546-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2500816 INFO (jetty-launcher-546-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a8df8a2{/solr,null,AVAILABLE}
[junit4] 2> 2500816 INFO (jetty-launcher-546-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@143482eb{/solr,null,AVAILABLE}
[junit4] 2> 2500914 INFO (jetty-launcher-546-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@ad122bb{SSL,[ssl, http/1.1]}{127.0.0.1:48067}
[junit4] 2> 2500914 INFO (jetty-launcher-546-thread-1) [ ] o.e.j.s.Server Started @2516197ms
[junit4] 2> 2500914 INFO (jetty-launcher-546-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=48067}
[junit4] 2> 2500914 ERROR (jetty-launcher-546-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2500914 INFO (jetty-launcher-546-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 2500914 INFO (jetty-launcher-546-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2500914 INFO (jetty-launcher-546-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2500914 INFO (jetty-launcher-546-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-15T00:52:37.847Z
[junit4] 2> 2500934 INFO (jetty-launcher-546-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@70541022{SSL,[ssl, http/1.1]}{127.0.0.1:48583}
[junit4] 2> 2500934 INFO (jetty-launcher-546-thread-2) [ ] o.e.j.s.Server Started @2516217ms
[junit4] 2> 2500934 INFO (jetty-launcher-546-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=48583}
[junit4] 2> 2500934 ERROR (jetty-launcher-546-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2500934 INFO (jetty-launcher-546-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 2500934 INFO (jetty-launcher-546-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2500934 INFO (jetty-launcher-546-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2500934 INFO (jetty-launcher-546-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-15T00:52:37.867Z
[junit4] 2> 2500946 INFO (jetty-launcher-546-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2501045 INFO (jetty-launcher-546-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2501115 INFO (jetty-launcher-546-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58064/solr
[junit4] 2> 2501146 INFO (jetty-launcher-546-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58064/solr
[junit4] 2> 2501683 INFO (jetty-launcher-546-thread-1) [n:127.0.0.1:48067_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2501684 INFO (jetty-launcher-546-thread-1) [n:127.0.0.1:48067_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48067_solr
[junit4] 2> 2501684 INFO (jetty-launcher-546-thread-1) [n:127.0.0.1:48067_solr ] o.a.s.c.Overseer Overseer (id=99005704243642374-127.0.0.1:48067_solr-n_0000000000) starting
[junit4] 2> 2501826 INFO (jetty-launcher-546-thread-1) [n:127.0.0.1:48067_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48067_solr
[junit4] 2> 2501905 INFO (zkCallback-558-thread-1-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2502146 INFO (jetty-launcher-546-thread-2) [n:127.0.0.1:48583_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2502148 INFO (jetty-launcher-546-thread-2) [n:127.0.0.1:48583_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2502149 INFO (jetty-launcher-546-thread-2) [n:127.0.0.1:48583_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48583_solr
[junit4] 2> 2502150 INFO (zkCallback-558-thread-1-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2502265 INFO (zkCallback-557-thread-1-processing-n:127.0.0.1:48583_solr) [n:127.0.0.1:48583_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2503182 INFO (jetty-launcher-546-thread-1) [n:127.0.0.1:48067_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48067.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@494e878c
[junit4] 2> 2503193 INFO (jetty-launcher-546-thread-2) [n:127.0.0.1:48583_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48583.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@494e878c
[junit4] 2> 2503280 INFO (jetty-launcher-546-thread-2) [n:127.0.0.1:48583_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48583.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@494e878c
[junit4] 2> 2503280 INFO (jetty-launcher-546-thread-2) [n:127.0.0.1:48583_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48583.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@494e878c
[junit4] 2> 2503302 INFO (jetty-launcher-546-thread-1) [n:127.0.0.1:48067_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48067.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@494e878c
[junit4] 2> 2503302 INFO (jetty-launcher-546-thread-1) [n:127.0.0.1:48067_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48067.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@494e878c
[junit4] 2> 2503313 INFO (jetty-launcher-546-thread-1) [n:127.0.0.1:48067_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_19B341F0295B3818-001/tempDir-001/node1/.
[junit4] 2> 2503333 INFO (jetty-launcher-546-thread-2) [n:127.0.0.1:48583_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_19B341F0295B3818-001/tempDir-001/node2/.
[junit4] 2> 2503932 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2503933 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58064/solr ready
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 2504997 WARN (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 2505234 WARN (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 2505244 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 2505403 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_42160_hdfs____.e6vop/webapp
[junit4] 2> 2507987 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42160
[junit4] 2> 2509230 WARN (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 2509231 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 2509335 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_46078_datanode____771nsm/webapp
[junit4] 2> 2510954 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46078
[junit4] 2> 2511793 WARN (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 2511794 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 2511867 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_46268_datanode____.5lydt3/webapp
[junit4] 2> 2512783 ERROR (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_19B341F0295B3818-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_19B341F0295B3818-001/tempDir-002/hdfsBaseDir/data/data2/]] heartbeating to localhost/127.0.0.1:54899) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 2512937 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x26ef3cddb5543d: from storage DS-a03a8a59-71f2-4d74-8a3b-7ef354b5b8ee node DatanodeRegistration(127.0.0.1:44657, datanodeUuid=291a6415-89bb-446f-829c-6959e759de26, infoPort=40750, infoSecurePort=0, ipcPort=35537, storageInfo=lv=-56;cid=testClusterID;nsid=934528364;c=0), blocks: 0, hasStaleStorage: true, processing time: 18 msecs
[junit4] 2> 2512938 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x26ef3cddb5543d: from storage DS-aa56a446-a3e0-4f8c-85dc-59ca0f68b875 node DatanodeRegistration(127.0.0.1:44657, datanodeUuid=291a6415-89bb-446f-829c-6959e759de26, infoPort=40750, infoSecurePort=0, ipcPort=35537, storageInfo=lv=-56;cid=testClusterID;nsid=934528364;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 2515203 INFO (SUITE-HdfsRecoveryZkTest-seed#[19B341F0295B3818]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46268
[junit4] 2> 2516538 ERROR (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_19B341F0295B3818-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_19B341F0295B3818-001/tempDir-002/hdfsBaseDir/data/data4/]] heartbeating to localhost/127.0.0.1:54899) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 2516906 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x26ef3dcba22c05: from storage DS-727bb8f5-06d7-4490-b5a4-6ff67ed23594 node DatanodeRegistration(127.0.0.1:55761, datanodeUuid=6ca88725-ee9e-4892-bee0-5dc41204f04b, infoPort=37532, infoSecurePort=0, ipcPort=58592, storageInfo=lv=-56;cid=testClusterID;nsid=934528364;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 2516906 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x26ef3dcba22c05: from storage DS-367b05e1-6755-438d-9e9b-6d6b7ffadf69 node DatanodeRegistration(127.0.0.1:55761, datanodeUuid=6ca88725-ee9e-4892-bee0-5dc41204f04b, infoPort=37532, infoSecurePort=0, ipcPort=58592, storageInfo=lv=-56;cid=testClusterID;nsid=934528364;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 2519205 INFO (TEST-HdfsRecoveryZkTest.test-seed#[19B341F0295B3818]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 2519732 INFO (qtp1637142555-3852) [n:127.0.0.1:48067_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&name=recoverytest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2519739 INFO (OverseerThreadFactory-1602-thread-1-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.CreateCollectionCmd Create collection recoverytest
[junit4] 2> 2519898 INFO (OverseerStateUpdate-99005704243642374-127.0.0.1:48067_solr-n_0000000000) [n:127.0.0.1:48067_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"recoverytest",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"recoverytest_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:48067/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2519918 INFO (OverseerStateUpdate-99005704243642374-127.0.0.1:48067_solr-n_0000000000) [n:127.0.0.1:48067_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"recoverytest",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"recoverytest_shard1_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:48583/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2520507 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=recoverytest_shard1_replica_n1&action=CREATE&numShards=1&collection=recoverytest&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2520507 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2520684 INFO (zkCallback-558-thread-1-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2520702 INFO (zkCallback-558-thread-2-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2522319 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2522699 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.s.IndexSchema [recoverytest_shard1_replica_n1] Schema name=minimal
[junit4] 2> 2522734 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2522744 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'recoverytest_shard1_replica_n1' using configuration from collection recoverytest, trusted=true
[junit4] 2> 2522744 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48067.solr.core.recoverytest.shard1.replica_n1' (registry 'solr.core.recoverytest.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@494e878c
[junit4] 2> 2522932 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=recoverytest_shard1_replica_n3&action=CREATE&numShards=1&collection=recoverytest&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2522932 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2522994 INFO (zkCallback-557-thread-1-processing-n:127.0.0.1:48583_solr) [n:127.0.0.1:48583_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2522994 INFO (zkCallback-558-thread-3-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2522995 INFO (zkCallback-558-thread-2-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2522995 INFO (zkCallback-557-thread-2-processing-n:127.0.0.1:48583_solr) [n:127.0.0.1:48583_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2523270 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:54899/data
[junit4] 2> 2523270 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 2523270 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2523270 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.SolrCore [[recoverytest_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_19B341F0295B3818-001/tempDir-001/node1/recoverytest_shard1_replica_n1], dataDir=[hdfs://localhost:54899/data/recoverytest/core_node2/data/]
[junit4] 2> 2523331 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:54899/data/recoverytest/core_node2/data/snapshot_metadata
[junit4] 2> 2523694 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 2523694 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 2523694 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
[junit4] 2> 2524253 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2524377 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.s.IndexSchema [recoverytest_shard1_replica_n3] Schema name=minimal
[junit4] 2> 2524427 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2524427 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'recoverytest_shard1_replica_n3' using configuration from collection recoverytest, trusted=true
[junit4] 2> 2524427 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48583.solr.core.recoverytest.shard1.replica_n3' (registry 'solr.core.recoverytest.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@494e878c
[junit4] 2> 2524427 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:54899/data
[junit4] 2> 2524430 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 2524430 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2524430 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.SolrCore [[recoverytest_shard1_replica_n3] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_19B341F0295B3818-001/tempDir-001/node2/recoverytest_shard1_replica_n3], dataDir=[hdfs://localhost:54899/data/recoverytest/core_node4/data/]
[junit4] 2> 2524431 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:54899/data/recoverytest/core_node4/data/snapshot_metadata
[junit4] 2> 2524876 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 2524877 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 2531244 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 2531245 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 2531273 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:54899/data/recoverytest/core_node2/data
[junit4] 2> 2531290 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:54899/data/recoverytest/core_node4/data
[junit4] 2> 2531617 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:54899/data/recoverytest/core_node4/data/index
[junit4] 2> 2531846 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:54899/data/recoverytest/core_node2/data/index
[junit4] 2> 2531850 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 2531850 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 2531858 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 2531858 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 2531903 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 2531922 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 2532964 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44657 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-367b05e1-6755-438d-9e9b-6d6b7ffadf69:NORMAL:127.0.0.1:55761|RBW], ReplicaUC[[DISK]DS-a03a8a59-71f2-4d74-8a3b-7ef354b5b8ee:NORMAL:127.0.0.1:44657|RBW]]} size 0
[junit4] 2> 2532968 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55761 is added to blk_1073741825_1001 size 69
[junit4] 2> 2533111 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44657 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-727bb8f5-06d7-4490-b5a4-6ff67ed23594:NORMAL:127.0.0.1:55761|RBW], ReplicaUC[[DISK]DS-aa56a446-a3e0-4f8c-85dc-59ca0f68b875:NORMAL:127.0.0.1:44657|RBW]]} size 0
[junit4] 2> 2533111 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55761 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-727bb8f5-06d7-4490-b5a4-6ff67ed23594:NORMAL:127.0.0.1:55761|RBW], ReplicaUC[[DISK]DS-aa56a446-a3e0-4f8c-85dc-59ca0f68b875:NORMAL:127.0.0.1:44657|RBW]]} size 0
[junit4] 2> 2534537 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 2534537 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2534537 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 2534546 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 2534546 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2534546 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 2534868 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2534868 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2534871 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2534871 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2537276 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7634c46b[recoverytest_shard1_replica_n1] main]
[junit4] 2> 2537278 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2537279 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2537286 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2537288 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584091306887479296
[junit4] 2> 2537290 INFO (searcherExecutor-1607-thread-1-processing-n:127.0.0.1:48067_solr x:recoverytest_shard1_replica_n1 s:shard1 c:recoverytest r:core_node2) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.SolrCore [recoverytest_shard1_replica_n1] Registered new searcher Searcher@7634c46b[recoverytest_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2537295 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 2537299 INFO (zkCallback-558-thread-2-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2537299 INFO (zkCallback-558-thread-3-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2537366 INFO (zkCallback-557-thread-2-processing-n:127.0.0.1:48583_solr) [n:127.0.0.1:48583_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2537366 INFO (zkCallback-557-thread-1-processing-n:127.0.0.1:48583_solr) [n:127.0.0.1:48583_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2537368 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@212d3324[recoverytest_shard1_replica_n3] main]
[junit4] 2> 2537374 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2537377 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2537378 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2537386 INFO (searcherExecutor-1608-thread-1-processing-n:127.0.0.1:48583_solr x:recoverytest_shard1_replica_n3 s:shard1 c:recoverytest r:core_node4) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.SolrCore [recoverytest_shard1_replica_n3] Registered new searcher Searcher@212d3324[recoverytest_shard1_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2537386 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584091306990239744
[junit4] 2> 2537845 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2537846 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2537846 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:48067/solr/recoverytest_shard1_replica_n1/
[junit4] 2> 2537846 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=recoverytest_shard1_replica_n1 url=https://127.0.0.1:48067/solr START replicas=[https://127.0.0.1:48583/solr/recoverytest_shard1_replica_n3/] nUpdates=100
[junit4] 2> 2538625 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=recoverytest_shard1_replica_n1 url=https://127.0.0.1:48067/solr DONE. We have no versions. sync failed.
[junit4] 2> 2539002 INFO (qtp260365154-3840) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.c.S.Request [recoverytest_shard1_replica_n3] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2539011 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2539011 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2539011 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2539035 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:48067/solr/recoverytest_shard1_replica_n1/ shard1
[junit4] 2> 2539349 INFO (zkCallback-558-thread-2-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2539349 INFO (zkCallback-558-thread-3-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2539354 INFO (zkCallback-557-thread-2-processing-n:127.0.0.1:48583_solr) [n:127.0.0.1:48583_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2539354 INFO (zkCallback-557-thread-1-processing-n:127.0.0.1:48583_solr) [n:127.0.0.1:48583_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2539381 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2539383 INFO (qtp1637142555-3849) [n:127.0.0.1:48067_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=recoverytest_shard1_replica_n1&action=CREATE&numShards=1&collection=recoverytest&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=18876
[junit4] 2> 2539525 INFO (zkCallback-557-thread-2-processing-n:127.0.0.1:48583_solr) [n:127.0.0.1:48583_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2539525 INFO (zkCallback-557-thread-1-processing-n:127.0.0.1:48583_solr) [n:127.0.0.1:48583_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2539627 INFO (qtp260365154-3841) [n:127.0.0.1:48583_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=recoverytest_shard1_replica_n3&action=CREATE&numShards=1&collection=recoverytest&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=16695
[junit4] 2> 2539747 INFO (zkCallback-558-thread-2-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2539747 INFO (zkCallback-558-thread-3-processing-n:127.0.0.1:48067_solr) [n:127.0.0.1:48067_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2539751 INFO (qtp1637142555-3852) [n:127.0.0.1:48067_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for a
[...truncated too long message...]
eper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:357)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:357)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:879)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:749)
[junit4] 2> at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:748)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1154)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1149)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$0(SolrZkClient.java:262)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 9519415 INFO (jetty-closer-2929-thread-7) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2e2f1939{/solr,null,UNAVAILABLE}
[junit4] 2> 9519453 ERROR (SUITE-TriggerIntegrationTest-seed#[19B341F0295B3818]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 9519454 INFO (SUITE-TriggerIntegrationTest-seed#[19B341F0295B3818]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45052 45052
[junit4] 2> 9519773 INFO (Thread-5050) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45052 45052
[junit4] 2> 9519774 WARN (Thread-5050) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 42 /solr/aliases.json
[junit4] 2> 17 /solr/security.json
[junit4] 2> 2 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 42 /solr/clusterprops.json
[junit4] 2> 42 /solr/clusterstate.json
[junit4] 2> 16 /solr/collections/collection1/state.json
[junit4] 2> 5 /solr/autoscaling.json
[junit4] 2> 3 /solr/overseer_elect/election/99006153322528817-127.0.0.1:58275_solr-n_0000000010
[junit4] 2> 3 /solr/overseer_elect/election/99006153322528772-127.0.0.1:49525_solr-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/99006153322528831-127.0.0.1:47789_solr-n_0000000013
[junit4] 2> 2 /solr/overseer_elect/election/99006153322528824-127.0.0.1:36375_solr-n_0000000012
[junit4] 2> 2 /solr/overseer_elect/election/99006153322528806-127.0.0.1:37629_solr-n_0000000007
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 42 /solr/collections
[junit4] 2> 41 /solr/live_nodes
[junit4] 2> 5 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 5 /solr/overseer/queue
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2> 5 /solr/overseer/queue-work
[junit4] 2> 3 /solr/autoscaling/events/node_added_trigger
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_19B341F0295B3818-001
[junit4] 2> Nov 15, 2017 2:49:36 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1892, maxMBSortInHeap=6.280136101553952, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@643e1a0c), locale=fi, timezone=America/Creston
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=139470776,total=510656512
[junit4] 2> NOTE: All tests run in this JVM: [SolrCLIZkUtilsTest, DeleteNodeTest, ConnectionReuseTest, PeerSyncWithIndexFingerprintCachingTest, AnalysisErrorHandlingTest, TestReload, BufferStoreTest, UnloadDistributedZkTest, TestUnifiedSolrHighlighter, EchoParamsTest, TestJsonFacets, HdfsThreadLeakTest, DefaultValueUpdateProcessorTest, RequestLoggingTest, UniqFieldsUpdateProcessorFactoryTest, TestExclusionRuleCollectionAccess, HLLSerializationTest, TestSolrDeletionPolicy2, TestFuzzyAnalyzedSuggestions, TestSQLHandlerNonCloud, RegexBytesRefFilterTest, TestOverriddenPrefixQueryForCustomFieldType, CustomCollectionTest, MergeStrategyTest, TestLegacyFieldReuse, TestValueSourceCache, TestFieldTypeCollectionResource, CopyFieldTest, TestAuthenticationFramework, BadComponentTest, TestMultiValuedNumericRangeQuery, CollectionReloadTest, TestConfigReload, TestSolr4Spatial2, OverseerRolesTest, TestStressInPlaceUpdates, LegacyCloudClusterPropTest, DeleteStatusTest, TestShardHandlerFactory, TestHighFrequencyDictionaryFactory, RequiredFieldsTest, TestIndexSearcher, TestPrepRecovery, XmlUpdateRequestHandlerTest, HdfsRecoveryZkTest, TestLFUCache, TestFieldCacheWithThreads, TestQuerySenderListener, XsltUpdateRequestHandlerTest, TestPartialUpdateDeduplication, DocValuesNotIndexedTest, TestInitParams, TestDistributedMissingSort, CloneFieldUpdateProcessorFactoryTest, TestUseDocValuesAsStored, SystemInfoHandlerTest, MetricsConfigTest, TestExpandComponent, ClusterStateTest, SuggestComponentContextFilterQueryTest, BasicDistributedZk2Test, AnalyticsQueryTest, TestCSVResponseWriter, RuleEngineTest, TestIntervalFaceting, AddSchemaFieldsUpdateProcessorFactoryTest, SuggesterTest, SearchRateTriggerTest, AlternateDirectoryTest, TestCloudSchemaless, CSVRequestHandlerTest, ScriptEngineTest, SortByFunctionTest, SolrGraphiteReporterTest, TestGeoJSONResponseWriter, TestPKIAuthenticationPlugin, TestTolerantSearch, ZkNodePropsTest, TestExtendedDismaxParser, TestBlendedInfixSuggestions, FileBasedSpellCheckerTest, SolrCoreCheckLockOnStartupTest, TestMissingGroups, UUIDUpdateProcessorFallbackTest, ClassificationUpdateProcessorFactoryTest, StatsReloadRaceTest, PluginInfoTest, AliasIntegrationTest, TestManagedResource, DirectSolrSpellCheckerTest, ReplicaListTransformerTest, PeerSyncReplicationTest, LeaderElectionTest, TestSortByMinMaxFunction, TestEmbeddedSolrServerConstructors, TestCloudNestedDocsSort, DistributedExpandComponentTest, WrapperMergePolicyFactoryTest, TestLeaderElectionZkExpiry, TestExceedMaxTermLength, BooleanFieldTest, SimpleMLTQParserTest, TestNumericTokenStream, DateRangeFieldTest, AutoscalingHistoryHandlerTest, AsyncCallRequestStatusResponseTest, DistribJoinFromCollectionTest, HdfsDirectoryFactoryTest, SolrSlf4jReporterTest, BasicAuthStandaloneTest, ReplaceNodeTest, TestBulkSchemaAPI, TestSolrCoreProperties, AutoAddReplicasIntegrationTest, TestZkChroot, TestNonDefinedSimilarityFactory, TestComplexPhraseQParserPlugin, SuggesterWFSTTest, TestRealTimeGet, SpatialRPTFieldTypeTest, TestFunctionQuery, SolrTestCaseJ4Test, RecoveryZkTest, TestRandomFaceting, ZkCLITest, ShardRoutingCustomTest, TestDistributedSearch, TestStressReorder, DistributedTermsComponentTest, TestCoreContainer, SolrCoreTest, TestGroupingSearch, QueryElevationComponentTest, PeerSyncTest, HighlighterTest, ShowFileRequestHandlerTest, TestCoreDiscovery, TestStressLucene, TestTrie, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, TestAtomicUpdateErrorCases, DistanceFunctionTest, DebugComponentTest, IndexBasedSpellCheckerTest, DisMaxRequestHandlerTest, TestWriterPerf, TestIndexingPerformance, FastVectorHighlighterTest, LoggingHandlerTest, SolrPluginUtilsTest, TestJmxIntegration, JsonLoaderTest, SearchHandlerTest, TestElisionMultitermQuery, TestConfig, DirectSolrConnectionTest, TestLuceneMatchVersion, TestCharFilters, TestXIncludeConfig, TimeZoneUtilsTest, TestFastOutputStream, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, TestEmbeddedSolrServerAdminHandler, TestJettySolrRunner, AddReplicaTest, CleanupOldIndexTest, CollectionStateFormat2Test, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, ConfigSetsAPITest, CreateCollectionCleanupTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, DeleteShardTest, HealthCheckHandlerTest, HttpPartitionTest, MoveReplicaTest, MultiThreadedOCPTest, SaslZkACLProviderTest, TestCloudDeleteByQuery, TestCloudPivotFacet, TestCloudPseudoReturnFields, TestCloudRecovery, TestConfigSetsAPI, TestDeleteCollectionOnDownNodes, TestDistribDocBasedVersion, TestDownShardTolerantSearch, TestLocalFSCloudBackupRestore, TestRandomFlRTGCloud, TestSSLRandomization, TestSkipOverseerOperations, TestTolerantUpdateProcessorRandomCloud, VMParamsZkACLAndCredentialsProvidersTest, AutoAddReplicasPlanActionTest, ExecutePlanActionTest, SystemLogListenerTest, TriggerIntegrationTest]
[junit4] Completed [576/749 (8!)] on J2 in 167.91s, 12 tests, 1 failure <<< FAILURES!
[...truncated 47859 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2174 - Still unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2174/
2 tests failed.
FAILED: org.apache.solr.cloud.TestCloudRecovery.leaderRecoverFromLogOnStartupTest
Error Message:
expected:<2> but was:<4>
Stack Trace:
java.lang.AssertionError: expected:<2> but was:<4>
at __randomizedtesting.SeedInfo.seed([549E0CC4396A0039:206EED817D4E47B6]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestCloudRecovery.leaderRecoverFromLogOnStartupTest(TestCloudRecovery.java:132)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.testReadApi
Error Message:
expected:<1> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
at __randomizedtesting.SeedInfo.seed([549E0CC4396A0039:3B7F771E298E222]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.testReadApi(AutoScalingHandlerTest.java:709)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11768 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/init-core-data-001
[junit4] 2> 528921 WARN (SUITE-AutoScalingHandlerTest-seed#[549E0CC4396A0039]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 528972 INFO (SUITE-AutoScalingHandlerTest-seed#[549E0CC4396A0039]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 528973 INFO (SUITE-AutoScalingHandlerTest-seed#[549E0CC4396A0039]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 528974 INFO (SUITE-AutoScalingHandlerTest-seed#[549E0CC4396A0039]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 528974 INFO (SUITE-AutoScalingHandlerTest-seed#[549E0CC4396A0039]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001
[junit4] 2> 528974 INFO (SUITE-AutoScalingHandlerTest-seed#[549E0CC4396A0039]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 528994 INFO (Thread-241) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 528994 INFO (Thread-241) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 529042 ERROR (Thread-241) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 529110 INFO (SUITE-AutoScalingHandlerTest-seed#[549E0CC4396A0039]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:34614
[junit4] 2> 529320 INFO (jetty-launcher-146-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 529354 INFO (jetty-launcher-146-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 529578 INFO (jetty-launcher-146-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4c382134{/solr,null,AVAILABLE}
[junit4] 2> 529594 INFO (jetty-launcher-146-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6c041692{/solr,null,AVAILABLE}
[junit4] 2> 529611 INFO (jetty-launcher-146-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6accbe7a{SSL,[ssl, http/1.1]}{127.0.0.1:41753}
[junit4] 2> 529611 INFO (jetty-launcher-146-thread-2) [ ] o.e.j.s.Server Started @545763ms
[junit4] 2> 529611 INFO (jetty-launcher-146-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41753}
[junit4] 2> 529611 ERROR (jetty-launcher-146-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 529611 INFO (jetty-launcher-146-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 529611 INFO (jetty-launcher-146-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 529611 INFO (jetty-launcher-146-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 529612 INFO (jetty-launcher-146-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-14T17:31:44.821Z
[junit4] 2> 529631 INFO (jetty-launcher-146-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@56a11ae0{SSL,[ssl, http/1.1]}{127.0.0.1:42549}
[junit4] 2> 529631 INFO (jetty-launcher-146-thread-1) [ ] o.e.j.s.Server Started @545783ms
[junit4] 2> 529631 INFO (jetty-launcher-146-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42549}
[junit4] 2> 529631 ERROR (jetty-launcher-146-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 529631 INFO (jetty-launcher-146-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 529631 INFO (jetty-launcher-146-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 529631 INFO (jetty-launcher-146-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 529631 INFO (jetty-launcher-146-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-14T17:31:44.840Z
[junit4] 2> 529778 INFO (jetty-launcher-146-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 529810 INFO (jetty-launcher-146-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 529845 INFO (jetty-launcher-146-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34614/solr
[junit4] 2> 529863 INFO (jetty-launcher-146-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34614/solr
[junit4] 2> 530035 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15fbb9634da0003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 530333 INFO (jetty-launcher-146-thread-2) [n:127.0.0.1:41753_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 530333 INFO (jetty-launcher-146-thread-2) [n:127.0.0.1:41753_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41753_solr
[junit4] 2> 530387 INFO (jetty-launcher-146-thread-2) [n:127.0.0.1:41753_solr ] o.a.s.c.Overseer Overseer (id=99003970631630854-127.0.0.1:41753_solr-n_0000000000) starting
[junit4] 2> 530515 INFO (jetty-launcher-146-thread-2) [n:127.0.0.1:41753_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41753_solr
[junit4] 2> 530697 INFO (OverseerStateUpdate-99003970631630854-127.0.0.1:41753_solr-n_0000000000) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 531212 INFO (jetty-launcher-146-thread-1) [n:127.0.0.1:42549_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 531302 INFO (jetty-launcher-146-thread-1) [n:127.0.0.1:42549_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 531465 INFO (jetty-launcher-146-thread-1) [n:127.0.0.1:42549_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42549_solr
[junit4] 2> 531554 INFO (zkCallback-158-thread-1-processing-n:127.0.0.1:41753_solr) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 531594 INFO (zkCallback-157-thread-1-processing-n:127.0.0.1:42549_solr) [n:127.0.0.1:42549_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 531666 INFO (jetty-launcher-146-thread-2) [n:127.0.0.1:41753_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41753.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 531666 INFO (jetty-launcher-146-thread-2) [n:127.0.0.1:41753_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41753.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 531666 INFO (jetty-launcher-146-thread-2) [n:127.0.0.1:41753_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41753.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 531667 INFO (jetty-launcher-146-thread-2) [n:127.0.0.1:41753_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node2/.
[junit4] 2> 531866 INFO (jetty-launcher-146-thread-1) [n:127.0.0.1:42549_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42549.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 531866 INFO (jetty-launcher-146-thread-1) [n:127.0.0.1:42549_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42549.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 531866 INFO (jetty-launcher-146-thread-1) [n:127.0.0.1:42549_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42549.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 531920 INFO (jetty-launcher-146-thread-1) [n:127.0.0.1:42549_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node1/.
[junit4] 2> 532599 INFO (SUITE-AutoScalingHandlerTest-seed#[549E0CC4396A0039]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 532620 INFO (SUITE-AutoScalingHandlerTest-seed#[549E0CC4396A0039]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 532710 INFO (TEST-AutoScalingHandlerTest.testErrorHandling-seed#[549E0CC4396A0039]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testErrorHandling
[junit4] 2> 533295 ERROR (qtp2089025075-907) [n:127.0.0.1:41753_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.api.ApiBag$ExceptionWithErrObject: Error in command payload, errors: [{set-cluster-policy=[{cores=<10, node=#ANY}, {shard=#EACH, node=#ANY}, {nodeRole=overseer, replica=0}], errorMessages=[replica is required in {
[junit4] 2> "shard":"#EACH",
[junit4] 2> "node":"#ANY"}]}],
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.processOps(AutoScalingHandler.java:211)
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.handleRequestBody(AutoScalingHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:737)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:718)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:499)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 533295 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=400 QTime=218
[junit4] 2> 533296 INFO (TEST-AutoScalingHandlerTest.testErrorHandling-seed#[549E0CC4396A0039]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testErrorHandling
[junit4] 2> 533355 INFO (TEST-AutoScalingHandlerTest.testPolicyAndPreferences-seed#[549E0CC4396A0039]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testPolicyAndPreferences
[junit4] 2> 533477 ERROR (qtp2089025075-906) [n:127.0.0.1:41753_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.api.ApiBag$ExceptionWithErrObject: Error in command payload, errors: [{set-policy={xyz=[{replica=<2, shard=#EACH, node=#ANY}, {nodeRole=!overseer, replica=0}], policy1=[{cores=<2, node=#ANY}, {replica=<2, shard=#EACH, node=#ANY}]}, errorMessages=[cores is only allowed in 'cluster-policy']}],
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.processOps(AutoScalingHandler.java:211)
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.handleRequestBody(AutoScalingHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:737)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:718)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:499)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 533478 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=400 QTime=53
[junit4] 2> 533698 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 533698 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 533948 INFO (qtp2089025075-912) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=82
[junit4] 2> 534416 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 534597 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=1118
[junit4] 2> 534782 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 534782 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 534799 INFO (qtp2089025075-909) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 534833 INFO (qtp1777903686-903) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 534884 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=271
[junit4] 2> 535153 INFO (qtp2089025075-910) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 535154 INFO (qtp2089025075-910) [n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 535165 INFO (qtp2089025075-909) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 535239 INFO (qtp1777903686-904) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 535328 INFO (qtp2089025075-910) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=371
[junit4] 2> 535458 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 535458 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 535714 INFO (qtp2089025075-909) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=240
[junit4] 2> 535717 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=1
[junit4] 2> 535788 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=458
[junit4] 2> 536118 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 536118 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 536135 INFO (qtp2089025075-908) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm} status=0 QTime=0
[junit4] 2> 536191 INFO (qtp1777903686-903) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm} status=0 QTime=0
[junit4] 2> 536207 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=292
[junit4] 2> 536522 INFO (qtp2089025075-912) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 536559 INFO (qtp2089025075-912) [n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 536775 INFO (qtp2089025075-908) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName,os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm,solr.core} status=0 QTime=0
[junit4] 2> 536800 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName,os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm,solr.core} status=0 QTime=0
[junit4] 2> 536975 INFO (qtp2089025075-912) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=766
[junit4] 2> 536976 INFO (TEST-AutoScalingHandlerTest.testPolicyAndPreferences-seed#[549E0CC4396A0039]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testPolicyAndPreferences
[junit4] 2> 537210 INFO (TEST-AutoScalingHandlerTest.testReadApi-seed#[549E0CC4396A0039]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testReadApi
[junit4] 2> 537742 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 537743 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 537744 INFO (qtp2089025075-910) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 537750 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 537781 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=564
[junit4] 2> 537890 INFO (qtp2089025075-909) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 537891 INFO (qtp2089025075-909) [n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 537909 INFO (qtp2089025075-910) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=17
[junit4] 2> 537933 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 537999 INFO (qtp2089025075-909) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=217
[junit4] 2> 538219 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 538220 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 538312 INFO (qtp2089025075-908) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=90
[junit4] 2> 538316 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 538349 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=347
[junit4] 2> 538617 INFO (qtp2089025075-912) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 538618 INFO (qtp2089025075-912) [n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 538620 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 538658 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 538694 INFO (qtp2089025075-912) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=344
[junit4] 2> 538732 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=16
[junit4] 2> 538874 INFO (qtp2089025075-909) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 538875 INFO (qtp2089025075-909) [n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 538876 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 538913 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 538970 INFO (qtp2089025075-909) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling/diagnostics params={wt=javabin&version=2} status=0 QTime=236
[junit4] 2> 538971 INFO (qtp2089025075-908) [n:127.0.0.1:41753_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=6&collection.configName=conf&maxShardsPerNode=10&name=readApiTestViolations&nrtReplicas=6&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 539077 INFO (OverseerThreadFactory-430-thread-1-processing-n:127.0.0.1:41753_solr) [n:127.0.0.1:41753_solr ] o.a.s.c.CreateCollectionCmd Create collection readApiTestViolations
[junit4] 2> 539078 ERROR (OverseerThreadFactory-430-thread-1-processing-n:127.0.0.1:41753_solr) [n:127.0.0.1:41753_solr ] o.a.s.c.OverseerCollectionMessageHandler Collection: readApiTestViolations operation: create failed:org.apache.solr.common.SolrException: 'maxShardsPerNode>0' is not supported when autoScaling policies are used
[junit4] 2> at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:136)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 539204 INFO (qtp2089025075-908) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=6&collection.configName=conf&maxShardsPerNode=10&name=readApiTestViolations&nrtReplicas=6&action=CREATE&numShards=1&wt=javabin&version=2} status=400 QTime=233
[junit4] 2> 539387 INFO (qtp2089025075-910) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 539388 INFO (qtp2089025075-910) [n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34614/solr ready
[junit4] 2> 539389 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 539444 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 539481 INFO (qtp2089025075-910) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=168
[junit4] 2> 539482 INFO (qtp2089025075-912) [n:127.0.0.1:41753_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=6&collection.configName=conf&name=readApiTestViolations&nrtReplicas=6&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 539517 INFO (OverseerCollectionConfigSetProcessor-99003970631630854-127.0.0.1:41753_solr-n_0000000000) [n:127.0.0.1:41753_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 539517 INFO (OverseerThreadFactory-430-thread-2-processing-n:127.0.0.1:41753_solr) [n:127.0.0.1:41753_solr ] o.a.s.c.CreateCollectionCmd Create collection readApiTestViolations
[junit4] 2> 539518 WARN (OverseerThreadFactory-430-thread-2-processing-n:127.0.0.1:41753_solr) [n:127.0.0.1:41753_solr ] o.a.s.c.CreateCollectionCmd Specified number of replicas of 6 on collection readApiTestViolations is higher than the number of Solr instances currently live or live and part of your createNodeSet(2). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 539592 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 539642 INFO (qtp1777903686-903) [n:127.0.0.1:42549_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=12
[junit4] 2> 539992 INFO (OverseerStateUpdate-99003970631630854-127.0.0.1:41753_solr-n_0000000000) [n:127.0.0.1:41753_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41753/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 539993 INFO (OverseerStateUpdate-99003970631630854-127.0.0.1:41753_solr-n_0000000000) [n:127.0.0.1:41753_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:42549/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 539995 INFO (OverseerStateUpdate-99003970631630854-127.0.0.1:41753_solr-n_0000000000) [n:127.0.0.1:41753_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41753/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 540030 INFO (OverseerStateUpdate-99003970631630854-127.0.0.1:41753_solr-n_0000000000) [n:127.0.0.1:41753_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:42549/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 540046 INFO (OverseerStateUpdate-99003970631630854-127.0.0.1:41753_solr-n_0000000000) [n:127.0.0.1:41753_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n8",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41753/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 540082 INFO (OverseerStateUpdate-99003970631630854-127.0.0.1:41753_solr-n_0000000000) [n:127.0.0.1:41753_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n10",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:42549/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 540338 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n1&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 540338 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 540541 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n3&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 540596 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n6&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 540596 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 540614 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n2&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 540614 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node12&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n10&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 540724 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n8&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 540834 INFO (zkCallback-158-thread-1-processing-n:127.0.0.1:41753_solr) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 540849 INFO (zkCallback-157-thread-1-processing-n:127.0.0.1:42549_solr) [n:127.0.0.1:42549_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 540850 INFO (zkCallback-158-thread-2-processing-n:127.0.0.1:41753_solr) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 540850 INFO (zkCallback-157-thread-2-processing-n:127.0.0.1:42549_solr) [n:127.0.0.1:42549_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 540850 INFO (zkCallback-157-thread-3-processing-n:127.0.0.1:42549_solr) [n:127.0.0.1:42549_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 541709 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 541917 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n1] Schema name=minimal
[junit4] 2> 542009 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 542009 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n1' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 542024 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41753.solr.core.readApiTestViolations.shard1.replica_n1' (registry 'solr.core.readApiTestViolations.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 542025 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 542025 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node2/readApiTestViolations_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node2/./readApiTestViolations_shard1_replica_n1/data/]
[junit4] 2> 542113 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 542148 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 542150 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 542181 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 542245 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 542291 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n8] Schema name=minimal
[junit4] 2> 542383 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 542383 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n8' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 542384 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41753.solr.core.readApiTestViolations.shard1.replica_n8' (registry 'solr.core.readApiTestViolations.shard1.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 542384 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 542384 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n8] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node2/readApiTestViolations_shard1_replica_n8], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node2/./readApiTestViolations_shard1_replica_n8/data/]
[junit4] 2> 542392 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n6] Schema name=minimal
[junit4] 2> 542537 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 542537 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n6' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 542537 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42549.solr.core.readApiTestViolations.shard1.replica_n6' (registry 'solr.core.readApiTestViolations.shard1.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 542538 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 542538 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n6] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node1/readApiTestViolations_shard1_replica_n6], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node1/./readApiTestViolations_shard1_replica_n6/data/]
[junit4] 2> 542560 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n2] Schema name=minimal
[junit4] 2> 542573 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n3] Schema name=minimal
[junit4] 2> 542583 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n10] Schema name=minimal
[junit4] 2> 542595 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 542595 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n3' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 542596 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41753.solr.core.readApiTestViolations.shard1.replica_n3' (registry 'solr.core.readApiTestViolations.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 542596 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 542596 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n3] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node2/readApiTestViolations_shard1_replica_n3], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node2/./readApiTestViolations_shard1_replica_n3/data/]
[junit4] 2> 542604 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 542604 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n10' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 542605 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42549.solr.core.readApiTestViolations.shard1.replica_n10' (registry 'solr.core.readApiTestViolations.shard1.replica_n10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 542605 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 542605 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n10] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node1/readApiTestViolations_shard1_replica_n10], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node1/./readApiTestViolations_shard1_replica_n10/data/]
[junit4] 2> 542611 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 542611 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n2' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 542732 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42549.solr.core.readApiTestViolations.shard1.replica_n2' (registry 'solr.core.readApiTestViolations.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@ac189db
[junit4] 2> 542765 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 542765 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node1/readApiTestViolations_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_549E0CC4396A0039-001/tempDir-001/node1/./readApiTestViolations_shard1_replica_n2/data/]
[junit4] 2> 543127 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 543127 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 543128 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 543128 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 543130 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@e6799a1[readApiTestViolations_shard1_replica_n2] main]
[junit4] 2> 543151 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 543152 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 543204 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 543205 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584063544991678464
[junit4] 2> 543408 INFO (searcherExecutor-440-thread-1-processing-n:127.0.0.1:42549_solr x:readApiTestViolations_shard1_replica_n2 s:shard1 c:readApiTestViolations r:core_node5) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.SolrCore [readApiTestViolations_shard1_replica_n2] Registered new searcher Searcher@e6799a1[readApiTestViolations_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 543426 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=6 found=1 timeoutin=9999ms
[junit4] 2> 543427 INFO (zkCallback-158-thread-2-processing-n:127.0.0.1:41753_solr) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 543427 INFO (zkCallback-158-thread-1-processing-n:127.0.0.1:41753_solr) [n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 543444 INFO (zkCallback-157-thread-3-processing-n:127.0.0.1:42549_solr) [n:127.0.0.1:42549_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 543444 INFO (zkCallback-157-thread-2-processing-n:127.0.0.1:42549_solr) [n:127.0.0.1:42549_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 543445 INFO (zkCallback-157-thread-1-processing-n:127.0.0.1:42549_solr) [n:127.0.0.1:42549_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 543554 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 543554 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 543555 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 543555 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 543556 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@6db2ab40[readApiTestViolations_shard1_replica_n6] main]
[junit4] 2> 543557 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 543590 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 543590 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 543591 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 543592 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 543593 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.s.SolrIndexSearcher Opening [Searcher@77a79f7[readApiTestViolations_shard1_replica_n8] main]
[junit4] 2> 543594 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 543594 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 543607 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 543607 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 543608 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 543608 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 543609 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4a39f20f[readApiTestViolations_shard1_replica_n1] main]
[junit4] 2> 543610 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 543610 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 543627 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 543628 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 543658 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 543709 INFO (searcherExecutor-437-thread-1-processing-n:127.0.0.1:42549_solr x:readApiTestViolations_shard1_replica_n6 s:shard1 c:readApiTestViolations r:core_node9) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.c.SolrCore [readApiTestViolations_shard1_replica_n6] Registered new searcher Searcher@6db2ab40[readApiTestViolations_shard1_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 543709 INFO (searcherExecutor-435-thread-1-processing-n:127.0.0.1:41753_solr x:readApiTestViolations_shard1_replica_n1 s:shard1 c:readApiTestViolations r:core_node4) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.c.SolrCore [readApiTestViolations_shard1_replica_n1] Registered new searcher Searcher@4a39f20f[readApiTestViolations_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 543710 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 543710 INFO (qtp1777903686-897) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584063545521209344
[junit4] 2> 543712 INFO (qtp2089025075-913) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584063545523306496
[junit4] 2> 543714 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 543714 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 543715 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 543715 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 543765 INFO (qtp2089025075-906) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584063545578881024
[junit4] 2> 543861 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 543861 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 543863 INFO (searcherExecutor-436-thread-1-processing-n:127.0.0.1:41753_solr x:readApiTestViolations_shard1_replica_n8 s:shard1 c:readApiTestViolations r:core_node11) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.c.SolrCore [readApiTestViolations_shard1_replica_n8] Registered new searcher Searcher@77a79f7[readApiTestViolations_shard1_replica_n8] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 543875 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@5361c972[readApiTestViolations_shard1_replica_n3] main]
[junit4] 2> 543913 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 543913 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 543914 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.s.SolrIndexSearcher Opening [Searcher@e7248e2[readApiTestViolations_shard1_replica_n10] main]
[junit4] 2> 543928 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 543948 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 543949 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 543985 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 544006 INFO (searcherExecutor-438-thread-1-processing-n:127.0.0.1:41753_solr x:readApiTestViolations_shard1_replica_n3 s:shard1 c:readApiTestViolations r:core_node7) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.c.SolrCore [readApiTestViolations_shard1_replica_n3] Registered new searcher Searcher@5361c972[readApiTestViolations_shard1_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 544006 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 544007 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 544007 INFO (qtp1777903686-898) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584063545832636416
[junit4] 2> 544022 INFO (qtp2089025075-907) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584063545848365056
[junit4] 2> 544042 INFO (searcherExecutor-439-thread-1-processing-n:127.0.0.1:42549_solr x:readApiTestViolations_shard1_replica_n10 s:shard1 c:readApiTestViolations r:core_node12) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.c.SolrCore [readApiTestViolations_shard1_replica_n10] Registered new searcher Searcher@e7248e2[readApiTestViolations_shard1_replica_n10] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 544526 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 544526 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 544526 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:42549/solr/readApiTestViolations_shard1_replica_n2/
[junit4] 2> 544527 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=readApiTestViolations_shard1_replica_n2 url=https://127.0.0.1:42549/solr START replicas=[https://127.0.0.1:41753/solr/readApiTestViolations_shard1_replica_n1/, https://127.0.0.1:41753/solr/readApiTestViolations_shard1_replica_n3/, https://127.0.0.1:42549/solr/readApiTestViolations_shard1_replica_n6/, https://127.0.0.1:41753/solr/readApiTestViolations_shard1_replica_n8/, https://127.0.0.1:42549/solr/readApiTestViolations_shard1_replica_n10/] nUpdates=100
[junit4] 2> 544894 INFO (qtp2089025075-910) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node11 x:readApiTestViolations_shard1_replica_n8] o.a.s.c.S.Request [readApiTestViolations_shard1_replica_n8] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=99
[junit4] 2> 544932 INFO (qtp2089025075-909) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node7 x:readApiTestViolations_shard1_replica_n3] o.a.s.c.S.Request [readApiTestViolations_shard1_replica_n3] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 544961 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=readApiTestViolations_shard1_replica_n2 url=https://127.0.0.1:42549/solr DONE. We have no versions. sync failed.
[junit4] 2> 545058 INFO (qtp1777903686-901) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node9 x:readApiTestViolations_shard1_replica_n6] o.a.s.c.S.Request [readApiTestViolations_shard1_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=107
[junit4] 2> 545059 INFO (qtp1777903686-903) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n10] o.a.s.c.S.Request [readApiTestViolations_shard1_replica_n10] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=107
[junit4] 2> 545367 INFO (qtp2089025075-910) [n:127.0.0.1:41753_solr c:readApiTestViolations s:shard1 r:core_node4 x:readApiTestViolations_shard1_replica_n1] o.a.s.c.S.Request [readApiTestViolations_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=307
[junit4] 2> 545383 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 545383 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 545383 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 545385 INFO (qtp1777903686-902) [n:127.0.0.1:42549_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:42549/solr/readApiTestViolations_shard1_replica_n2/ shard1
[junit4] 2> 545495 INFO (zkCallback-157-thread-1-processing-n:127.0.0.1:42549_solr) [n:127.0.0.1:42549_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTe
[...truncated too long message...]
re.collection1.shard1.replica_n1, tag=867191750
[junit4] 2> 2271340 INFO (coreCloseExecutor-3162-thread-2) [n:127.0.0.1:34305_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5475905d: rootName = solr_34305, domain = solr.core.collection1.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@fddff7f
[junit4] 2> 2271354 INFO (zkCallback-1573-thread-1-processing-n:127.0.0.1:34305_solr) [n:127.0.0.1:34305_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [0])
[junit4] 2> 2271354 INFO (zkCallback-1566-thread-1-processing-n:127.0.0.1:43952_solr) [n:127.0.0.1:43952_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [0])
[junit4] 2> 2271355 INFO (zkCallback-1566-thread-2-processing-n:127.0.0.1:43952_solr) [n:127.0.0.1:43952_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [0])
[junit4] 2> 2271414 INFO (coreCloseExecutor-3162-thread-2) [n:127.0.0.1:34305_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=867191750
[junit4] 2> 2271449 INFO (coreCloseExecutor-3163-thread-1) [n:127.0.0.1:43952_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n4] o.a.s.c.SolrCore [collection1_shard2_replica_n4] CLOSING SolrCore org.apache.solr.core.SolrCore@1216c936
[junit4] 2> 2271449 INFO (coreCloseExecutor-3163-thread-1) [n:127.0.0.1:43952_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard2.replica_n4, tag=303483190
[junit4] 2> 2271449 INFO (coreCloseExecutor-3163-thread-1) [n:127.0.0.1:43952_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6d0de51f: rootName = solr_43952, domain = solr.core.collection1.shard2.replica_n4, service url = null, agent id = null] for registry solr.core.collection1.shard2.replica_n4 / com.codahale.metrics.MetricRegistry@427fefc0
[junit4] 2> 2271557 INFO (coreCloseExecutor-3163-thread-2) [n:127.0.0.1:43952_solr c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore [collection1_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@55c3e9cc
[junit4] 2> 2271576 INFO (coreCloseExecutor-3163-thread-2) [n:127.0.0.1:43952_solr c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n2, tag=1438902732
[junit4] 2> 2271576 INFO (coreCloseExecutor-3163-thread-2) [n:127.0.0.1:43952_solr c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@85a2213: rootName = solr_43952, domain = solr.core.collection1.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@a0f3d16
[junit4] 2> 2271633 INFO (coreCloseExecutor-3163-thread-1) [n:127.0.0.1:43952_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard2.leader, tag=303483190
[junit4] 2> 2271716 INFO (coreCloseExecutor-3163-thread-2) [n:127.0.0.1:43952_solr c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=1438902732
[junit4] 2> 2271903 INFO (jetty-closer-1524-thread-1) [ ] o.a.s.c.Overseer Overseer (id=99004081461723153-127.0.0.1:43952_solr-n_0000000004) closing
[junit4] 2> 2271904 INFO (OverseerStateUpdate-99004081461723153-127.0.0.1:43952_solr-n_0000000004) [n:127.0.0.1:43952_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43952_solr
[junit4] 2> 2271904 WARN (OverseerAutoScalingTriggerThread-99004081461723153-127.0.0.1:43952_solr-n_0000000004) [n:127.0.0.1:43952_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2272085 INFO (jetty-closer-1524-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6ede0f09{/solr,null,UNAVAILABLE}
[junit4] 2> 2272125 INFO (jetty-closer-1524-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2b165c7f{/solr,null,UNAVAILABLE}
[junit4] 2> 2272125 ERROR (SUITE-TestCloudRecovery-seed#[549E0CC4396A0039]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2272125 INFO (SUITE-TestCloudRecovery-seed#[549E0CC4396A0039]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40225 40225
[junit4] 2> 2272125 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15fbbb002d70011, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2272205 INFO (Thread-1229) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40225 40225
[junit4] 2> 2272205 WARN (Thread-1229) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 6 /solr/configs/config
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 39 /solr/collections/collection1/state.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 4 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 4 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 4 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_549E0CC4396A0039-001
[junit4] 2> Nov 14, 2017 6:00:48 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{_version_=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=426, maxMBSortInHeap=5.965800294316802, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@76f170be), locale=es-MX, timezone=America/Matamoros
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=166930568,total=524812288
[junit4] 2> NOTE: All tests run in this JVM: [AsyncCallRequestStatusResponseTest, TestPrepRecovery, TestConfigSetsAPIExclusivity, TestSQLHandlerNonCloud, TestUseDocValuesAsStored, TestNumericTokenStream, TestCollectionAPI, SearchRateTriggerTest, TestDynamicFieldResource, BooleanFieldTest, CopyFieldTest, AliasIntegrationTest, DocValuesNotIndexedTest, TestTrie, AlternateDirectoryTest, CollectionReloadTest, TestCloudSchemaless, TestManagedSchema, RequestLoggingTest, TemplateUpdateProcessorTest, ChaosMonkeyNothingIsSafeTest, TestPointFields, ComputePlanActionTest, AnalysisErrorHandlingTest, ConnectionReuseTest, TestTrackingShardHandlerFactory, TestCoreDiscovery, TestReplicaProperties, TestDynamicLoading, ZkStateReaderTest, TestLeaderElectionZkExpiry, TestPKIAuthenticationPlugin, RollingRestartTest, DistanceFunctionTest, TestMissingGroups, WrapperMergePolicyFactoryTest, SortByFunctionTest, TestCharFilters, TestOverriddenPrefixQueryForCustomFieldType, ManagedSchemaRoundRobinCloudTest, HdfsBasicDistributedZkTest, RegexBytesRefFilterTest, TestManagedResource, TestSystemCollAutoCreate, DistribJoinFromCollectionTest, LeaderFailureAfterFreshStartTest, TestZkAclsWithHadoopAuth, CdcrBootstrapTest, DistributedFacetPivotWhiteBoxTest, TestReload, MetricUtilsTest, UUIDUpdateProcessorFallbackTest, TestHashPartitioner, TestRetrieveFieldsOptimizer, TestFieldCacheSort, TestDelegationWithHadoopAuth, TestQueryTypes, TestSolrDeletionPolicy2, SuggestComponentContextFilterQueryTest, DistributedFacetPivotLongTailTest, BasicAuthStandaloneTest, TestConfigsApi, TestCloudRecovery]
[junit4] Completed [198/749 (2!)] on J2 in 53.35s, 2 tests, 1 failure <<< FAILURES!
[...truncated 49131 lines...]