You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/02/16 13:24:40 UTC
[JENKINS] Lucene-Solr-Tests-7.x - Build # 406 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/406/
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.index.hdfs.CheckHdfsIndexTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.index.hdfs.CheckHdfsIndexTest: 1) Thread[id=585, name=qtp868643065-585, state=TIMED_WAITING, group=TGRP-CheckHdfsIndexTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.index.hdfs.CheckHdfsIndexTest:
1) Thread[id=585, name=qtp868643065-585, state=TIMED_WAITING, group=TGRP-CheckHdfsIndexTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([E280E39C30BA0997]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.index.hdfs.CheckHdfsIndexTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=585, name=qtp868643065-585, state=TIMED_WAITING, group=TGRP-CheckHdfsIndexTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=585, name=qtp868643065-585, state=TIMED_WAITING, group=TGRP-CheckHdfsIndexTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([E280E39C30BA0997]:0)
Build Log:
[...truncated 12181 lines...]
[junit4] Suite: org.apache.solr.index.hdfs.CheckHdfsIndexTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/init-core-data-001
[junit4] 2> 7192 WARN (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
[junit4] 2> 7192 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 7193 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 7633 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 7633 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /q/
[junit4] 2> 8577 WARN (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 9467 WARN (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 9656 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 9677 WARN (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 10201 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 10393 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_52123_hdfs____.aw3o4h/webapp
[junit4] 2> 12773 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:52123
[junit4] 2> 13462 WARN (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 13465 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 13474 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_59047_datanode____y6khyu/webapp
[junit4] 2> 13944 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59047
[junit4] 2> 14198 WARN (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 14201 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 14221 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_45335_datanode____.3miag5/webapp
[junit4] 2> 14647 INFO (SUITE-CheckHdfsIndexTest-seed#[E280E39C30BA0997]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45335
[junit4] 2> 14867 ERROR (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/tempDir-001/hdfsBaseDir/data/data2/]] heartbeating to localhost/127.0.0.1:36182) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 15248 ERROR (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/tempDir-001/hdfsBaseDir/data/data4/]] heartbeating to localhost/127.0.0.1:36182) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 15368 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x43a28c030b296e: from storage DS-0b669953-9e03-481b-a865-0df43aea675c node DatanodeRegistration(127.0.0.1:51036, datanodeUuid=5f2e4db4-0594-46e1-a76b-cf2f8fcefea5, infoPort=45163, infoSecurePort=0, ipcPort=60851, storageInfo=lv=-56;cid=testClusterID;nsid=1005183451;c=0), blocks: 0, hasStaleStorage: true, processing time: 13 msecs
[junit4] 2> 15371 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x43a28c0434f2ce: from storage DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50 node DatanodeRegistration(127.0.0.1:59512, datanodeUuid=0533e912-ace6-4f79-9d19-743a90291b4a, infoPort=47456, infoSecurePort=0, ipcPort=43345, storageInfo=lv=-56;cid=testClusterID;nsid=1005183451;c=0), blocks: 0, hasStaleStorage: true, processing time: 4 msecs
[junit4] 2> 15372 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x43a28c030b296e: from storage DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4 node DatanodeRegistration(127.0.0.1:51036, datanodeUuid=5f2e4db4-0594-46e1-a76b-cf2f8fcefea5, infoPort=45163, infoSecurePort=0, ipcPort=60851, storageInfo=lv=-56;cid=testClusterID;nsid=1005183451;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 15372 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x43a28c0434f2ce: from storage DS-24f4402d-6762-4664-b7dd-64190cae7e67 node DatanodeRegistration(127.0.0.1:59512, datanodeUuid=0533e912-ace6-4f79-9d19-743a90291b4a, infoPort=47456, infoSecurePort=0, ipcPort=43345, storageInfo=lv=-56;cid=testClusterID;nsid=1005183451;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 16811 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 16813 INFO (Thread-115) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 16813 INFO (Thread-115) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 16913 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.ZkTestServer start zk server on port:57913
[junit4] 2> 16935 ERROR (Thread-115) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 17043 INFO (zkConnectionManagerCallback-6-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 17071 INFO (zkConnectionManagerCallback-8-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 17095 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 17111 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 17118 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 17124 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 17130 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 17140 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 17150 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 17153 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 17157 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 17160 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 17162 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 17209 INFO (zkConnectionManagerCallback-11-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 17227 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 17579 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 17627 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 17627 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 17630 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 17711 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6774333b{/q,null,AVAILABLE}
[junit4] 2> 17766 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@d00def{SSL,[ssl, http/1.1]}{127.0.0.1:53641}
[junit4] 2> 17766 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.Server Started @19847ms
[junit4] 2> 17766 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:36182/hdfs__localhost_36182__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-Tests-7.x_solr_build_solr-core_test_J2_temp_solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001_tempDir-002_control_data, replicaType=NRT, hostContext=/q, hostPort=53641, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/control-001/cores}
[junit4] 2> 17800 ERROR (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 17800 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 17800 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 17802 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 17803 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T12:54:00.005Z
[junit4] 2> 17804 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 17844 INFO (zkConnectionManagerCallback-13-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 17849 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 17851 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/control-001/solr.xml
[junit4] 2> 17858 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 17858 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 17861 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@f8d32d8, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 17877 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57913/solr
[junit4] 2> 17898 INFO (zkConnectionManagerCallback-17-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 17947 INFO (zkConnectionManagerCallback-19-thread-1-processing-n:127.0.0.1:53641_q) [n:127.0.0.1:53641_q ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 18192 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:53641_q ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 18194 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:53641_q ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53641_q
[junit4] 2> 18197 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:53641_q ] o.a.s.c.Overseer Overseer (id=73305238729457669-127.0.0.1:53641_q-n_0000000000) starting
[junit4] 2> 18293 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:53641_q ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53641_q
[junit4] 2> 18317 INFO (zkCallback-18-thread-1-processing-n:127.0.0.1:53641_q) [n:127.0.0.1:53641_q ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 18501 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:53641_q ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@f8d32d8
[junit4] 2> 18502 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:53641_q ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@f8d32d8
[junit4] 2> 18502 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:53641_q ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@f8d32d8
[junit4] 2> 18508 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:53641_q ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/control-001/cores
[junit4] 2> 18566 INFO (zkConnectionManagerCallback-25-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 18568 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 18569 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57913/solr ready
[junit4] 2> 18826 INFO (qtp1074252388-217) [n:127.0.0.1:53641_q ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:53641_q&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 18838 INFO (OverseerThreadFactory-34-thread-1-processing-n:127.0.0.1:53641_q) [n:127.0.0.1:53641_q ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 19015 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 19016 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 19128 INFO (zkCallback-18-thread-1-processing-n:127.0.0.1:53641_q) [n:127.0.0.1:53641_q ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 20062 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 20100 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 20206 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 20229 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 20231 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@f8d32d8
[junit4] 2> 20236 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:36182/solr_hdfs_home
[junit4] 2> 20236 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 20236 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 20236 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[hdfs://localhost:36182/solr_hdfs_home/control_collection/core_node2/data/]
[junit4] 2> 20240 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:36182/solr_hdfs_home/control_collection/core_node2/data/snapshot_metadata
[junit4] 2> 20253 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 20253 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 20253 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
[junit4] 2> 20655 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 20661 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:36182/solr_hdfs_home/control_collection/core_node2/data
[junit4] 2> 20692 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:36182/solr_hdfs_home/control_collection/core_node2/data/index
[junit4] 2> 20699 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 20699 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 20704 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 20704 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=61.865234375, floorSegmentMB=2.162109375, forceMergeDeletesPctAllowed=10.625284389970572, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6636055112926569
[junit4] 2> 20914 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW]]} size 69
[junit4] 2> 20914 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741825_1001 size 69
[junit4] 2> 21330 WARN (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 21433 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 21433 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 21434 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 21455 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 21455 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 21466 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1457030358, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 21606 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@55e02791[control_collection_shard1_replica_n1] main]
[junit4] 2> 21610 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 21621 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 21623 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 21627 INFO (searcherExecutor-37-thread-1-processing-n:127.0.0.1:53641_q x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@55e02791[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 21639 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592562175276220416
[junit4] 2> 21691 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 21691 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 21691 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:53641/q/control_collection_shard1_replica_n1/
[junit4] 2> 21692 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 21692 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:53641/q/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 21692 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 21725 INFO (zkCallback-18-thread-1-processing-n:127.0.0.1:53641_q) [n:127.0.0.1:53641_q ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 21727 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:53641/q/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 21728 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 21740 INFO (qtp1074252388-220) [n:127.0.0.1:53641_q c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2727
[junit4] 2> 21790 INFO (qtp1074252388-217) [n:127.0.0.1:53641_q ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 21791 INFO (OverseerCollectionConfigSetProcessor-73305238729457669-127.0.0.1:53641_q-n_0000000000) [n:127.0.0.1:53641_q ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 21837 INFO (zkCallback-18-thread-1-processing-n:127.0.0.1:53641_q) [n:127.0.0.1:53641_q ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 22790 INFO (qtp1074252388-217) [n:127.0.0.1:53641_q ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:53641_q&wt=javabin&version=2} status=0 QTime=3966
[junit4] 2> 22811 INFO (zkConnectionManagerCallback-29-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 22816 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 22817 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57913/solr ready
[junit4] 2> 22819 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 22826 INFO (qtp1074252388-217) [n:127.0.0.1:53641_q ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 22829 INFO (OverseerThreadFactory-34-thread-2-processing-n:127.0.0.1:53641_q) [n:127.0.0.1:53641_q ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 22834 WARN (OverseerThreadFactory-34-thread-2-processing-n:127.0.0.1:53641_q) [n:127.0.0.1:53641_q ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 23066 INFO (qtp1074252388-217) [n:127.0.0.1:53641_q ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 23066 INFO (qtp1074252388-217) [n:127.0.0.1:53641_q ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=240
[junit4] 2> 23204 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/shard-1-001 of type NRT
[junit4] 2> 23207 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 23222 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 23222 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 23222 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 23223 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@259a7a62{/q,null,AVAILABLE}
[junit4] 2> 23223 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@798ef98e{SSL,[ssl, http/1.1]}{127.0.0.1:52038}
[junit4] 2> 23223 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.e.j.s.Server Started @25304ms
[junit4] 2> 23224 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:36182/hdfs__localhost_36182__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-Tests-7.x_solr_build_solr-core_test_J2_temp_solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/q, hostPort=52038, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/shard-1-001/cores}
[junit4] 2> 23224 ERROR (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 23224 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 23224 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 23224 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 23224 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T12:54:05.426Z
[junit4] 2> 23244 INFO (zkConnectionManagerCallback-31-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 23251 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 23251 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/shard-1-001/solr.xml
[junit4] 2> 23256 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 23256 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 23257 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@f8d32d8, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 23276 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57913/solr
[junit4] 2> 23304 INFO (zkConnectionManagerCallback-35-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 23344 INFO (zkConnectionManagerCallback-37-thread-1-processing-n:127.0.0.1:52038_q) [n:127.0.0.1:52038_q ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 23352 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:52038_q ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 23356 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:52038_q ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 23361 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:52038_q ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52038_q
[junit4] 2> 23371 INFO (zkCallback-28-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 23377 INFO (zkCallback-36-thread-1-processing-n:127.0.0.1:52038_q) [n:127.0.0.1:52038_q ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 23377 INFO (zkCallback-18-thread-2-processing-n:127.0.0.1:53641_q) [n:127.0.0.1:53641_q ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 23535 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:52038_q ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@f8d32d8
[junit4] 2> 23566 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:52038_q ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@f8d32d8
[junit4] 2> 23567 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:52038_q ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@f8d32d8
[junit4] 2> 23570 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [n:127.0.0.1:52038_q ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/shard-1-001/cores
[junit4] 2> 23723 INFO (qtp893459442-278) [n:127.0.0.1:52038_q ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:52038_q&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 23727 INFO (OverseerCollectionConfigSetProcessor-73305238729457669-127.0.0.1:53641_q-n_0000000000) [n:127.0.0.1:53641_q ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 23737 INFO (OverseerThreadFactory-34-thread-3-processing-n:127.0.0.1:53641_q) [n:127.0.0.1:53641_q ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:52038_q for creating new replica
[junit4] 2> 23757 INFO (qtp893459442-273) [n:127.0.0.1:52038_q ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 23758 INFO (qtp893459442-273) [n:127.0.0.1:52038_q ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 24791 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 24951 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.IndexSchema [collection1_shard1_replica_n21] Schema name=test
[junit4] 2> 25112 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 25162 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n21' using configuration from collection collection1, trusted=true
[junit4] 2> 25163 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n21' (registry 'solr.core.collection1.shard1.replica_n21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@f8d32d8
[junit4] 2> 25163 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:36182/solr_hdfs_home
[junit4] 2> 25163 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 25163 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 25163 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrCore [[collection1_shard1_replica_n21] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.index.hdfs.CheckHdfsIndexTest_E280E39C30BA0997-001/shard-1-001/cores/collection1_shard1_replica_n21], dataDir=[hdfs://localhost:36182/solr_hdfs_home/collection1/core_node22/data/]
[junit4] 2> 25165 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:36182/solr_hdfs_home/collection1/core_node22/data/snapshot_metadata
[junit4] 2> 25216 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 25216 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 25229 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 25231 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:36182/solr_hdfs_home/collection1/core_node22/data
[junit4] 2> 25660 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:36182/solr_hdfs_home/collection1/core_node22/data/index
[junit4] 2> 25677 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 25677 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
[junit4] 2> 25687 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 25688 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=61.865234375, floorSegmentMB=2.162109375, forceMergeDeletesPctAllowed=10.625284389970572, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6636055112926569
[junit4] 2> 25785 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 25796 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741826_1002 size 69
[junit4] 2> 25917 WARN (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 25994 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 25994 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 25994 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
[junit4] 2> 26011 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 26011 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 26045 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1457030358, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 26081 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.SolrIndexSearcher Opening [Searcher@7bb45349[collection1_shard1_replica_n21] main]
[junit4] 2> 26082 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 26082 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 26083 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 26094 INFO (searcherExecutor-48-thread-1-processing-n:127.0.0.1:52038_q x:collection1_shard1_replica_n21 s:shard1 c:collection1) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrCore [collection1_shard1_replica_n21] Registered new searcher Searcher@7bb45349[collection1_shard1_replica_n21] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 26095 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592562179948675072
[junit4] 2> 26109 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 26109 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 26109 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:52038/q/collection1_shard1_replica_n21/
[junit4] 2> 26109 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 26109 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SyncStrategy https://127.0.0.1:52038/q/collection1_shard1_replica_n21/ has no replicas
[junit4] 2> 26109 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 26118 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:52038/q/collection1_shard1_replica_n21/ shard1
[junit4] 2> 26119 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 26122 INFO (qtp893459442-273) [n:127.0.0.1:52038_q c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2364
[junit4] 2> 26128 INFO (qtp893459442-278) [n:127.0.0.1:52038_q ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:52038_q&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=2405
[junit4] 2> 26152 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testChecksumsOnlyVerbose
[junit4] 2> 27629 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741829_1005{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW]]} size 0
[junit4] 2> 27630 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741829_1005{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|FINALIZED]]} size 0
[junit4] 2> 27632 WARN (DataStreamer for file /solr/_0.nvd) [ ] o.a.h.h.DFSClient Caught exception
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Thread.join(Thread.java:1252)
[junit4] 2> at java.lang.Thread.join(Thread.java:1326)
[junit4] 2> at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeResponder(DFSOutputStream.java:716)
[junit4] 2> at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.endBlock(DFSOutputStream.java:476)
[junit4] 2> at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:652)
[junit4] 2> 27703 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741830_1006{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW]]} size 0
[junit4] 2> 27705 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741830_1006 size 133
[junit4] 2> 27733 INFO (OverseerCollectionConfigSetProcessor-73305238729457669-127.0.0.1:53641_q-n_0000000000) [n:127.0.0.1:53641_q ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 27877 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741831_1007{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW]]} size 0
[junit4] 2> 27913 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741831_1007{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW]]} size 0
[junit4] 2> 28066 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741832_1008{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW]]} size 125
[junit4] 2> 28068 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741832_1008 size 125
[junit4] 2> 28529 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741833_1009{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 28533 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741833_1009{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|FINALIZED]]} size 0
[junit4] 2> 28571 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741834_1010{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|FINALIZED]]} size 0
[junit4] 2> 28573 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741834_1010{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|FINALIZED]]} size 0
[junit4] 2> 28640 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741835_1011{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW]]} size 0
[junit4] 2> 28664 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741835_1011 size 70
[junit4] 2> 28754 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741836_1012{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW]]} size 401
[junit4] 2> 28754 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741836_1012 size 401
[junit4] 2> 29161 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741828_1004{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 29161 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741828_1004{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 29221 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741837_1013{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|FINALIZED]]} size 0
[junit4] 2> 29224 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741837_1013{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|FINALIZED], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|FINALIZED]]} size 0
[junit4] 2> 29247 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 29248 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 29364 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741838_1014{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|FINALIZED]]} size 0
[junit4] 2> 29366 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741838_1014 size 111
[junit4] 2> 30231 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741841_1017{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 30232 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741841_1017{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|FINALIZED]]} size 0
[junit4] 2> 30290 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741842_1018{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW]]} size 133
[junit4] 2> 30291 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741842_1018 size 133
[junit4] 2> 30723 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741843_1019{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 30727 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741843_1019 size 472
[junit4] 2> 30740 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741844_1020{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 30740 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741844_1020{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 30745 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741839_1015{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 30745 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741839_1015 size 185427
[junit4] 2> 30764 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741845_1021{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 30765 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741845_1021 size 3718
[junit4] 2> 30786 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741846_1022{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|FINALIZED]]} size 0
[junit4] 2> 30787 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741846_1022 size 5247
[junit4] 2> 30790 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741840_1016{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 30793 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741840_1016 size 70220
[junit4] 2> 30809 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741847_1023{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 30810 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741847_1023{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|FINALIZED]]} size 0
[junit4] 2> 30824 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741848_1024{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|FINALIZED]]} size 0
[junit4] 2> 30824 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741848_1024{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|FINALIZED], ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|FINALIZED]]} size 0
[junit4] 2> 30862 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741849_1025{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW]]} size 0
[junit4] 2> 30863 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741849_1025{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW]]} size 0
[junit4] 2> 30928 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741850_1026{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|FINALIZED]]} size 0
[junit4] 2> 30930 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741850_1026{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|FINALIZED], ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|FINALIZED]]} size 0
[junit4] 2> 30974 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741851_1027{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW]]} size 0
[junit4] 2> 30976 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741851_1027 size 75
[junit4] 2> 31020 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741852_1028{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 31022 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741852_1028 size 742
[junit4] 2> 31290 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741854_1030{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW]]} size 0
[junit4] 2> 31295 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741854_1030{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW]]} size 0
[junit4] 2> 31306 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741853_1029{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|RBW], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|RBW]]} size 0
[junit4] 2> 31309 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741853_1029 size 755044
[junit4] 2> 31475 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741855_1031{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|FINALIZED]]} size 0
[junit4] 2> 31475 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741855_1031{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-6be8dbf6-429a-4606-98d7-fbf66e69eba4:NORMAL:127.0.0.1:51036|FINALIZED], ReplicaUC[[DISK]DS-54ed3cd1-e2d9-4fc0-bc70-a6ee56888c50:NORMAL:127.0.0.1:59512|FINALIZED]]} size 0
[junit4] 2> 31483 INFO (IPC Server handler 6 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741846_1022 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31487 INFO (IPC Server handler 8 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741850_1026 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31488 INFO (IPC Server handler 0 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741829_1005 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31489 INFO (IPC Server handler 1 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741843_1019 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31491 INFO (IPC Server handler 7 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741842_1018 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31492 INFO (IPC Server handler 3 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741835_1011 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31493 INFO (IPC Server handler 2 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741833_1009 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31493 INFO (IPC Server handler 9 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741836_1012 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31494 INFO (IPC Server handler 4 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741834_1010 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31495 INFO (IPC Server handler 5 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741832_1008 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31496 INFO (IPC Server handler 6 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741844_1020 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31500 INFO (IPC Server handler 8 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741839_1015 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31501 INFO (IPC Server handler 0 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741848_1024 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31501 INFO (IPC Server handler 1 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741849_1025 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31502 INFO (IPC Server handler 7 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741831_1007 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31503 INFO (IPC Server handler 3 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741840_1016 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31504 INFO (IPC Server handler 2 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741837_1013 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31505 INFO (IPC Server handler 9 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741841_1017 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31507 INFO (IPC Server handler 4 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741845_1021 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31511 INFO (IPC Server handler 5 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741828_1004 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31512 INFO (IPC Server handler 6 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741838_1014 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31512 INFO (IPC Server handler 8 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741827_1003 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31513 INFO (IPC Server handler 0 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741847_1023 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31514 INFO (IPC Server handler 1 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741830_1006 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31515 INFO (IPC Server handler 7 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741851_1027 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 31516 INFO (IPC Server handler 3 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741852_1028 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 31539 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51036 is added to blk_1073741856_1032{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-24f4402d-6762-4664-b7dd-64190cae7e67:NORMAL:127.0.0.1:59512|RBW], ReplicaUC[[DISK]DS-0b669953-9e03-481b-a865-0df43aea675c:NORMAL:127.0.0.1:51036|RBW]]} size 0
[junit4] 2> 31548 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59512 is added to blk_1073741856_1032 size 134
[junit4] 2> 34465 INFO (org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@43b4d353) [ ] BlockStateChange BLOCK* BlockManager: ask 127.0.0.1:59512 to delete [blk_1073741827_1003, blk_1073741828_1004, blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741833_1009, blk_1073741834_1010, blk_1073741835_1011, blk_1073741836_1012, blk_1073741837_1013, blk_1073741838_1014, blk_1073741839_1015, blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741846_1022, blk_1073741847_1023, blk_1073741848_1024, blk_1073741849_1025, blk_1073741850_1026, blk_1073741851_1027, blk_1073741852_1028]
[junit4] 2> 37491 INFO (org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@43b4d353) [ ] BlockStateChange BLOCK* BlockManager: ask 127.0.0.1:51036 to delete [blk_1073741827_1003, blk_1073741828_1004, blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741833_1009, blk_1073741834_1010, blk_1073741835_1011, blk_1073741836_1012, blk_1073741837_1013, blk_1073741838_1014, blk_1073741839_1015, blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741846_1022, blk_1073741847_1023, blk_1073741848_1024, blk_1073741849_1025, blk_1073741850_1026, blk_1073741851_1027, blk_1073741852_1028]
[junit4] 2> 38710 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost:36182/solr
[junit4] 2> 38712 INFO (IPC Server handler 4 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741854_1030 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 38712 INFO (IPC Server handler 4 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741853_1029 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 38712 INFO (IPC Server handler 4 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741855_1031 127.0.0.1:59512 127.0.0.1:51036
[junit4] 2> 38712 INFO (IPC Server handler 4 on 36182) [ ] BlockStateChange BLOCK* addToInvalidates: blk_1073741856_1032 127.0.0.1:51036 127.0.0.1:59512
[junit4] 2> 38712 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testChecksumsOnlyVerbose
[junit4] 2> 38713 INFO (TEST-CheckHdfsIndexTest.testChecksumsOnlyVerbose-seed#[E280E39C30BA0997]) [ ] o.a.s.c.ChaosMonkey monkey: stop j
[...truncated too long message...]
rc/test/org/apache/solr/highlight/HighlighterTest.java (at line 204)
[ecj-lint] Analyzer a1 = new WhitespaceAnalyzer();
[ecj-lint] ^^
[ecj-lint] Resource leak: 'a1' is never closed
[ecj-lint] ----------
[ecj-lint] 15. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 207)
[ecj-lint] OffsetWindowTokenFilter tots = new OffsetWindowTokenFilter(tokenStream);
[ecj-lint] ^^^^
[ecj-lint] Resource leak: 'tots' is never closed
[ecj-lint] ----------
[ecj-lint] 16. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 211)
[ecj-lint] Analyzer a2 = new WhitespaceAnalyzer();
[ecj-lint] ^^
[ecj-lint] Resource leak: 'a2' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 17. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/response/TestJavabinTupleStreamParser.java (at line 72)
[ecj-lint] JavabinTupleStreamParser parser = new JavabinTupleStreamParser(new ByteArrayInputStream(bytes), true);
[ecj-lint] ^^^^^^
[ecj-lint] Resource leak: 'parser' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 18. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/schema/TestSortableTextField.java (at line 491)
[ecj-lint] final SolrClient client = new EmbeddedSolrServer(h.getCore());
[ecj-lint] ^^^^^^
[ecj-lint] Resource leak: 'client' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 19. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 243)
[ecj-lint] return loadfactor!=0 ? new HashDocSet(a,0,n,1/loadfactor) : new HashDocSet(a,0,n);
[ecj-lint] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
[ecj-lint] ----------
[ecj-lint] 20. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 528)
[ecj-lint] DocSet a = new BitDocSet(bs);
[ecj-lint] ^
[ecj-lint] Resource leak: 'a' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 21. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 78)
[ecj-lint] final MockPKIAuthenticationPlugin mock = new MockPKIAuthenticationPlugin(null, nodeName);
[ecj-lint] ^^^^
[ecj-lint] Resource leak: 'mock' is never closed
[ecj-lint] ----------
[ecj-lint] 22. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 133)
[ecj-lint] MockPKIAuthenticationPlugin mock1 = new MockPKIAuthenticationPlugin(null, nodeName) {
[ecj-lint] ^^^^^
[ecj-lint] Resource leak: 'mock1' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 23. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestRuleBasedAuthorizationPlugin.java (at line 380)
[ecj-lint] RuleBasedAuthorizationPlugin plugin = new RuleBasedAuthorizationPlugin();
[ecj-lint] ^^^^^^
[ecj-lint] Resource leak: 'plugin' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 24. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestSha256AuthenticationProvider.java (at line 49)
[ecj-lint] BasicAuthPlugin basicAuthPlugin = new BasicAuthPlugin();
[ecj-lint] ^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: 'basicAuthPlugin' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 25. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/spelling/SimpleQueryConverter.java (at line 42)
[ecj-lint] WhitespaceAnalyzer analyzer = new WhitespaceAnalyzer();
[ecj-lint] ^^^^^^^^
[ecj-lint] Resource leak: 'analyzer' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 26. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 139)
[ecj-lint] IndexWriter w = new IndexWriter(d, newIndexWriterConfig(analyzer));
[ecj-lint] ^
[ecj-lint] Resource leak: 'w' is never closed
[ecj-lint] ----------
[ecj-lint] 27. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 172)
[ecj-lint] throw iae;
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'w' is not closed at this location
[ecj-lint] ----------
[ecj-lint] 28. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 178)
[ecj-lint] return;
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'w' is not closed at this location
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 29. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 134)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 30. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 333)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 31. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 367)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 32. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 413)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 33. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 458)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 34. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 516)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 35. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 181)
[ecj-lint] EmbeddedSolrServer server1 = new EmbeddedSolrServer(h.getCoreContainer(), "split1");
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'server1' is never closed
[ecj-lint] ----------
[ecj-lint] 36. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 182)
[ecj-lint] EmbeddedSolrServer server2 = new EmbeddedSolrServer(h.getCoreContainer(), "split2");
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'server2' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 37. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/processor/RecordingUpdateProcessorFactory.java (at line 67)
[ecj-lint] return recording ? new RecordingUpdateRequestProcessor(commandQueue, next) : next;
[ecj-lint] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
[ecj-lint] ----------
[ecj-lint] 37 problems (4 errors, 33 warnings)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:618: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:101: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build.xml:682: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:2087: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:2120: Compile failed; see the compiler error output for details.
Total time: 54 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-7.x - Build # 411 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/411/
5 tests failed.
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove
Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:45974/solr/MoveReplicaHDFSTest_failed_coll_true, https://127.0.0.1:35950/solr/MoveReplicaHDFSTest_failed_coll_true]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:45974/solr/MoveReplicaHDFSTest_failed_coll_true, https://127.0.0.1:35950/solr/MoveReplicaHDFSTest_failed_coll_true]
at __randomizedtesting.SeedInfo.seed([970B58BEEF65968B:3DC68B4C58B6435B]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:462)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:991)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:306)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:45974/solr/MoveReplicaHDFSTest_failed_coll_true: no servers hosting shard: shard2
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:436)
... 46 more
FAILED: org.apache.solr.cloud.TestTlogReplica.testRecovery
Error Message:
Can not find doc 8 in https://127.0.0.1:43387/solr
Stack Trace:
java.lang.AssertionError: Can not find doc 8 in https://127.0.0.1:43387/solr
at __randomizedtesting.SeedInfo.seed([970B58BEEF65968B:56FB2112C2355C2C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:885)
at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:599)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.api.collections.ShardSplitTest.test
Error Message:
shard1_0 is not consistent expected:<192> but was:<106>
Stack Trace:
java.lang.AssertionError: shard1_0 is not consistent expected:<192> but was:<106>
at __randomizedtesting.SeedInfo.seed([970B58BEEF65968B:1F5F67644199FB73]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.api.collections.ShardSplitTest.checkSubShardConsistency(ShardSplitTest.java:899)
at org.apache.solr.cloud.api.collections.ShardSplitTest.checkDocCountsAndShardStates(ShardSplitTest.java:853)
at org.apache.solr.cloud.api.collections.ShardSplitTest.splitByUniqueKeyTest(ShardSplitTest.java:659)
at org.apache.solr.cloud.api.collections.ShardSplitTest.test(ShardSplitTest.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([970B58BEEF65968B:2D076F31B08D40C4]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.junit.Assert.assertNull(Assert.java:562)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1585)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.io.graph.GraphTest
Error Message:
Could not load collection from ZK: collection1
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([2F58AAC49D811C57]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1108)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:647)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:137)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
at org.apache.solr.client.solrj.io.graph.GraphTest.setupCluster(GraphTest.java:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1215)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:340)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:340)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1120)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1106)
... 28 more
Build Log:
[...truncated 12616 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4] 2> 785935 INFO (SUITE-TriggerIntegrationTest-seed#[970B58BEEF65968B]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_970B58BEEF65968B-001/init-core-data-001
[junit4] 2> 785968 WARN (SUITE-TriggerIntegrationTest-seed#[970B58BEEF65968B]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 785968 INFO (SUITE-TriggerIntegrationTest-seed#[970B58BEEF65968B]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 785970 INFO (SUITE-TriggerIntegrationTest-seed#[970B58BEEF65968B]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 785970 INFO (SUITE-TriggerIntegrationTest-seed#[970B58BEEF65968B]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_970B58BEEF65968B-001/tempDir-001
[junit4] 2> 785970 INFO (SUITE-TriggerIntegrationTest-seed#[970B58BEEF65968B]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 785992 INFO (Thread-420) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 785992 INFO (Thread-420) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 786009 ERROR (Thread-420) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 786099 INFO (SUITE-TriggerIntegrationTest-seed#[970B58BEEF65968B]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:34658
[junit4] 2> 786155 INFO (zkConnectionManagerCallback-3478-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 786176 INFO (jetty-launcher-3475-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 786214 INFO (jetty-launcher-3475-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 786285 INFO (jetty-launcher-3475-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 786285 INFO (jetty-launcher-3475-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 786285 INFO (jetty-launcher-3475-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 786301 INFO (jetty-launcher-3475-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@603d296d{/solr,null,AVAILABLE}
[junit4] 2> 786303 INFO (jetty-launcher-3475-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3347f55{HTTP/1.1,[http/1.1]}{127.0.0.1:37834}
[junit4] 2> 786303 INFO (jetty-launcher-3475-thread-1) [ ] o.e.j.s.Server Started @797384ms
[junit4] 2> 786303 INFO (jetty-launcher-3475-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37834}
[junit4] 2> 786303 ERROR (jetty-launcher-3475-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 786303 INFO (jetty-launcher-3475-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 786303 INFO (jetty-launcher-3475-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 786303 INFO (jetty-launcher-3475-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 786303 INFO (jetty-launcher-3475-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-17T02:24:06.754Z
[junit4] 2> 786354 INFO (jetty-launcher-3475-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 786354 INFO (jetty-launcher-3475-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 786355 INFO (jetty-launcher-3475-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 786355 INFO (jetty-launcher-3475-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@111da581{/solr,null,AVAILABLE}
[junit4] 2> 786355 INFO (jetty-launcher-3475-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@71d1f7f8{HTTP/1.1,[http/1.1]}{127.0.0.1:44979}
[junit4] 2> 786355 INFO (jetty-launcher-3475-thread-2) [ ] o.e.j.s.Server Started @797437ms
[junit4] 2> 786355 INFO (jetty-launcher-3475-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44979}
[junit4] 2> 786356 ERROR (jetty-launcher-3475-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 786356 INFO (jetty-launcher-3475-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 786356 INFO (jetty-launcher-3475-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 786356 INFO (jetty-launcher-3475-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 786356 INFO (jetty-launcher-3475-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-17T02:24:06.807Z
[junit4] 2> 786370 INFO (zkConnectionManagerCallback-3480-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 786370 INFO (zkConnectionManagerCallback-3482-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 786371 INFO (jetty-launcher-3475-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 786375 INFO (jetty-launcher-3475-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 786480 INFO (jetty-launcher-3475-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34658/solr
[junit4] 2> 786520 INFO (zkConnectionManagerCallback-3486-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 786608 INFO (jetty-launcher-3475-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34658/solr
[junit4] 2> 786623 INFO (zkConnectionManagerCallback-3490-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 786663 INFO (zkConnectionManagerCallback-3492-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 786740 INFO (zkConnectionManagerCallback-3495-thread-1-processing-n:127.0.0.1:37834_solr) [n:127.0.0.1:37834_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 786791 INFO (jetty-launcher-3475-thread-1) [n:127.0.0.1:37834_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 786849 INFO (jetty-launcher-3475-thread-1) [n:127.0.0.1:37834_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37834_solr
[junit4] 2> 786886 INFO (jetty-launcher-3475-thread-1) [n:127.0.0.1:37834_solr ] o.a.s.c.Overseer Overseer (id=72134379120885766-127.0.0.1:37834_solr-n_0000000000) starting
[junit4] 2> 786923 INFO (jetty-launcher-3475-thread-1) [n:127.0.0.1:37834_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37834_solr
[junit4] 2> 786925 DEBUG (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 786959 DEBUG (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 786959 INFO (OverseerStateUpdate-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 786960 DEBUG (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:37834_solr]
[junit4] 2> 786960 DEBUG (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 786960 DEBUG (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 786994 DEBUG (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 787024 DEBUG (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 787044 DEBUG (ScheduledTrigger-1306-thread-1) [n:127.0.0.1:37834_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 787414 INFO (jetty-launcher-3475-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 787415 INFO (jetty-launcher-3475-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 787432 INFO (jetty-launcher-3475-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44979_solr
[junit4] 2> 787433 INFO (jetty-launcher-3475-thread-1) [n:127.0.0.1:37834_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37834.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 787469 INFO (jetty-launcher-3475-thread-1) [n:127.0.0.1:37834_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37834.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 787470 INFO (jetty-launcher-3475-thread-1) [n:127.0.0.1:37834_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37834.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 787473 INFO (zkCallback-3494-thread-1-processing-n:127.0.0.1:37834_solr) [n:127.0.0.1:37834_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 787483 INFO (jetty-launcher-3475-thread-1) [n:127.0.0.1:37834_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_970B58BEEF65968B-001/tempDir-001/node1/.
[junit4] 2> 787519 INFO (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 787753 INFO (jetty-launcher-3475-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44979.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 787789 INFO (jetty-launcher-3475-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44979.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 787790 INFO (jetty-launcher-3475-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44979.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 787807 INFO (jetty-launcher-3475-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_970B58BEEF65968B-001/tempDir-001/node2/.
[junit4] 2> 788022 INFO (zkConnectionManagerCallback-3500-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 788046 INFO (zkConnectionManagerCallback-3504-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 788047 INFO (SUITE-TriggerIntegrationTest-seed#[970B58BEEF65968B]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 788048 INFO (SUITE-TriggerIntegrationTest-seed#[970B58BEEF65968B]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34658/solr ready
[junit4] 2> 788120 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCooldown
[junit4] 2> 788123 INFO (qtp773745786-7579) [n:127.0.0.1:37834_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 788137 INFO (qtp773745786-7579) [n:127.0.0.1:37834_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=14
[junit4] 2> 788161 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
[junit4] 2> 788185 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
[junit4] 2> 788186 DEBUG (zkCallback-3494-thread-1-processing-n:127.0.0.1:37834_solr) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 788186 DEBUG (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 788186 DEBUG (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 788186 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@3347f55{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 788187 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=597558301
[junit4] 2> 788187 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 788201 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@44742def: rootName = solr_37834, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@719076bf
[junit4] 2> 788213 DEBUG (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 788214 DEBUG (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 788219 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 788219 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@f1b30ee: rootName = solr_37834, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@40d6d6a2
[junit4] 2> 788239 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 788239 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@15772333: rootName = solr_37834, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5fa2d900
[junit4] 2> 788240 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37834_solr
[junit4] 2> 788250 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 788250 INFO (zkCallback-3494-thread-1-processing-n:127.0.0.1:37834_solr) [n:127.0.0.1:37834_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 788250 INFO (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 788250 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 788250 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.Overseer Overseer (id=72134379120885766-127.0.0.1:37834_solr-n_0000000000) closing
[junit4] 2> 788251 INFO (OverseerStateUpdate-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37834_solr
[junit4] 2> 788251 WARN (OverseerAutoScalingTriggerThread-72134379120885766-127.0.0.1:37834_solr-n_0000000000) [n:127.0.0.1:37834_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 788265 INFO (zkCallback-3503-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 788266 DEBUG (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 788267 INFO (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44979_solr
[junit4] 2> 788267 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@603d296d{/solr,null,UNAVAILABLE}
[junit4] 2> 788267 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 788268 INFO (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.Overseer Overseer (id=72134379120885765-127.0.0.1:44979_solr-n_0000000001) starting
[junit4] 2> 788281 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 788299 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 788299 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44979_solr]
[junit4] 2> 788299 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion -1
[junit4] 2> 788299 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 788301 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 788301 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 788301 DEBUG (ScheduledTrigger-1315-thread-1) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 789302 DEBUG (ScheduledTrigger-1315-thread-1) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 790312 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 791317 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 792326 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 793285 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 793285 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 793285 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 793286 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 793286 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@38fe5940{/solr,null,AVAILABLE}
[junit4] 2> 793286 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@19594177{HTTP/1.1,[http/1.1]}{127.0.0.1:43312}
[junit4] 2> 793286 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.Server Started @804368ms
[junit4] 2> 793286 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43312}
[junit4] 2> 793287 ERROR (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 793287 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 793287 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 793287 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 793288 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-17T02:24:13.739Z
[junit4] 2> 793289 INFO (zkConnectionManagerCallback-3506-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 793289 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 793310 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34658/solr
[junit4] 2> 793332 INFO (zkConnectionManagerCallback-3510-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 793377 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 793406 INFO (zkConnectionManagerCallback-3512-thread-1-processing-n:127.0.0.1:43312_solr) [n:127.0.0.1:43312_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 793425 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:43312_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 793448 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:43312_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 793467 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:43312_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43312_solr
[junit4] 2> 793468 INFO (zkCallback-3503-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 793468 INFO (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 793510 INFO (zkCallback-3511-thread-1-processing-n:127.0.0.1:43312_solr) [n:127.0.0.1:43312_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 793699 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:43312_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43312.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 793737 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:43312_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43312.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 793737 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:43312_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43312.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 793755 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:43312_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_970B58BEEF65968B-001/tempDir-001/node3/.
[junit4] 2> 793978 INFO (qtp2038115069-7654) [n:127.0.0.1:43312_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 794022 INFO (qtp1903376971-7590) [n:127.0.0.1:44979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 794023 DEBUG (qtp2038115069-7651) [n:127.0.0.1:43312_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 794023 INFO (qtp2038115069-7651) [n:127.0.0.1:43312_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=82
[junit4] 2> 794073 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 794141 INFO (qtp2038115069-7656) [n:127.0.0.1:43312_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 794173 INFO (qtp1903376971-7596) [n:127.0.0.1:44979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 794175 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:44979_solr, 127.0.0.1:43312_solr]
[junit4] 2> 794175 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 794173 DEBUG (qtp1903376971-7594) [n:127.0.0.1:44979_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 794276 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44979_solr, 127.0.0.1:43312_solr]
[junit4] 2> 794276 INFO (qtp1903376971-7594) [n:127.0.0.1:44979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=167
[junit4] 2> 794277 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 794278 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 794281 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 794282 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:44979_solr, 127.0.0.1:43312_solr]
[junit4] 2> 794282 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 794282 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44979_solr, 127.0.0.1:43312_solr]
[junit4] 2> 794303 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 794303 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 794303 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 794304 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d6b1fa2{/solr,null,AVAILABLE}
[junit4] 2> 794304 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@a6c8515{HTTP/1.1,[http/1.1]}{127.0.0.1:38143}
[junit4] 2> 794304 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.Server Started @805386ms
[junit4] 2> 794304 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38143}
[junit4] 2> 794305 ERROR (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 794305 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 794305 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 794305 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 794305 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-17T02:24:14.756Z
[junit4] 2> 794281 INFO (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 794356 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 4
[junit4] 2> 794356 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 794356 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 794386 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 794387 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
[junit4] 2> 794431 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 794435 INFO (zkConnectionManagerCallback-3516-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 794436 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 794472 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34658/solr
[junit4] 2> 794475 INFO (zkConnectionManagerCallback-3520-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 794523 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10045d5eb98000d, likely client has closed socket
[junit4] 2> 794550 INFO (zkConnectionManagerCallback-3522-thread-1-processing-n:127.0.0.1:38143_solr) [n:127.0.0.1:38143_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 794584 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38143_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 794651 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38143_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 794654 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38143_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38143_solr
[junit4] 2> 794703 INFO (zkCallback-3511-thread-1-processing-n:127.0.0.1:43312_solr) [n:127.0.0.1:43312_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 794715 INFO (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 794748 INFO (zkCallback-3503-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 794759 INFO (zkCallback-3521-thread-1-processing-n:127.0.0.1:38143_solr) [n:127.0.0.1:38143_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 795023 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38143_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38143.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 795077 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38143_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38143.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 795077 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38143_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38143.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 795079 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38143_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_970B58BEEF65968B-001/tempDir-001/node4/.
[junit4] 2> 795442 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 795443 DEBUG (ScheduledTrigger-1315-thread-4) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
[junit4] 2> 795443 DEBUG (ScheduledTrigger-1315-thread-4) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 795443 DEBUG (ScheduledTrigger-1315-thread-4) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:38143_solr at time 1171656831491830
[junit4] 2> 796444 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 796444 DEBUG (ScheduledTrigger-1315-thread-1) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
[junit4] 2> 796444 DEBUG (ScheduledTrigger-1315-thread-1) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 796444 DEBUG (ScheduledTrigger-1315-thread-1) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger firing registered processor for nodes: [127.0.0.1:38143_solr] added at times [1171656831491830], now=1171657832400628
[junit4] 2> 796444 DEBUG (ScheduledTrigger-1315-thread-1) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"4299d9d3d5ef6T7liv5tp9g2xqcbuwz13qb5ebc",
[junit4] 2> "source":"node_added_cooldown_trigger",
[junit4] 2> "eventTime":1171656831491830,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1171656831491830],
[junit4] 2> "nodeNames":["127.0.0.1:38143_solr"]}}
[junit4] 2> 796445 DEBUG (ScheduledTrigger-1315-thread-1) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_cooldown_trigger]
[junit4] 2> 796445 INFO (ScheduledTrigger-1315-thread-1) [n:127.0.0.1:44979_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 796446 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"4299d9d3d5ef6T7liv5tp9g2xqcbuwz13qb5ebc",
[junit4] 2> "source":"node_added_cooldown_trigger",
[junit4] 2> "eventTime":1171656831491830,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1171656831491830],
[junit4] 2> "_enqueue_time_":1171657833332006,
[junit4] 2> "nodeNames":["127.0.0.1:38143_solr"]}}
[junit4] 2> 796448 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
[junit4] 2> 796448 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_cooldown_trigger after 5000ms
[junit4] 2> 796448 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 2 ms for event id=4299d9d3d5ef6T7liv5tp9g2xqcbuwz13qb5ebc
[junit4] 2> 797447 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 797448 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 797448 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 797448 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 797449 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3c3e33ed{/solr,null,AVAILABLE}
[junit4] 2> 797449 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@67bf1859{HTTP/1.1,[http/1.1]}{127.0.0.1:38069}
[junit4] 2> 797449 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.Server Started @808531ms
[junit4] 2> 797449 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38069}
[junit4] 2> 797450 ERROR (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 797450 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 797450 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 797450 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 797450 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-17T02:24:17.901Z
[junit4] 2> 797452 INFO (zkConnectionManagerCallback-3526-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 797452 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 797476 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34658/solr
[junit4] 2> 797477 INFO (zkConnectionManagerCallback-3530-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 797479 INFO (zkConnectionManagerCallback-3532-thread-1-processing-n:127.0.0.1:38069_solr) [n:127.0.0.1:38069_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 797484 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38069_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 797486 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38069_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 797488 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38069_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38069_solr
[junit4] 2> 797489 INFO (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 797489 INFO (zkCallback-3503-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 797489 INFO (zkCallback-3521-thread-1-processing-n:127.0.0.1:38143_solr) [n:127.0.0.1:38143_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 797489 INFO (zkCallback-3511-thread-1-processing-n:127.0.0.1:43312_solr) [n:127.0.0.1:43312_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 797497 INFO (zkCallback-3531-thread-1-processing-n:127.0.0.1:38069_solr) [n:127.0.0.1:38069_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 797574 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38069_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38069.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 797583 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38069_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38069.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 797583 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38069_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38069.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 797585 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:38069_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_970B58BEEF65968B-001/tempDir-001/node5/.
[junit4] 2> 801448 DEBUG (ScheduledTrigger-1315-thread-4) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
[junit4] 2> 801448 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
[junit4] 2> 801448 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
[junit4] 2> 801449 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:38069_solr at time 1171662837051359
[junit4] 2> 802449 DEBUG (ScheduledTrigger-1315-thread-4) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
[junit4] 2> 802449 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
[junit4] 2> 802450 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
[junit4] 2> 802450 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger firing registered processor for nodes: [127.0.0.1:38069_solr] added at times [1171662837051359], now=1171663838270543
[junit4] 2> 802450 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"4299f0332efdfT7liv5tp9g2xqcbuwz13qb5ebe",
[junit4] 2> "source":"node_added_cooldown_trigger",
[junit4] 2> "eventTime":1171662837051359,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1171662837051359],
[junit4] 2> "nodeNames":["127.0.0.1:38069_solr"]}}
[junit4] 2> 802450 DEBUG (ScheduledTrigger-1315-thread-2) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_cooldown_trigger]
[junit4] 2> 802451 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"4299f0332efdfT7liv5tp9g2xqcbuwz13qb5ebe",
[junit4] 2> "source":"node_added_cooldown_trigger",
[junit4] 2> "eventTime":1171662837051359,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1171662837051359],
[junit4] 2> "_enqueue_time_":1171663838486999,
[junit4] 2> "nodeNames":["127.0.0.1:38069_solr"]}}
[junit4] 2> 802451 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
[junit4] 2> 802451 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_cooldown_trigger after 5000ms
[junit4] 2> 802451 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=4299f0332efdfT7liv5tp9g2xqcbuwz13qb5ebe
[junit4] 2> 804520 INFO (qtp880080605-7706) [n:127.0.0.1:38069_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 804573 INFO (qtp198145829-7677) [n:127.0.0.1:38143_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 804601 INFO (qtp2038115069-7656) [n:127.0.0.1:43312_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 804629 INFO (qtp1903376971-7594) [n:127.0.0.1:44979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=19
[junit4] 2> 804630 DEBUG (qtp880080605-7702) [n:127.0.0.1:38069_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 804631 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 804631 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:44979_solr, 127.0.0.1:38143_solr, 127.0.0.1:43312_solr, 127.0.0.1:38069_solr]
[junit4] 2> 804631 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 804631 DEBUG (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44979_solr, 127.0.0.1:38143_solr, 127.0.0.1:43312_solr, 127.0.0.1:38069_solr]
[junit4] 2> 804631 INFO (qtp880080605-7702) [n:127.0.0.1:38069_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=159
[junit4] 2> 804637 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 804637 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: triggerCooldownPeriodSeconds from: 5 to: 7
[junit4] 2> 804638 DEBUG (OverseerAutoScalingTriggerThread-72134379120885765-127.0.0.1:44979_solr-n_0000000001) [n:127.0.0.1:44979_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 804639 INFO (qtp880080605-7704) [n:127.0.0.1:38069_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 804682 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 804747 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 804747 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 804747 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 804747 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1fbd71f6{/solr,null,AVAILABLE}
[junit4] 2> 804748 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4b39e695{HTTP/1.1,[http/1.1]}{127.0.0.1:34438}
[junit4] 2> 804748 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.Server Started @815829ms
[junit4] 2> 804748 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34438}
[junit4] 2> 804748 ERROR (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 804748 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 804748 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 804748 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 804749 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-17T02:24:25.200Z
[junit4] 2> 804775 INFO (zkConnectionManagerCallback-3536-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 804775 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 804809 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34658/solr
[junit4] 2> 804810 INFO (zkConnectionManagerCallback-3540-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 804824 INFO (zkConnectionManagerCallback-3542-thread-1-processing-n:127.0.0.1:34438_solr) [n:127.0.0.1:34438_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 804838 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:34438_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 804839 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:34438_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 804853 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:34438_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34438_solr
[junit4] 2> 804869 INFO (zkCallback-3491-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 804869 INFO (zkCallback-3521-thread-1-processing-n:127.0.0.1:38143_solr) [n:127.0.0.1:38143_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 804917 INFO (zkCallback-3541-thread-1-processing-n:127.0.0.1:34438_solr) [n:127.0.0.1:34438_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 804928 INFO (zkCallback-3511-thread-1-processing-n:127.0.0.1:43312_solr) [n:127.0.0.1:43312_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 804934 INFO (zkCallback-3531-thread-1-processing-n:127.0.0.1:38069_solr) [n:127.0.0.1:38069_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 804934 INFO (zkCallback-3503-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 805081 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:34438_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34438.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 805119 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:34438_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34438.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 805119 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:34438_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34438.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2501a069
[junit4] 2> 805137 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [n:127.0.0.1:34438_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_970B58BEEF65968B-001/tempDir-001/node6/.
[junit4] 2> 807452 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
[junit4] 2> 807452 DEBUG (ScheduledTrigger-1315-thread-1) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
[junit4] 2> 807452 DEBUG (ScheduledTrigger-1315-thread-1) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 5
[junit4] 2> 807452 DEBUG (ScheduledTrigger-1315-thread-1) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:34438_solr at time 1171668840376313
[junit4] 2> 808453 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
[junit4] 2> 808453 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
[junit4] 2> 808453 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 5
[junit4] 2> 808453 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger firing registered processor for nodes: [127.0.0.1:34438_solr] added at times [1171668840376313], now=1171669841425080
[junit4] 2> 808453 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"429a0690667f9T7liv5tp9g2xqcbuwz13qb5ebf",
[junit4] 2> "source":"node_added_cooldown_trigger",
[junit4] 2> "eventTime":1171668840376313,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1171668840376313],
[junit4] 2> "nodeNames":["127.0.0.1:34438_solr"]}}
[junit4] 2> 808453 DEBUG (ScheduledTrigger-1315-thread-3) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_cooldown_trigger]
[junit4] 2> 808458 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"429a0690667f9T7liv5tp9g2xqcbuwz13qb5ebf",
[junit4] 2> "source":"node_added_cooldown_trigger",
[junit4] 2> "eventTime":1171668840376313,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1171668840376313],
[junit4] 2> "_enqueue_time_":1171669841643691,
[junit4] 2> "nodeNames":["127.0.0.1:34438_solr"]}}
[junit4] 2> 808468 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 808484 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 7000ms
[junit4] 2> 808484 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_cooldown_trigger after 7000ms
[junit4] 2> 808484 DEBUG (AutoscalingActionExecutor-1316-thread-1-processing-n:127.0.0.1:44979_solr) [n:127.0.0.1:44979_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 26 ms for event id=429a0690667f9T7liv5tp9g2xqcbuwz13qb5ebf
[junit4] 2> 808507 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 808507 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 808507 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 808508 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@133d160e{/solr,null,AVAILABLE}
[junit4] 2> 808508 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[970B58BEEF65968B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@216dfc7d{HTTP/1.1,[http/1.1]}{127.0.0.1:41709}
[j
[...truncated too long message...]
ion1_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard2.leader, tag=1958625687
[junit4] 2> 307801 INFO (zkCallback-276-thread-1-processing-n:127.0.0.1:43393_solr) [n:127.0.0.1:43393_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [0])
[junit4] 2> 307801 INFO (zkCallback-276-thread-2-processing-n:127.0.0.1:43393_solr) [n:127.0.0.1:43393_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [0])
[junit4] 2> 307868 INFO (zkCallback-278-thread-1-processing-n:127.0.0.1:43624_solr) [n:127.0.0.1:43624_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [0])
[junit4] 2> 307868 INFO (zkCallback-278-thread-2-processing-n:127.0.0.1:43624_solr) [n:127.0.0.1:43624_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [0])
[junit4] 2> 308106 INFO (jetty-closer-261-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72134672723410949-127.0.0.1:43393_solr-n_0000000000) closing
[junit4] 2> 308125 INFO (OverseerStateUpdate-72134672723410949-127.0.0.1:43393_solr-n_0000000000) [n:127.0.0.1:43393_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43393_solr
[junit4] 2> 308150 WARN (OverseerAutoScalingTriggerThread-72134672723410949-127.0.0.1:43393_solr-n_0000000000) [n:127.0.0.1:43393_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 308369 WARN (ScheduledTrigger-609-thread-3) [n:127.0.0.1:43393_solr ] o.a.s.c.a.TriggerBase Exception updating trigger state '/autoscaling/triggerState/.auto_add_replicas'
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:502)
[junit4] 2> at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1409)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1100)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$exists$3(SolrZkClient.java:316)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:316)
[junit4] 2> at org.apache.solr.client.solrj.impl.ZkDistribStateManager.hasData(ZkDistribStateManager.java:58)
[junit4] 2> at org.apache.solr.cloud.autoscaling.TriggerBase.saveState(TriggerBase.java:203)
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers$ScheduledTrigger.run(ScheduledTriggers.java:573)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 308426 INFO (jetty-closer-261-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4b8b9904{/solr,null,UNAVAILABLE}
[junit4] 2> 308499 INFO (jetty-closer-261-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 308653 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100461a47ab0005, likely client has closed socket
[junit4] 2> 308727 INFO (jetty-closer-261-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@219aaf6b{/solr,null,UNAVAILABLE}
[junit4] 2> 308775 INFO (jetty-closer-261-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 308792 ERROR (SUITE-GraphTest-seed#[2F58AAC49D811C57]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 308812 INFO (SUITE-GraphTest-seed#[2F58AAC49D811C57]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35284 35284
[junit4] 2> 308905 INFO (Thread-268) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35284 35284
[junit4] 2> 308911 WARN (Thread-268) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 4 /solr/clusterprops.json
[junit4] 2> 2 /solr/collections/collection1/terms/shard2
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/configs/conf
[junit4] 2> 2 /solr/collections/collection1/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 14 /solr/collections/collection1/state.json
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 4 /solr/collections
[junit4] 2>
[junit4] 2> 308911 INFO (SUITE-GraphTest-seed#[2F58AAC49D811C57]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Feb 17, 2018 3:39:03 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1437, maxMBSortInHeap=6.763181669371344, sim=RandomSimilarity(queryNorm=true): {}, locale=pl-PL, timezone=America/Tortola
[junit4] 2> NOTE: Linux 4.4.0-112-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=192587064,total=490209280
[junit4] 2> NOTE: All tests run in this JVM: [TestHash, SineEvaluatorTest, SolrParamTest, UuidEvaluatorTest, GetByIdTest, LargeVolumeJettyTest, ArcCosineEvaluatorTest, HttpSolrClientBuilderTest, SolrExceptionTest, TestJsonRecordReader, TangentEvaluatorTest, TestSuggesterResponse, JettyWebappTest, TestJavaBinCodec, HyperbolicSineEvaluatorTest, TestCoreAdmin, LessThanEqualToEvaluatorTest, SolrExampleXMLTest, RegressionEvaluatorTest, TestCloudSolrClientConnections, SolrExampleBinaryTest, StreamExpressionToExplanationTest, CloudSolrClientBuilderTest, AddEvaluatorTest, QueryResponseTest, ContentStreamTest, ModifiableSolrParamsTest, DocumentAnalysisResponseTest, TestUpdateRequestCodec, NamedListTest, FacetFieldTest, CollectionAdminRequestRequiredParamsTest, TestLBHttpSolrClient, CloudSolrClientCacheTest, ConcurrentUpdateSolrClientBuilderTest, HttpSolrClientConPoolTest, HttpSolrClientSSLAuthConPoolTest, LBHttpSolrClientBuilderTest, GraphExpressionTest, GraphTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=GraphTest -Dtests.seed=2F58AAC49D811C57 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=pl-PL -Dtests.timezone=America/Tortola -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J2 | GraphTest (suite) <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
[junit4] > at __randomizedtesting.SeedInfo.seed([2F58AAC49D811C57]:0)
[junit4] > at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1108)
[junit4] > at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:647)
[junit4] > at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:137)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
[junit4] > at org.apache.solr.client.solrj.io.graph.GraphTest.setupCluster(GraphTest.java:63)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
[junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
[junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] > at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1215)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:340)
[junit4] > at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:340)
[junit4] > at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1120)
[junit4] > at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1106)
[junit4] > ... 28 more
[junit4] Completed [102/146 (1!)] on J2 in 17.81s, 0 tests, 1 error <<< FAILURES!
[...truncated 47698 lines...]
[JENKINS] Lucene-Solr-Tests-7.x - Build # 410 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/410/
2 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple
Error Message:
Waiting for collection testSimple1 null Live Nodes: [127.0.0.1:41745_solr, 127.0.0.1:48475_solr] Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/18)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{ "core_node5":{ "core":"testSimple1_shard1_replica_n2", "base_url":"http://127.0.0.1:41745/solr", "node_name":"127.0.0.1:41745_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node12":{ "core":"testSimple1_shard1_replica_n11", "base_url":"http://127.0.0.1:41745/solr", "node_name":"127.0.0.1:41745_solr", "state":"active", "type":"NRT"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{ "core_node8":{ "core":"testSimple1_shard2_replica_n6", "base_url":"http://127.0.0.1:41745/solr", "node_name":"127.0.0.1:41745_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node10":{ "core":"testSimple1_shard2_replica_n9", "base_url":"http://127.0.0.1:43612/solr", "node_name":"127.0.0.1:43612_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"2", "autoAddReplicas":"true", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple1
null
Live Nodes: [127.0.0.1:41745_solr, 127.0.0.1:48475_solr]
Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/18)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{
"core_node5":{
"core":"testSimple1_shard1_replica_n2",
"base_url":"http://127.0.0.1:41745/solr",
"node_name":"127.0.0.1:41745_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node12":{
"core":"testSimple1_shard1_replica_n11",
"base_url":"http://127.0.0.1:41745/solr",
"node_name":"127.0.0.1:41745_solr",
"state":"active",
"type":"NRT"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{
"core_node8":{
"core":"testSimple1_shard2_replica_n6",
"base_url":"http://127.0.0.1:41745/solr",
"node_name":"127.0.0.1:41745_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node10":{
"core":"testSimple1_shard2_replica_n9",
"base_url":"http://127.0.0.1:43612/solr",
"node_name":"127.0.0.1:43612_solr",
"state":"down",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"true",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([9ECF92D91AE97F9:315FDDD3B65D4328]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost
Error Message:
The operations computed by ComputePlanAction should not be null SolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
Stack Trace:
java.lang.AssertionError: The operations computed by ComputePlanAction should not be null SolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
at __randomizedtesting.SeedInfo.seed([9ECF92D91AE97F9:392C18AF19DC76A5]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost(ComputePlanActionTest.java:291)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12476 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[junit4] 2> 401921 INFO (SUITE-ComputePlanActionTest-seed#[9ECF92D91AE97F9]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_9ECF92D91AE97F9-001/init-core-data-001
[junit4] 2> 401922 WARN (SUITE-ComputePlanActionTest-seed#[9ECF92D91AE97F9]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=16 numCloses=16
[junit4] 2> 401922 INFO (SUITE-ComputePlanActionTest-seed#[9ECF92D91AE97F9]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 401923 INFO (SUITE-ComputePlanActionTest-seed#[9ECF92D91AE97F9]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 401924 INFO (SUITE-ComputePlanActionTest-seed#[9ECF92D91AE97F9]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_9ECF92D91AE97F9-001/tempDir-001
[junit4] 2> 401924 INFO (SUITE-ComputePlanActionTest-seed#[9ECF92D91AE97F9]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 401924 INFO (Thread-1161) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 401924 INFO (Thread-1161) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 401926 ERROR (Thread-1161) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 402024 INFO (SUITE-ComputePlanActionTest-seed#[9ECF92D91AE97F9]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:56387
[junit4] 2> 402026 INFO (zkConnectionManagerCallback-638-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402031 INFO (jetty-launcher-635-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 402034 INFO (jetty-launcher-635-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 402034 INFO (jetty-launcher-635-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 402034 INFO (jetty-launcher-635-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 402035 INFO (jetty-launcher-635-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@11c2fb59{/solr,null,AVAILABLE}
[junit4] 2> 402036 INFO (jetty-launcher-635-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@64222e84{SSL,[ssl, http/1.1]}{127.0.0.1:35465}
[junit4] 2> 402036 INFO (jetty-launcher-635-thread-1) [ ] o.e.j.s.Server Started @404674ms
[junit4] 2> 402036 INFO (jetty-launcher-635-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35465}
[junit4] 2> 402038 ERROR (jetty-launcher-635-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 402038 INFO (jetty-launcher-635-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 402038 INFO (jetty-launcher-635-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 402038 INFO (jetty-launcher-635-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 402038 INFO (jetty-launcher-635-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T21:14:13.030Z
[junit4] 2> 402044 INFO (zkConnectionManagerCallback-640-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402044 INFO (jetty-launcher-635-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 402054 INFO (jetty-launcher-635-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56387/solr
[junit4] 2> 402058 INFO (zkConnectionManagerCallback-644-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402060 INFO (zkConnectionManagerCallback-646-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402142 INFO (jetty-launcher-635-thread-1) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 402143 INFO (jetty-launcher-635-thread-1) [n:127.0.0.1:35465_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35465_solr
[junit4] 2> 402144 INFO (jetty-launcher-635-thread-1) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer Overseer (id=73307205718179843-127.0.0.1:35465_solr-n_0000000000) starting
[junit4] 2> 402148 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 402149 INFO (jetty-launcher-635-thread-1) [n:127.0.0.1:35465_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35465_solr
[junit4] 2> 402149 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 402150 INFO (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 402150 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 402158 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:35465_solr]
[junit4] 2> 402158 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 402158 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 402159 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 402159 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 402159 DEBUG (ScheduledTrigger-1503-thread-1) [n:127.0.0.1:35465_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 402201 INFO (jetty-launcher-635-thread-1) [n:127.0.0.1:35465_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35465.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@611ea94f
[junit4] 2> 402208 INFO (jetty-launcher-635-thread-1) [n:127.0.0.1:35465_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35465.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@611ea94f
[junit4] 2> 402208 INFO (jetty-launcher-635-thread-1) [n:127.0.0.1:35465_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35465.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@611ea94f
[junit4] 2> 402209 INFO (jetty-launcher-635-thread-1) [n:127.0.0.1:35465_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_9ECF92D91AE97F9-001/tempDir-001/node1/.
[junit4] 2> 402223 INFO (zkConnectionManagerCallback-650-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402226 INFO (zkConnectionManagerCallback-654-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402227 INFO (SUITE-ComputePlanActionTest-seed#[9ECF92D91AE97F9]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 402227 INFO (SUITE-ComputePlanActionTest-seed#[9ECF92D91AE97F9]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:56387/solr ready
[junit4] 2> 402238 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLost
[junit4] 2> 402238 DEBUG (zkCallback-645-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 402239 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 402240 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 402241 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 402241 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 402242 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 402276 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 402278 DEBUG (qtp859049410-3827) [n:127.0.0.1:35465_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 402286 DEBUG (zkCallback-645-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 402286 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 402286 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 402286 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 402286 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 402286 INFO (qtp859049410-3827) [n:127.0.0.1:35465_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=20
[junit4] 2> 402290 INFO (qtp859049410-3821) [n:127.0.0.1:35465_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 402290 DEBUG (qtp859049410-3823) [n:127.0.0.1:35465_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 402291 INFO (qtp859049410-3823) [n:127.0.0.1:35465_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 402291 DEBUG (zkCallback-645-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 402293 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 402293 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 402293 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 402293 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 402295 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 402296 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 402296 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 402296 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 402296 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1517153c{/solr,null,AVAILABLE}
[junit4] 2> 402297 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@69eeeea7{SSL,[ssl, http/1.1]}{127.0.0.1:33061}
[junit4] 2> 402297 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.Server Started @404935ms
[junit4] 2> 402297 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33061}
[junit4] 2> 402297 ERROR (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 402297 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 402297 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 402297 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 402297 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T21:14:13.289Z
[junit4] 2> 402299 INFO (zkConnectionManagerCallback-657-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402299 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 402306 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56387/solr
[junit4] 2> 402307 INFO (zkConnectionManagerCallback-661-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402309 INFO (zkConnectionManagerCallback-663-thread-1-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402313 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 402314 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:33061_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 402315 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:33061_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33061_solr
[junit4] 2> 402316 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:33061_solr"} current state version: 0
[junit4] 2> 402316 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:33061_solr
[junit4] 2> 402316 INFO (zkCallback-645-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 402329 INFO (zkCallback-653-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 402330 INFO (zkCallback-653-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 402330 INFO (zkCallback-662-thread-1-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 402420 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:33061_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33061.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@611ea94f
[junit4] 2> 402429 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:33061_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33061.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@611ea94f
[junit4] 2> 402429 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:33061_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33061.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@611ea94f
[junit4] 2> 402430 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:33061_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_9ECF92D91AE97F9-001/tempDir-001/node2/.
[junit4] 2> 402489 INFO (qtp466262365-3858) [n:127.0.0.1:33061_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 402492 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 402493 DEBUG (qtp466262365-3861) [n:127.0.0.1:33061_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 402493 INFO (qtp466262365-3861) [n:127.0.0.1:33061_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=9
[junit4] 2> 402493 DEBUG (zkCallback-645-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 402495 DEBUG (zkCallback-645-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33061_solr, 127.0.0.1:35465_solr]
[junit4] 2> 402495 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 402496 INFO (qtp466262365-3863) [n:127.0.0.1:33061_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=testNodeLost&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 402497 DEBUG (ScheduledTrigger-1503-thread-1) [n:127.0.0.1:35465_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 402501 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 402502 DEBUG (OverseerAutoScalingTriggerThread-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 402505 INFO (OverseerThreadFactory-1505-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testNodeLost
[junit4] 2> 402514 INFO (qtp466262365-3861) [n:127.0.0.1:33061_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 402518 INFO (qtp859049410-3827) [n:127.0.0.1:35465_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 402526 INFO (OverseerThreadFactory-1505-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 19067561640 sessionWrapper.createTime 19067561633051902, this.sessionWrapper.createTime 19067561633051902
[junit4] 2> 402530 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"testNodeLost",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf",
[junit4] 2> "numShards":"1",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 402530 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: testNodeLost
[junit4] 2> 402530 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/testNodeLost/state.json
[junit4] 2> 402632 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 402632 INFO (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 402633 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{}}
[junit4] 2> 402633 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 402633 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33061/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 402633 INFO (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33061/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 402634 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 402634 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:33061/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 402734 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 0
[junit4] 2> 402841 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n2&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 402842 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 402842 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 402842 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 402846 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:33061/solr",
[junit4] 2> "node_name":"127.0.0.1:33061_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 402846 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:33061/solr",
[junit4] 2> "node_name":"127.0.0.1:33061_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 402847 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeLost_shard1_replica_n2","base_url":"https://127.0.0.1:33061/solr","node_name":"127.0.0.1:33061_solr","state":"down","type":"NRT"}
[junit4] 2> 402847 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:33061/solr",
[junit4] 2> "node_name":"127.0.0.1:33061_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 402847 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "node_name":"127.0.0.1:35465_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 402847 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "node_name":"127.0.0.1:35465_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 402847 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"testNodeLost_shard1_replica_n1","base_url":"https://127.0.0.1:35465/solr","node_name":"127.0.0.1:35465_solr","state":"down","type":"NRT"}
[junit4] 2> 402847 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "node_name":"127.0.0.1:35465_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:33061/solr",
[junit4] 2> "node_name":"127.0.0.1:33061_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 402947 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 1
[junit4] 2> 402948 INFO (zkCallback-662-thread-1-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 402948 INFO (zkCallback-645-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 402949 INFO (zkCallback-662-thread-2-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 402950 INFO (zkCallback-645-thread-2-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 403498 DEBUG (ScheduledTrigger-1503-thread-2) [n:127.0.0.1:35465_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 403857 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 403858 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 403864 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.IndexSchema [testNodeLost_shard1_replica_n2] Schema name=minimal
[junit4] 2> 403864 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.IndexSchema [testNodeLost_shard1_replica_n1] Schema name=minimal
[junit4] 2> 403867 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 403867 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 403867 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testNodeLost_shard1_replica_n2' using configuration from collection testNodeLost, trusted=true
[junit4] 2> 403867 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testNodeLost_shard1_replica_n1' using configuration from collection testNodeLost, trusted=true
[junit4] 2> 403874 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33061.solr.core.testNodeLost.shard1.replica_n2' (registry 'solr.core.testNodeLost.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@611ea94f
[junit4] 2> 403874 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35465.solr.core.testNodeLost.shard1.replica_n1' (registry 'solr.core.testNodeLost.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@611ea94f
[junit4] 2> 403874 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 403874 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 403874 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrCore [[testNodeLost_shard1_replica_n2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_9ECF92D91AE97F9-001/tempDir-001/node2/testNodeLost_shard1_replica_n2], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_9ECF92D91AE97F9-001/tempDir-001/node2/./testNodeLost_shard1_replica_n2/data/]
[junit4] 2> 403875 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore [[testNodeLost_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_9ECF92D91AE97F9-001/tempDir-001/node1/testNodeLost_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_9ECF92D91AE97F9-001/tempDir-001/node1/./testNodeLost_shard1_replica_n1/data/]
[junit4] 2> 403936 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 403936 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 403937 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 403937 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 403939 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@481b3ceb[testNodeLost_shard1_replica_n1] main]
[junit4] 2> 403941 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 403948 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 403948 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 403948 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 403949 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 403949 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592593644195414016
[junit4] 2> 403949 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 403949 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 403951 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@39155023[testNodeLost_shard1_replica_n2] main]
[junit4] 2> 403952 INFO (searcherExecutor-1515-thread-1-processing-n:127.0.0.1:35465_solr x:testNodeLost_shard1_replica_n1 s:shard1 c:testNodeLost r:core_node3) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n1] Registered new searcher Searcher@481b3ceb[testNodeLost_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 403955 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 403966 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 403967 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 403967 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592593644214288384
[junit4] 2> 403970 INFO (searcherExecutor-1514-thread-1-processing-n:127.0.0.1:33061_solr x:testNodeLost_shard1_replica_n2 s:shard1 c:testNodeLost r:core_node4) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n2] Registered new searcher Searcher@39155023[testNodeLost_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 403972 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 403972 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost"} current state version: 0
[junit4] 2> 404072 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 2
[junit4] 2> 404073 INFO (zkCallback-645-thread-2-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 404073 INFO (zkCallback-662-thread-2-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 404073 INFO (zkCallback-645-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 404073 INFO (zkCallback-662-thread-1-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 404472 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 404472 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 404472 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:35465/solr/testNodeLost_shard1_replica_n1/
[junit4] 2> 404473 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testNodeLost_shard1_replica_n1 url=https://127.0.0.1:35465/solr START replicas=[https://127.0.0.1:33061/solr/testNodeLost_shard1_replica_n2/] nUpdates=100
[junit4] 2> 404478 INFO (qtp466262365-3858) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.S.Request [testNodeLost_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 404498 DEBUG (ScheduledTrigger-1503-thread-2) [n:127.0.0.1:35465_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 404773 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testNodeLost_shard1_replica_n1 url=https://127.0.0.1:35465/solr DONE. We have no versions. sync failed.
[junit4] 2> 404773 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 404773 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 404773 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 404775 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:35465/solr/testNodeLost_shard1_replica_n1/ shard1
[junit4] 2> 404776 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "state":"active"} current state version: 0
[junit4] 2> 404876 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 3
[junit4] 2> 404877 INFO (zkCallback-662-thread-2-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 404877 INFO (zkCallback-662-thread-1-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 404877 INFO (zkCallback-645-thread-3-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 404877 INFO (zkCallback-645-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 404926 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 404927 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "node_name":"127.0.0.1:35465_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 404928 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "node_name":"127.0.0.1:35465_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 404928 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"testNodeLost_shard1_replica_n1","base_url":"https://127.0.0.1:35465/solr","node_name":"127.0.0.1:35465_solr","state":"active","type":"NRT","leader":"true"}
[junit4] 2> 404928 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/4)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "node_name":"127.0.0.1:35465_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:33061/solr",
[junit4] 2> "node_name":"127.0.0.1:33061_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 404928 INFO (qtp859049410-3822) [n:127.0.0.1:35465_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2085
[junit4] 2> 404979 INFO (qtp466262365-3864) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n2&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2137
[junit4] 2> 404979 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:33061/solr",
[junit4] 2> "node_name":"127.0.0.1:33061_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 404979 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:33061/solr",
[junit4] 2> "node_name":"127.0.0.1:33061_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testNodeLost",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 404979 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeLost_shard1_replica_n2","base_url":"https://127.0.0.1:33061/solr","node_name":"127.0.0.1:33061_solr","state":"active","type":"NRT"}
[junit4] 2> 404980 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/4)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:35465/solr",
[junit4] 2> "node_name":"127.0.0.1:35465_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testNodeLost_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:33061/solr",
[junit4] 2> "node_name":"127.0.0.1:33061_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 404981 INFO (qtp466262365-3863) [n:127.0.0.1:33061_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 405080 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 4
[junit4] 2> 405081 INFO (zkCallback-662-thread-1-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 405081 INFO (zkCallback-645-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 405081 INFO (zkCallback-645-thread-3-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 405081 INFO (zkCallback-662-thread-2-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 405499 DEBUG (ScheduledTrigger-1503-thread-2) [n:127.0.0.1:35465_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 405981 INFO (qtp466262365-3863) [n:127.0.0.1:33061_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=testNodeLost&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3485
[junit4] 2> 405985 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 405986 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 405986 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 405986 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 405986 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5c991238{/solr,null,AVAILABLE}
[junit4] 2> 405987 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7210332d{SSL,[ssl, http/1.1]}{127.0.0.1:55470}
[junit4] 2> 405987 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.Server Started @408625ms
[junit4] 2> 405987 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=55470}
[junit4] 2> 405987 ERROR (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 405987 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 405987 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 405987 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 405987 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T21:14:16.979Z
[junit4] 2> 405992 INFO (zkConnectionManagerCallback-667-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 405993 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 406000 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56387/solr
[junit4] 2> 406003 INFO (zkConnectionManagerCallback-671-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 406006 INFO (zkConnectionManagerCallback-673-thread-1-processing-n:127.0.0.1:55470_solr) [n:127.0.0.1:55470_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 406009 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:55470_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 406010 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:55470_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 406011 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:55470_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55470_solr
[junit4] 2> 406011 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:55470_solr"} current state version: 0
[junit4] 2> 406011 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:55470_solr
[junit4] 2> 406012 INFO (zkCallback-662-thread-2-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 406012 INFO (zkCallback-645-thread-3-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 406021 INFO (zkCallback-653-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 406021 INFO (zkCallback-653-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 406029 INFO (zkCallback-672-thread-1-processing-n:127.0.0.1:55470_solr) [n:127.0.0.1:55470_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 406072 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:55470_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_55470.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@611ea94f
[junit4] 2> 406080 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:55470_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_55470.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@611ea94f
[junit4] 2> 406080 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:55470_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_55470.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@611ea94f
[junit4] 2> 406082 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [n:127.0.0.1:55470_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ComputePlanActionTest_9ECF92D91AE97F9-001/tempDir-001/node3/.
[junit4] 2> 406114 INFO (zkConnectionManagerCallback-677-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 406117 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@69eeeea7{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 406117 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1997009962
[junit4] 2> 406118 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 406118 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@391a56e2: rootName = solr_33061, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@c9958a7
[junit4] 2> 406124 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 406124 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@752cf2ca: rootName = solr_33061, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@358cd1eb
[junit4] 2> 406128 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 406128 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1633dd3d: rootName = solr_33061, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2ebecf26
[junit4] 2> 406129 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33061_solr
[junit4] 2> 406130 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:33061_solr"} current state version: 0
[junit4] 2> 406130 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:33061_solr
[junit4] 2> 406130 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.NodeMutator Update replica state for core_node4:{"core":"testNodeLost_shard1_replica_n2","base_url":"https://127.0.0.1:33061/solr","node_name":"127.0.0.1:33061_solr","state":"active","type":"NRT"} to down
[junit4] 2> 406130 INFO (zkCallback-653-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 406130 INFO (zkCallback-672-thread-1-processing-n:127.0.0.1:55470_solr) [n:127.0.0.1:55470_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 406130 INFO (zkCallback-653-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 406131 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 406131 INFO (zkCallback-645-thread-3-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 406131 INFO (zkCallback-662-thread-2-processing-n:127.0.0.1:33061_solr) [n:127.0.0.1:33061_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 406132 INFO (coreCloseExecutor-1530-thread-1) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@5b4ef7f5
[junit4] 2> 406132 INFO (coreCloseExecutor-1530-thread-1) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testNodeLost.shard1.replica_n2, tag=1531901941
[junit4] 2> 406132 INFO (coreCloseExecutor-1530-thread-1) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5825c19f: rootName = solr_33061, domain = solr.core.testNodeLost.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.testNodeLost.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@78d03f9a
[junit4] 2> 406139 INFO (coreCloseExecutor-1530-thread-1) [n:127.0.0.1:33061_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testNodeLost.shard1.leader, tag=1531901941
[junit4] 2> 406144 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1517153c{/solr,null,UNAVAILABLE}
[junit4] 2> 406144 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 406145 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[9ECF92D91AE97F9]) [ ] o.a.s.c.a.ComputePlanActionTest Stopped_node : 127.0.0.1:33061_solr
[junit4] 2> 406146 INFO (zkConnectionManagerCallback-679-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 406230 DEBUG (OverseerStateUpdate-73307205718179843-127.0.0.1:35465_solr-n_0000000000) [n:127.0.0.1:35465_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 5
[junit4] 2> 406231 INFO (zkCallback-645-thread-3-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 406231 INFO (zkCallback-645-thread-1-processing-n:127.0.0.1:35465_solr) [n:127.0.0.1:35465_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2])
[junit4] 2> 406499 DEBUG (ScheduledTrigger-1503-thread-2) [n:127.0.0.1:35465_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_tr
[...truncated too long message...]
gistry@7540f5e9
[junit4] 2> 2204419 INFO (coreCloseExecutor-8803-thread-3) [n:127.0.0.1:41745_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple2.shard1.leader, tag=1690920408
[junit4] 2> 2204419 INFO (coreCloseExecutor-8803-thread-5) [n:127.0.0.1:41745_solr c:testSimple1 s:shard1 r:core_node12 x:testSimple1_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard1.leader, tag=1668020301
[junit4] 2> 2204420 INFO (jetty-closer-4706-thread-2) [ ] o.a.s.c.Overseer Overseer (id=73307314591105033-127.0.0.1:41745_solr-n_0000000000) closing
[junit4] 2> 2204421 INFO (OverseerStateUpdate-73307314591105033-127.0.0.1:41745_solr-n_0000000000) [n:127.0.0.1:41745_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41745_solr
[junit4] 2> 2204421 WARN (OverseerAutoScalingTriggerThread-73307314591105033-127.0.0.1:41745_solr-n_0000000000) [n:127.0.0.1:41745_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2204423 DEBUG (jetty-closer-4706-thread-2) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 2204424 INFO (jetty-closer-4706-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@70fd06c2{/solr,null,UNAVAILABLE}
[junit4] 2> 2204425 INFO (jetty-closer-4706-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2204426 ERROR (SUITE-AutoAddReplicasIntegrationTest-seed#[9ECF92D91AE97F9]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2204426 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[9ECF92D91AE97F9]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42077 42077
[junit4] 2> 2204646 INFO (Thread-5703) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42077 42077
[junit4] 2> 2204648 WARN (Thread-5703) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/collections/testSimple1/terms/shard2
[junit4] 2> 6 /solr/collections/testSimple1/terms/shard1
[junit4] 2> 5 /solr/collections/testSimple2/terms/shard2
[junit4] 2> 5 /solr/collections/testSimple2/terms/shard1
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/configs/conf
[junit4] 2> 3 /solr/collections/testSimple3/terms/shard3
[junit4] 2> 3 /solr/collections/testSimple3/terms/shard2
[junit4] 2> 3 /solr/collections/testSimple3/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 38 /solr/collections/testSimple1/state.json
[junit4] 2> 29 /solr/collections/testSimple2/state.json
[junit4] 2> 13 /solr/collections/testSimple3/state.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 4 /solr/clusterprops.json
[junit4] 2> 3 /solr/overseer_elect/election/73307314591105033-127.0.0.1:41745_solr-n_0000000000
[junit4] 2> 2 /solr/collections/testSimple1/leader_elect/shard1/election/73307314591105033-core_node5-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 5 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_9ECF92D91AE97F9-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=true): {}, locale=el, timezone=America/Resolute
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=162179448,total=521142272
[junit4] 2> NOTE: All tests run in this JVM: [FullSolrCloudDistribCmdsTest, TestSolrCloudSnapshots, DistributedQueryComponentCustomSortTest, SuggesterWFSTTest, TestExecutePlanAction, ZkCLITest, TestLegacyNumericRangeQueryBuilder, TestRandomCollapseQParserPlugin, TestCollapseQParserPlugin, JSONWriterTest, EchoParamsTest, FacetPivotSmallTest, TestOmitPositions, SparseHLLTest, DirectUpdateHandlerTest, TestReplicationHandlerBackup, ShardRoutingTest, TestConfig, SpatialRPTFieldTypeTest, TestSlowCompositeReaderWrapper, TolerantUpdateProcessorTest, TestDefaultStatsCache, TestConfigSetProperties, TestCollectionAPIs, CustomCollectionTest, CoreAdminRequestStatusTest, FullHLLTest, TestExactStatsCache, TestSimDistributedQueue, ChangedSchemaMergeTest, DocValuesMissingTest, TestNodeAddedTrigger, TestIBSimilarityFactory, SolrCoreMetricManagerTest, FieldAnalysisRequestHandlerTest, TestUtilizeNode, BadIndexSchemaTest, UtilsToolTest, TestCSVLoader, CdcrBidirectionalTest, TestNonDefinedSimilarityFactory, SolrMetricsIntegrationTest, TestGraphTermsQParserPlugin, DefaultValueUpdateProcessorTest, XmlUpdateRequestHandlerTest, TestFastOutputStream, TestSolrCoreParser, TestSchemaSimilarityResource, ChaosMonkeyNothingIsSafeTest, TestImplicitCoreProperties, TestSimpleTextCodec, DistributedTermsComponentTest, TestRandomFaceting, HdfsRecoverLeaseTest, BlockJoinFacetRandomTest, TestJsonFacets, TestStressLucene, BlobRepositoryCloudTest, SolrJmxReporterCloudTest, TestConfigReload, TestManagedSynonymGraphFilterFactory, TestJoin, OverseerModifyCollectionTest, ExitableDirectoryReaderTest, CollectionsAPIAsyncDistributedZkTest, CheckHdfsIndexTest, CursorPagingTest, TestRandomFlRTGCloud, DistributedFacetExistsSmallTest, TestWriterPerf, TestClusterStateProvider, TestSolrCloudWithDelegationTokens, SimpleFacetsTest, TestGraphMLResponseWriter, SolrPluginUtilsTest, TestHashPartitioner, TestShortCircuitedRequests, TestDocumentBuilder, ConfigureRecoveryStrategyTest, TestManagedResourceStorage, OpenExchangeRatesOrgProviderTest, TestHighFrequencyDictionaryFactory, TemplateUpdateProcessorTest, TestBackupRepositoryFactory, DistributedFacetPivotSmallAdvancedTest, TestSolrDeletionPolicy1, TestBlendedInfixSuggestions, TestPointFields, TestPrepRecovery, CreateCollectionCleanupTest, TestRequestForwarding, HttpPartitionOnCommitTest, TestCloudRecovery, TestPKIAuthenticationPlugin, TestDocTermOrds, ActionThrottleTest, HdfsChaosMonkeyNothingIsSafeTest, TestAuthenticationFramework, TestNumericTerms64, TestCustomStream, MoveReplicaTest, TestDocSet, TestCopyFieldCollectionResource, ReplicationFactorTest, TestLuceneIndexBackCompat, DeleteShardTest, CloneFieldUpdateProcessorFactoryTest, SpellingQueryConverterTest, TestCloudJSONFacetJoinDomain, TestSolrQueryParser, SolrCloudReportersTest, SystemLogListenerTest, TestRequestStatusCollectionAPI, DistributedQueryElevationComponentTest, TestNRTOpen, LeaderElectionContextKeyTest, TestCustomDocTransformer, AnalyticsMergeStrategyTest, TestSolrQueryResponse, SubstringBytesRefFilterTest, AnalysisErrorHandlingTest, ChaosMonkeySafeLeaderWithPullReplicasTest, TestLMDirichletSimilarityFactory, TestStressCloudBlindAtomicUpdates, UpdateParamsTest, TestMultiWordSynonyms, SimpleMLTQParserTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, ZkSolrClientTest, TestDistributedSearch, TestFaceting, TestRealTimeGet, TestStressReorder, SolrCoreTest, TestGroupingSearch, PeerSyncTest, HighlighterTest, TestCoreDiscovery, SolrRequestParserTest, SuggesterTSTTest, SuggesterTest, TestTrie, PolyFieldTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, QueryEqualityTest, SortByFunctionTest, TestRemoteStreaming, DistanceFunctionTest, CacheHeaderTest, TestSurroundQueryParser, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, FileBasedSpellCheckerTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, FastVectorHighlighterTest, RegexBoostProcessorTest, TestCollationField, UpdateRequestProcessorFactoryTest, MBeansHandlerTest, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, ResponseLogComponentTest, SolrIndexConfigTest, BadComponentTest, TestStressRecovery, SynonymTokenizerTest, TestLMJelinekMercerSimilarityFactory, ResourceLoaderTest, PluginInfoTest, TestSuggestSpellingConverter, TestUtils, UUIDFieldTest, CircularListTest, TestRTGBase, DistributedIntervalFacetingTest, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, ConnectionReuseTest, AliasIntegrationTest, ConcurrentCreateRoutedAliasTest, DeleteInactiveReplicaTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, DistribDocExpirationUpdateProcessorTest, LeaderFailoverAfterPartitionTest, LeaderFailureAfterFreshStartTest, LeaderInitiatedRecoveryOnShardRestartTest, LegacyCloudClusterPropTest, MigrateRouteKeyTest, NodeMutatorTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerTaskQueueTest, RemoteQueryErrorTest, ReplaceNodeNoTargetTest, ReplaceNodeTest, SSLMigrationTest, SaslZkACLProviderTest, SharedFSAutoReplicaFailoverTest, SolrCLIZkUtilsTest, SolrCloudExampleTest, TestClusterProperties, TestConfigSetsAPI, TestRebalanceLeaders, TestSolrCloudWithKerberosAlt, TestStressInPlaceUpdates, ZkShardTermsTest, AssignTest, CollectionTooManyReplicasTest, HdfsCollectionsAPIDistributedZkTest, SimpleCollectionCreateDeleteTest, TestCollectionsAPIViaSolrCloudCluster, AutoAddReplicasIntegrationTest]
[junit4] Completed [604/777 (2!)] on J0 in 140.87s, 1 test, 1 failure <<< FAILURES!
[...truncated 49064 lines...]
[JENKINS] Lucene-Solr-Tests-7.x - Build # 409 - Still unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/409/
2 tests failed.
FAILED: org.apache.solr.cloud.ReplaceNodeNoTargetTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([750E09DE18CC2EEF:FD5A3604B6304317]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
expected:<5> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
at __randomizedtesting.SeedInfo.seed([750E09DE18CC2EEF:18F2AD23A284D1E8]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:265)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12377 lines...]
[junit4] Suite: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/init-core-data-001
[junit4] 2> 209320 WARN (SUITE-AutoscalingHistoryHandlerTest-seed#[750E09DE18CC2EEF]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 209333 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[750E09DE18CC2EEF]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 209334 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[750E09DE18CC2EEF]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 209334 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[750E09DE18CC2EEF]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 209335 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[750E09DE18CC2EEF]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001
[junit4] 2> 209335 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[750E09DE18CC2EEF]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 209350 INFO (Thread-393) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 209350 INFO (Thread-393) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 209371 ERROR (Thread-393) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 209442 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[750E09DE18CC2EEF]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:33065
[junit4] 2> 209445 INFO (zkConnectionManagerCallback-468-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209465 INFO (jetty-launcher-465-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 209479 INFO (jetty-launcher-465-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 209487 INFO (jetty-launcher-465-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 209498 INFO (jetty-launcher-465-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 209498 INFO (jetty-launcher-465-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 209498 INFO (jetty-launcher-465-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 209498 INFO (jetty-launcher-465-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@27ebb218{/solr,null,AVAILABLE}
[junit4] 2> 209500 INFO (jetty-launcher-465-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3d86bf00{SSL,[ssl, http/1.1]}{127.0.0.1:49452}
[junit4] 2> 209500 INFO (jetty-launcher-465-thread-1) [ ] o.e.j.s.Server Started @211264ms
[junit4] 2> 209500 INFO (jetty-launcher-465-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49452}
[junit4] 2> 209500 ERROR (jetty-launcher-465-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 209500 INFO (jetty-launcher-465-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 209500 INFO (jetty-launcher-465-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 209500 INFO (jetty-launcher-465-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 209500 INFO (jetty-launcher-465-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T19:27:19.439Z
[junit4] 2> 209516 INFO (jetty-launcher-465-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 209516 INFO (jetty-launcher-465-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 209517 INFO (jetty-launcher-465-thread-3) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 209517 INFO (jetty-launcher-465-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1b24ea01{/solr,null,AVAILABLE}
[junit4] 2> 209517 INFO (jetty-launcher-465-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4cd86165{SSL,[ssl, http/1.1]}{127.0.0.1:44768}
[junit4] 2> 209518 INFO (jetty-launcher-465-thread-3) [ ] o.e.j.s.Server Started @211282ms
[junit4] 2> 209518 INFO (jetty-launcher-465-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44768}
[junit4] 2> 209518 ERROR (jetty-launcher-465-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 209518 INFO (jetty-launcher-465-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 209518 INFO (jetty-launcher-465-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 209518 INFO (jetty-launcher-465-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 209518 INFO (jetty-launcher-465-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T19:27:19.457Z
[junit4] 2> 209521 INFO (jetty-launcher-465-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 209521 INFO (jetty-launcher-465-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 209521 INFO (jetty-launcher-465-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 209521 INFO (zkConnectionManagerCallback-470-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209521 INFO (jetty-launcher-465-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 209526 INFO (zkConnectionManagerCallback-472-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209526 INFO (jetty-launcher-465-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 209527 INFO (jetty-launcher-465-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4b9cf2fe{/solr,null,AVAILABLE}
[junit4] 2> 209527 INFO (jetty-launcher-465-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4cd51f42{SSL,[ssl, http/1.1]}{127.0.0.1:53685}
[junit4] 2> 209527 INFO (jetty-launcher-465-thread-2) [ ] o.e.j.s.Server Started @211291ms
[junit4] 2> 209527 INFO (jetty-launcher-465-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53685}
[junit4] 2> 209527 ERROR (jetty-launcher-465-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 209527 INFO (jetty-launcher-465-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 209527 INFO (jetty-launcher-465-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 209527 INFO (jetty-launcher-465-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 209527 INFO (jetty-launcher-465-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T19:27:19.466Z
[junit4] 2> 209547 INFO (jetty-launcher-465-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33065/solr
[junit4] 2> 209553 INFO (zkConnectionManagerCallback-474-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209554 INFO (jetty-launcher-465-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33065/solr
[junit4] 2> 209554 INFO (jetty-launcher-465-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 209580 INFO (jetty-launcher-465-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33065/solr
[junit4] 2> 209581 INFO (zkConnectionManagerCallback-479-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209593 INFO (zkConnectionManagerCallback-482-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209581 INFO (zkConnectionManagerCallback-486-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209600 INFO (zkConnectionManagerCallback-488-thread-1-processing-n:127.0.0.1:49452_solr) [n:127.0.0.1:49452_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209600 INFO (zkConnectionManagerCallback-492-thread-1-processing-n:127.0.0.1:44768_solr) [n:127.0.0.1:44768_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209600 INFO (zkConnectionManagerCallback-490-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209691 INFO (jetty-launcher-465-thread-2) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 209691 INFO (jetty-launcher-465-thread-1) [n:127.0.0.1:49452_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 209691 INFO (jetty-launcher-465-thread-2) [n:127.0.0.1:53685_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53685_solr
[junit4] 2> 209692 INFO (jetty-launcher-465-thread-1) [n:127.0.0.1:49452_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49452_solr
[junit4] 2> 209699 INFO (jetty-launcher-465-thread-2) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer Overseer (id=73306785394786311-127.0.0.1:53685_solr-n_0000000000) starting
[junit4] 2> 209704 INFO (zkCallback-487-thread-1-processing-n:127.0.0.1:49452_solr) [n:127.0.0.1:49452_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 209707 INFO (jetty-launcher-465-thread-3) [n:127.0.0.1:44768_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 209709 INFO (jetty-launcher-465-thread-3) [n:127.0.0.1:44768_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44768_solr
[junit4] 2> 209711 INFO (zkCallback-491-thread-1-processing-n:127.0.0.1:44768_solr) [n:127.0.0.1:44768_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 209711 INFO (zkCallback-491-thread-2-processing-n:127.0.0.1:44768_solr) [n:127.0.0.1:44768_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 209711 INFO (zkCallback-487-thread-1-processing-n:127.0.0.1:49452_solr) [n:127.0.0.1:49452_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 209718 INFO (zkCallback-489-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 209739 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 209741 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:44768_solr"} current state version: 0
[junit4] 2> 209741 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:44768_solr
[junit4] 2> 209751 DEBUG (OverseerAutoScalingTriggerThread-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 209751 INFO (jetty-launcher-465-thread-2) [n:127.0.0.1:53685_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53685_solr
[junit4] 2> 209752 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:53685_solr"} current state version: 0
[junit4] 2> 209752 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:53685_solr
[junit4] 2> 209752 INFO (zkCallback-487-thread-1-processing-n:127.0.0.1:49452_solr) [n:127.0.0.1:49452_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 209752 INFO (zkCallback-491-thread-2-processing-n:127.0.0.1:44768_solr) [n:127.0.0.1:44768_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 209752 INFO (zkCallback-489-thread-2-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 209758 DEBUG (OverseerAutoScalingTriggerThread-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 209762 DEBUG (OverseerAutoScalingTriggerThread-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:53685_solr, 127.0.0.1:49452_solr, 127.0.0.1:44768_solr]
[junit4] 2> 209767 DEBUG (OverseerAutoScalingTriggerThread-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 209767 DEBUG (OverseerAutoScalingTriggerThread-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 209776 DEBUG (OverseerAutoScalingTriggerThread-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 209776 DEBUG (OverseerAutoScalingTriggerThread-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 209784 DEBUG (ScheduledTrigger-1010-thread-1) [n:127.0.0.1:53685_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 209826 INFO (jetty-launcher-465-thread-3) [n:127.0.0.1:44768_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44768.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c32ea73
[junit4] 2> 209845 INFO (jetty-launcher-465-thread-2) [n:127.0.0.1:53685_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53685.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c32ea73
[junit4] 2> 209848 INFO (jetty-launcher-465-thread-3) [n:127.0.0.1:44768_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44768.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c32ea73
[junit4] 2> 209848 INFO (jetty-launcher-465-thread-3) [n:127.0.0.1:44768_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44768.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c32ea73
[junit4] 2> 209849 INFO (jetty-launcher-465-thread-3) [n:127.0.0.1:44768_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/.
[junit4] 2> 209853 INFO (jetty-launcher-465-thread-2) [n:127.0.0.1:53685_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53685.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c32ea73
[junit4] 2> 209855 INFO (jetty-launcher-465-thread-2) [n:127.0.0.1:53685_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53685.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c32ea73
[junit4] 2> 209856 INFO (jetty-launcher-465-thread-2) [n:127.0.0.1:53685_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/.
[junit4] 2> 209864 INFO (jetty-launcher-465-thread-1) [n:127.0.0.1:49452_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49452.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c32ea73
[junit4] 2> 209893 INFO (jetty-launcher-465-thread-1) [n:127.0.0.1:49452_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49452.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c32ea73
[junit4] 2> 209893 INFO (jetty-launcher-465-thread-1) [n:127.0.0.1:49452_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49452.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c32ea73
[junit4] 2> 209894 INFO (jetty-launcher-465-thread-1) [n:127.0.0.1:49452_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/.
[junit4] 2> 209977 INFO (zkConnectionManagerCallback-500-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209996 INFO (zkConnectionManagerCallback-504-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 209997 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[750E09DE18CC2EEF]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 210003 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[750E09DE18CC2EEF]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33065/solr ready
[junit4] 2> 210045 INFO (qtp573334363-2473) [n:127.0.0.1:53685_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&name=AutoscalingHistoryHandlerTest_collection&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 210063 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection AutoscalingHistoryHandlerTest_collection
[junit4] 2> 210064 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
[junit4] 2> 210066 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/protwords.txt
[junit4] 2> 210067 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/solrconfig.xml
[junit4] 2> 210068 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/synonyms.txt
[junit4] 2> 210069 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/stopwords.txt
[junit4] 2> 210070 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_it.txt
[junit4] 2> 210071 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ca.txt
[junit4] 2> 210072 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stemdict_nl.txt
[junit4] 2> 210073 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_no.txt
[junit4] 2> 210075 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hy.txt
[junit4] 2> 210076 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_id.txt
[junit4] 2> 210077 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hi.txt
[junit4] 2> 210078 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ga.txt
[junit4] 2> 210079 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_da.txt
[junit4] 2> 210080 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ja.txt
[junit4] 2> 210080 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_pt.txt
[junit4] 2> 210081 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hu.txt
[junit4] 2> 210082 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_el.txt
[junit4] 2> 210083 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ru.txt
[junit4] 2> 210084 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_tr.txt
[junit4] 2> 210085 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ar.txt
[junit4] 2> 210086 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/userdict_ja.txt
[junit4] 2> 210087 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_eu.txt
[junit4] 2> 210088 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_it.txt
[junit4] 2> 210089 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_cz.txt
[junit4] 2> 210089 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stoptags_ja.txt
[junit4] 2> 210091 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_fr.txt
[junit4] 2> 210091 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_de.txt
[junit4] 2> 210092 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fa.txt
[junit4] 2> 210093 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ga.txt
[junit4] 2> 210094 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ca.txt
[junit4] 2> 210095 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_nl.txt
[junit4] 2> 210096 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_bg.txt
[junit4] 2> 210097 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_en.txt
[junit4] 2> 210098 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_es.txt
[junit4] 2> 210101 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_lv.txt
[junit4] 2> 210102 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ro.txt
[junit4] 2> 210103 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_th.txt
[junit4] 2> 210104 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fr.txt
[junit4] 2> 210104 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_sv.txt
[junit4] 2> 210105 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fi.txt
[junit4] 2> 210106 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/hyphenations_ga.txt
[junit4] 2> 210107 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_gl.txt
[junit4] 2> 210108 INFO (OverseerThreadFactory-1012-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/params.json
[junit4] 2> 210112 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "numShards":"1",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 210112 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: AutoscalingHistoryHandlerTest_collection
[junit4] 2> 210112 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json
[junit4] 2> 210214 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 210214 INFO (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 210216 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{}}
[junit4] 2> 210216 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 210216 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:44768/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 210217 INFO (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:44768/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 210217 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 210217 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44768/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 210218 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:53685/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 210218 INFO (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:53685/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 210219 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44768/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 210219 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44768/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "base_url":"https://127.0.0.1:53685/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 210319 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 0
[junit4] 2> 210485 INFO (qtp655093372-2466) [n:127.0.0.1:49452_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 210486 INFO (qtp655093372-2466) [n:127.0.0.1:49452_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 210493 INFO (qtp573334363-2472) [n:127.0.0.1:53685_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n4&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 210493 INFO (qtp573334363-2472) [n:127.0.0.1:53685_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 210507 INFO (qtp1958293772-2484) [n:127.0.0.1:44768_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 210508 INFO (qtp1958293772-2484) [n:127.0.0.1:44768_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 210509 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "node_name":"127.0.0.1:49452_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 210509 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "node_name":"127.0.0.1:49452_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 210510 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1","base_url":"https://127.0.0.1:49452/solr","node_name":"127.0.0.1:49452_solr","state":"down","type":"NRT"}
[junit4] 2> 210510 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "node_name":"127.0.0.1:49452_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44768/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "base_url":"https://127.0.0.1:53685/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 210519 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:53685/solr",
[junit4] 2> "node_name":"127.0.0.1:53685_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 210519 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:53685/solr",
[junit4] 2> "node_name":"127.0.0.1:53685_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 210519 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node6:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4","base_url":"https://127.0.0.1:53685/solr","node_name":"127.0.0.1:53685_solr","state":"down","type":"NRT"}
[junit4] 2> 210519 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "node_name":"127.0.0.1:49452_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44768/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "base_url":"https://127.0.0.1:53685/solr",
[junit4] 2> "node_name":"127.0.0.1:53685_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 210523 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:44768/solr",
[junit4] 2> "node_name":"127.0.0.1:44768_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 210523 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:44768/solr",
[junit4] 2> "node_name":"127.0.0.1:44768_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 210523 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node5:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2","base_url":"https://127.0.0.1:44768/solr","node_name":"127.0.0.1:44768_solr","state":"down","type":"NRT"}
[junit4] 2> 210523 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:49452/solr",
[junit4] 2> "node_name":"127.0.0.1:49452_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44768/solr",
[junit4] 2> "node_name":"127.0.0.1:44768_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "base_url":"https://127.0.0.1:53685/solr",
[junit4] 2> "node_name":"127.0.0.1:53685_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 210624 DEBUG (OverseerStateUpdate-73306785394786311-127.0.0.1:53685_solr-n_0000000000) [n:127.0.0.1:53685_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 1
[junit4] 2> 210624 INFO (zkCallback-489-thread-2-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 210624 INFO (zkCallback-487-thread-1-processing-n:127.0.0.1:49452_solr) [n:127.0.0.1:49452_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 210625 INFO (zkCallback-489-thread-1-processing-n:127.0.0.1:53685_solr) [n:127.0.0.1:53685_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 210625 INFO (zkCallback-491-thread-1-processing-n:127.0.0.1:44768_solr) [n:127.0.0.1:44768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 210625 INFO (zkCallback-491-thread-2-processing-n:127.0.0.1:44768_solr) [n:127.0.0.1:44768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 210627 INFO (zkCallback-487-thread-2-processing-n:127.0.0.1:49452_solr) [n:127.0.0.1:49452_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 210787 DEBUG (ScheduledTrigger-1010-thread-1) [n:127.0.0.1:53685_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 211535 INFO (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
[junit4] 2> 211536 INFO (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 0
[junit4] 2> 211536 WARN (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/extraction/lib
[junit4] 2> 211536 WARN (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
[junit4] 2> 211536 WARN (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/clustering/lib
[junit4] 2> 211537 WARN (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
[junit4] 2> 211537 WARN (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/langid/lib
[junit4] 2> 211537 WARN (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
[junit4] 2> 211537 WARN (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/velocity/lib
[junit4] 2> 211537 WARN (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
[junit4] 2> 211540 INFO (qtp573334363-2472) [n:127.0.0.1:53685_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
[junit4] 2> 211540 INFO (qtp573334363-2472) [n:127.0.0.1:53685_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.RequestParams request params refreshed to version 0
[junit4] 2> 211540 WARN (qtp573334363-2472) [n:127.0.0.1:53685_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/extraction/lib
[junit4] 2> 211542 WARN (qtp573334363-2472) [n:127.0.0.1:53685_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
[junit4] 2> 211543 WARN (qtp573334363-2472) [n:127.0.0.1:53685_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/clustering/lib
[junit4] 2> 211543 WARN (qtp573334363-2472) [n:127.0.0.1:53685_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
[junit4] 2> 211543 WARN (qtp573334363-2472) [n:127.0.0.1:53685_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/langid/lib
[junit4] 2> 211543 WARN (qtp573334363-2472) [n:127.0.0.1:53685_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
[junit4] 2> 211544 WARN (qtp573334363-2472) [n:127.0.0.1:53685_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/velocity/lib
[junit4] 2> 211544 WARN (qtp573334363-2472) [n:127.0.0.1:53685_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
[junit4] 2> 211545 INFO (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 211547 INFO (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
[junit4] 2> 211547 INFO (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams request params refreshed to version 0
[junit4] 2> 211547 WARN (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib
[junit4] 2> 211547 WARN (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 211548 WARN (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib
[junit4] 2> 211548 WARN (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 211548 WARN (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib
[junit4] 2> 211548 WARN (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 211548 WARN (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/velocity/lib
[junit4] 2> 211548 WARN (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_750E09DE18CC2EEF-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 211555 INFO (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 211558 INFO (qtp573334363-2472) [n:127.0.0.1:53685_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 211565 INFO (qtp655093372-2466) [n:127.0.0.1:49452_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.s.IndexSchema [AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] Schema name=default-config
[junit4] 2> 211575 INFO (qtp1958293772-2484) [n:127.0.0.1:44768_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.s.IndexSchema [AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] Schema name=default-config
[junit4] 2> 211592 INFO (qtp573334363-
[...truncated too long message...]
882318794770-127.0.0.1:57632_solr-n_0000000000) [n:127.0.0.1:57632_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:57632_solr
[junit4] 2> 1697078 WARN (OverseerAutoScalingTriggerThread-73306882318794770-127.0.0.1:57632_solr-n_0000000000) [n:127.0.0.1:57632_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1697080 INFO (jetty-closer-3129-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@739c707a{/solr,null,UNAVAILABLE}
[junit4] 2> 1697080 INFO (jetty-closer-3129-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1698275 WARN (zkCallback-3164-thread-2-processing-n:127.0.0.1:36966_solr) [n:127.0.0.1:36966_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SyncStrategy Closed, skipping sync up.
[junit4] 2> 1698276 INFO (zkCallback-3164-thread-2-processing-n:127.0.0.1:36966_solr) [n:127.0.0.1:36966_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1698276 INFO (zkCallback-3164-thread-2-processing-n:127.0.0.1:36966_solr) [n:127.0.0.1:36966_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrCore [replacenodetest_coll_notarget_shard3_replica_n10] CLOSING SolrCore org.apache.solr.core.SolrCore@38064c55
[junit4] 2> 1698276 INFO (zkCallback-3164-thread-2-processing-n:127.0.0.1:36966_solr) [n:127.0.0.1:36966_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.replacenodetest_coll_notarget.shard3.replica_n10, tag=939936853
[junit4] 2> 1698276 INFO (zkCallback-3164-thread-2-processing-n:127.0.0.1:36966_solr) [n:127.0.0.1:36966_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7ac5fdf7: rootName = solr_36966, domain = solr.core.replacenodetest_coll_notarget.shard3.replica_n10, service url = null, agent id = null] for registry solr.core.replacenodetest_coll_notarget.shard3.replica_n10 / com.codahale.metrics.MetricRegistry@26cf6bf3
[junit4] 2> 1698286 INFO (zkCallback-3164-thread-2-processing-n:127.0.0.1:36966_solr) [n:127.0.0.1:36966_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard3.leader, tag=939936853
[junit4] 2> 1698287 INFO (jetty-closer-3129-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@411aaea7{/solr,null,UNAVAILABLE}
[junit4] 2> 1698287 INFO (jetty-closer-3129-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1698288 ERROR (SUITE-ReplaceNodeNoTargetTest-seed#[750E09DE18CC2EEF]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1698288 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[750E09DE18CC2EEF]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38224 38224
[junit4] 2> 1698378 INFO (Thread-6153) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38224 38224
[junit4] 2> 1698379 WARN (Thread-6153) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/collections/replacenodetest_coll_notarget/terms/shard4
[junit4] 2> 9 /solr/collections/replacenodetest_coll_notarget/terms/shard3
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 6 /solr/configs/conf1
[junit4] 2> 5 /solr/collections/replacenodetest_coll_notarget/terms/shard2
[junit4] 2> 5 /solr/collections/replacenodetest_coll_notarget/terms/shard1
[junit4] 2> 5 /solr/collections/replacenodetest_coll_notarget/terms/shard5
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 88 /solr/collections/replacenodetest_coll_notarget/state.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 3 /solr/overseer_elect/election/73306882318794770-127.0.0.1:57632_solr-n_0000000000
[junit4] 2> 2 /solr/collections/replacenodetest_coll_notarget/leader_elect/shard4/election/73306882318794763-core_node15-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/73306882318794765-127.0.0.1:57379_solr-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_750E09DE18CC2EEF-001
[junit4] 2> Feb 16, 2018 7:52:08 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=true): {}, locale=sr-Latn-ME, timezone=America/Iqaluit
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=105982352,total=508559360
[junit4] 2> NOTE: All tests run in this JVM: [DistributedMLTComponentTest, TestUseDocValuesAsStored, QueryParsingTest, TestFastLRUCache, TestLegacyTerms, TestRestManager, BlockJoinFacetSimpleTest, TestCollationFieldDocValues, SolrCloudExampleTest, NodeLostTriggerTest, TestReversedWildcardFilterFactory, BadComponentTest, TestExportWriter, PreAnalyzedUpdateProcessorTest, ClassificationUpdateProcessorIntegrationTest, TestSSLRandomization, TestNoOpRegenerator, SolrGangliaReporterTest, TestMaxTokenLenTokenizer, DirectSolrConnectionTest, TestNestedDocsSort, TestCursorMarkWithoutUniqueKey, HttpPartitionTest, TestQueryUtils, ScriptEngineTest, QueryElevationComponentTest, TestStressVersions, TestSolrJ, HdfsCollectionsAPIDistributedZkTest, TestDeleteCollectionOnDownNodes, TermsComponentTest, TestPayloadScoreQParserPlugin, TestSweetSpotSimilarityFactory, AutoscalingHistoryHandlerTest, HttpSolrCallGetCoreTest, HdfsBasicDistributedZk2Test, TestPivotHelperCode, CollectionsAPIDistributedZkTest, SpellCheckCollatorWithCollapseTest, QueryEqualityTest, CollectionReloadTest, TestTrie, FastVectorHighlighterTest, TestSchemaManager, HdfsRecoveryZkTest, DirectUpdateHandlerOptimizeTest, TestCoreBackup, TestRecovery, TestPostingsSolrHighlighter, TestFunctionQuery, ConfigSetsAPITest, SoftAutoCommitTest, TestTolerantUpdateProcessorCloud, TestTrieFacet, TestBulkSchemaConcurrent, DistributedFacetPivotLargeTest, TestFoldingMultitermQuery, HighlighterTest, ShardRoutingCustomTest, DeleteStatusTest, PolyFieldTest, TestSurroundQueryParser, TestInfoStreamLogging, TestLocalFSCloudBackupRestore, CdcrBootstrapTest, CoreMergeIndexesAdminHandlerTest, ResourceLoaderTest, UpdateLogTest, TestBM25SimilarityFactory, TestPolicyCloud, TestCloudDeleteByQuery, TestPullReplica, AddReplicaTest, TestDistribIDF, DistributedQueryComponentOptimizationTest, SmileWriterTest, SOLR749Test, DOMUtilTest, AtomicUpdateProcessorFactoryTest, HighlighterMaxOffsetTest, TestLegacyFieldCache, TestFieldCache, ZkControllerTest, SliceStateTest, CreateRoutedAliasTest, TlogReplayBufferedWhileIndexingTest, DistributedDebugComponentTest, SaslZkACLProviderTest, TestRandomRequestDistribution, DistributedIntervalFacetingTest, FileUtilsTest, TestPartialUpdateDeduplication, CurrencyFieldTypeTest, AutoAddReplicasIntegrationTest, TestFieldSortValues, TestFieldResource, TestHdfsUpdateLog, RestartWhileUpdatingTest, MetricUtilsTest, TestFuzzyAnalyzedSuggestions, JvmMetricsTest, PeerSyncTest, SuggesterFSTTest, TestChildDocTransformer, BasicZkTest, SolrShardReporterTest, TestLeaderElectionZkExpiry, TestLRUStatsCache, ZkFailoverTest, TestJsonRequest, SchemaVersionSpecificBehaviorTest, TestSolrCLIRunExample, SolrCoreTest, LegacyCloudClusterPropTest, CollectionStateFormat2Test, TestCloudPivotFacet, DocumentBuilderTest, TestReloadAndDeleteDocs, TestSolrFieldCacheBean, TestDownShardTolerantSearch, OverriddenZkACLAndCredentialsProvidersTest, TestSearchPerf, TestSizeLimitedDistributedMap, SolrJmxReporterTest, DistributedSpellCheckComponentTest, TestJoin, ConvertedLegacyTest, BasicFunctionalityTest, SimplePostToolTest, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, SpatialFilterTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, SolrInfoBeanTest, LukeRequestHandlerTest, XmlUpdateRequestHandlerTest, TestIndexingPerformance, RequiredFieldsTest, LoggingHandlerTest, IndexSchemaTest, TestCollationField, JsonLoaderTest, TestComponentsName, SearchHandlerTest, TestElisionMultitermQuery, TestLuceneMatchVersion, TestXIncludeConfig, OpenExchangeRatesOrgProviderTest, TestSystemIdResolver, TestDocumentBuilder, TestHighlightDedupGrouping, TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, ConnectionReuseTest, ConnectionManagerTest, DeleteNodeTest, DeleteShardTest, DistributedQueueTest, DocValuesNotIndexedTest, ForceLeaderTest, MoveReplicaHDFSTest, ReplaceNodeNoTargetTest]
[junit4] Completed [529/777 (2!)] on J1 in 10.86s, 1 test, 1 failure <<< FAILURES!
[...truncated 49353 lines...]
[JENKINS] Lucene-Solr-Tests-7.x - Build # 408 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/408/
2 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.testReadApi
Error Message:
expected:<1> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
at __randomizedtesting.SeedInfo.seed([A232C33C7659783A:F51B3889ADAB9A21]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.testReadApi(AutoScalingHandlerTest.java:725)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
expected:<5> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
at __randomizedtesting.SeedInfo.seed([A232C33C7659783A:CFCE67C1CC11873D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:265)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13267 lines...]
[junit4] Suite: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
[junit4] 2> 992558 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[A232C33C7659783A]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/init-core-data-001
[junit4] 2> 992559 WARN (SUITE-AutoscalingHistoryHandlerTest-seed#[A232C33C7659783A]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 992559 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[A232C33C7659783A]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 992560 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[A232C33C7659783A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 992561 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[A232C33C7659783A]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001
[junit4] 2> 992561 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[A232C33C7659783A]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 992562 INFO (Thread-3799) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 992562 INFO (Thread-3799) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 992567 ERROR (Thread-3799) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 992662 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[A232C33C7659783A]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:37304
[junit4] 2> 992664 INFO (zkConnectionManagerCallback-2404-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992670 INFO (jetty-launcher-2401-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 992670 INFO (jetty-launcher-2401-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 992670 INFO (jetty-launcher-2401-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 992671 INFO (jetty-launcher-2401-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 992671 INFO (jetty-launcher-2401-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 992671 INFO (jetty-launcher-2401-thread-3) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 992671 INFO (jetty-launcher-2401-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@670214ea{/solr,null,AVAILABLE}
[junit4] 2> 992672 INFO (jetty-launcher-2401-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 992672 INFO (jetty-launcher-2401-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 992672 INFO (jetty-launcher-2401-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 992672 INFO (jetty-launcher-2401-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@106a30a1{/solr,null,AVAILABLE}
[junit4] 2> 992673 INFO (jetty-launcher-2401-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@59cb3ba0{SSL,[ssl, http/1.1]}{127.0.0.1:42767}
[junit4] 2> 992675 INFO (jetty-launcher-2401-thread-2) [ ] o.e.j.s.Server Started @994577ms
[junit4] 2> 992675 INFO (jetty-launcher-2401-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42767}
[junit4] 2> 992675 ERROR (jetty-launcher-2401-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 992675 INFO (jetty-launcher-2401-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 992675 INFO (jetty-launcher-2401-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 992675 INFO (jetty-launcher-2401-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 992675 INFO (jetty-launcher-2401-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T17:04:42.478Z
[junit4] 2> 992673 INFO (jetty-launcher-2401-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 992676 INFO (jetty-launcher-2401-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 992673 INFO (jetty-launcher-2401-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@aec447d{SSL,[ssl, http/1.1]}{127.0.0.1:40521}
[junit4] 2> 992676 INFO (jetty-launcher-2401-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 992676 INFO (jetty-launcher-2401-thread-3) [ ] o.e.j.s.Server Started @994579ms
[junit4] 2> 992676 INFO (jetty-launcher-2401-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40521}
[junit4] 2> 992676 ERROR (jetty-launcher-2401-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 992676 INFO (jetty-launcher-2401-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 992676 INFO (jetty-launcher-2401-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 992676 INFO (jetty-launcher-2401-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 992676 INFO (jetty-launcher-2401-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T17:04:42.479Z
[junit4] 2> 992677 INFO (jetty-launcher-2401-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@172d4e8f{/solr,null,AVAILABLE}
[junit4] 2> 992677 INFO (jetty-launcher-2401-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@a1c001d{SSL,[ssl, http/1.1]}{127.0.0.1:37968}
[junit4] 2> 992678 INFO (jetty-launcher-2401-thread-1) [ ] o.e.j.s.Server Started @994580ms
[junit4] 2> 992678 INFO (zkConnectionManagerCallback-2406-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992678 INFO (jetty-launcher-2401-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37968}
[junit4] 2> 992678 ERROR (jetty-launcher-2401-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 992678 INFO (jetty-launcher-2401-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 992678 INFO (jetty-launcher-2401-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 992678 INFO (jetty-launcher-2401-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 992678 INFO (jetty-launcher-2401-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T17:04:42.481Z
[junit4] 2> 992678 INFO (zkConnectionManagerCallback-2408-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992679 INFO (jetty-launcher-2401-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 992679 INFO (jetty-launcher-2401-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 992683 INFO (zkConnectionManagerCallback-2410-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992684 INFO (jetty-launcher-2401-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 992685 INFO (jetty-launcher-2401-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37304/solr
[junit4] 2> 992701 INFO (jetty-launcher-2401-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37304/solr
[junit4] 2> 992702 INFO (zkConnectionManagerCallback-2414-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992703 INFO (zkConnectionManagerCallback-2418-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992705 INFO (zkConnectionManagerCallback-2420-thread-1-processing-n:127.0.0.1:42767_solr) [n:127.0.0.1:42767_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992705 INFO (zkConnectionManagerCallback-2422-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992710 INFO (jetty-launcher-2401-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37304/solr
[junit4] 2> 992711 INFO (zkConnectionManagerCallback-2426-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992713 INFO (zkConnectionManagerCallback-2428-thread-1-processing-n:127.0.0.1:37968_solr) [n:127.0.0.1:37968_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992786 INFO (jetty-launcher-2401-thread-3) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 992786 INFO (jetty-launcher-2401-thread-2) [n:127.0.0.1:42767_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 992787 INFO (jetty-launcher-2401-thread-3) [n:127.0.0.1:40521_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40521_solr
[junit4] 2> 992788 INFO (jetty-launcher-2401-thread-2) [n:127.0.0.1:42767_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42767_solr
[junit4] 2> 992788 INFO (jetty-launcher-2401-thread-3) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer Overseer (id=73306224608149511-127.0.0.1:40521_solr-n_0000000000) starting
[junit4] 2> 992798 INFO (zkCallback-2421-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 992799 INFO (zkCallback-2419-thread-1-processing-n:127.0.0.1:42767_solr) [n:127.0.0.1:42767_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 992802 INFO (jetty-launcher-2401-thread-1) [n:127.0.0.1:37968_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 992804 INFO (jetty-launcher-2401-thread-1) [n:127.0.0.1:37968_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 992805 INFO (jetty-launcher-2401-thread-1) [n:127.0.0.1:37968_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37968_solr
[junit4] 2> 992810 INFO (zkCallback-2419-thread-1-processing-n:127.0.0.1:42767_solr) [n:127.0.0.1:42767_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 992812 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 992813 INFO (jetty-launcher-2401-thread-3) [n:127.0.0.1:40521_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40521_solr
[junit4] 2> 992818 INFO (zkCallback-2419-thread-1-processing-n:127.0.0.1:42767_solr) [n:127.0.0.1:42767_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 992819 INFO (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 992825 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:37968_solr"} current state version: 0
[junit4] 2> 992825 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:37968_solr
[junit4] 2> 992825 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:40521_solr"} current state version: 0
[junit4] 2> 992825 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:40521_solr
[junit4] 2> 992831 DEBUG (OverseerAutoScalingTriggerThread-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 992850 INFO (zkCallback-2427-thread-1-processing-n:127.0.0.1:37968_solr) [n:127.0.0.1:37968_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 992851 DEBUG (OverseerAutoScalingTriggerThread-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 992851 DEBUG (OverseerAutoScalingTriggerThread-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:37968_solr, 127.0.0.1:42767_solr, 127.0.0.1:40521_solr]
[junit4] 2> 992851 DEBUG (OverseerAutoScalingTriggerThread-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 992851 DEBUG (OverseerAutoScalingTriggerThread-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 992858 DEBUG (OverseerAutoScalingTriggerThread-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 992859 DEBUG (OverseerAutoScalingTriggerThread-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 992863 DEBUG (ScheduledTrigger-5013-thread-1) [n:127.0.0.1:40521_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 992869 INFO (jetty-launcher-2401-thread-1) [n:127.0.0.1:37968_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37968.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cdc9daf
[junit4] 2> 992880 INFO (jetty-launcher-2401-thread-1) [n:127.0.0.1:37968_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37968.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cdc9daf
[junit4] 2> 992880 INFO (jetty-launcher-2401-thread-1) [n:127.0.0.1:37968_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37968.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cdc9daf
[junit4] 2> 992881 INFO (jetty-launcher-2401-thread-1) [n:127.0.0.1:37968_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/.
[junit4] 2> 992914 INFO (jetty-launcher-2401-thread-3) [n:127.0.0.1:40521_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40521.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cdc9daf
[junit4] 2> 992916 INFO (jetty-launcher-2401-thread-2) [n:127.0.0.1:42767_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42767.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cdc9daf
[junit4] 2> 992929 INFO (jetty-launcher-2401-thread-3) [n:127.0.0.1:40521_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40521.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cdc9daf
[junit4] 2> 992929 INFO (jetty-launcher-2401-thread-3) [n:127.0.0.1:40521_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40521.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cdc9daf
[junit4] 2> 992930 INFO (jetty-launcher-2401-thread-3) [n:127.0.0.1:40521_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/.
[junit4] 2> 992932 INFO (jetty-launcher-2401-thread-2) [n:127.0.0.1:42767_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42767.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cdc9daf
[junit4] 2> 992932 INFO (jetty-launcher-2401-thread-2) [n:127.0.0.1:42767_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42767.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cdc9daf
[junit4] 2> 992933 INFO (jetty-launcher-2401-thread-2) [n:127.0.0.1:42767_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/.
[junit4] 2> 992986 INFO (zkConnectionManagerCallback-2436-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992989 INFO (zkConnectionManagerCallback-2440-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 992989 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[A232C33C7659783A]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 992990 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[A232C33C7659783A]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37304/solr ready
[junit4] 2> 993018 INFO (qtp1778005159-12303) [n:127.0.0.1:42767_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&name=AutoscalingHistoryHandlerTest_collection&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 993020 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection AutoscalingHistoryHandlerTest_collection
[junit4] 2> 993021 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
[junit4] 2> 993022 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/protwords.txt
[junit4] 2> 993024 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/solrconfig.xml
[junit4] 2> 993025 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/synonyms.txt
[junit4] 2> 993026 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/stopwords.txt
[junit4] 2> 993027 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_it.txt
[junit4] 2> 993028 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ca.txt
[junit4] 2> 993029 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stemdict_nl.txt
[junit4] 2> 993030 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_no.txt
[junit4] 2> 993031 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hy.txt
[junit4] 2> 993032 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_id.txt
[junit4] 2> 993033 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hi.txt
[junit4] 2> 993034 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ga.txt
[junit4] 2> 993035 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_da.txt
[junit4] 2> 993036 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ja.txt
[junit4] 2> 993037 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_pt.txt
[junit4] 2> 993038 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hu.txt
[junit4] 2> 993039 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_el.txt
[junit4] 2> 993040 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ru.txt
[junit4] 2> 993041 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_tr.txt
[junit4] 2> 993042 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ar.txt
[junit4] 2> 993042 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/userdict_ja.txt
[junit4] 2> 993043 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_eu.txt
[junit4] 2> 993044 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_it.txt
[junit4] 2> 993045 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_cz.txt
[junit4] 2> 993046 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stoptags_ja.txt
[junit4] 2> 993047 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_fr.txt
[junit4] 2> 993048 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_de.txt
[junit4] 2> 993049 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fa.txt
[junit4] 2> 993050 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ga.txt
[junit4] 2> 993051 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ca.txt
[junit4] 2> 993052 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_nl.txt
[junit4] 2> 993053 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_bg.txt
[junit4] 2> 993053 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_en.txt
[junit4] 2> 993054 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_es.txt
[junit4] 2> 993055 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_lv.txt
[junit4] 2> 993056 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ro.txt
[junit4] 2> 993057 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_th.txt
[junit4] 2> 993058 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fr.txt
[junit4] 2> 993059 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_sv.txt
[junit4] 2> 993060 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fi.txt
[junit4] 2> 993061 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/hyphenations_ga.txt
[junit4] 2> 993061 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_gl.txt
[junit4] 2> 993062 INFO (OverseerThreadFactory-5015-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/params.json
[junit4] 2> 993067 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "numShards":"1",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 993067 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: AutoscalingHistoryHandlerTest_collection
[junit4] 2> 993067 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json
[junit4] 2> 993170 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 993170 INFO (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 993171 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{}}
[junit4] 2> 993171 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 993172 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:42767/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 993172 INFO (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:42767/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 993173 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 993173 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:42767/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 993174 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37968/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 993174 INFO (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37968/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 993175 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:42767/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 993175 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:42767/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "base_url":"https://127.0.0.1:37968/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 993276 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 0
[junit4] 2> 993381 INFO (qtp1778005159-12288) [n:127.0.0.1:42767_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 993382 INFO (qtp1778005159-12288) [n:127.0.0.1:42767_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 993393 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:42767/solr",
[junit4] 2> "node_name":"127.0.0.1:42767_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 993393 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:42767/solr",
[junit4] 2> "node_name":"127.0.0.1:42767_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 993393 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node5:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2","base_url":"https://127.0.0.1:42767/solr","node_name":"127.0.0.1:42767_solr","state":"down","type":"NRT"}
[junit4] 2> 993393 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:42767/solr",
[junit4] 2> "node_name":"127.0.0.1:42767_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "base_url":"https://127.0.0.1:37968/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 993403 INFO (qtp876182406-12287) [n:127.0.0.1:40521_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 993403 INFO (qtp876182406-12287) [n:127.0.0.1:40521_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 993405 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "node_name":"127.0.0.1:40521_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 993405 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "node_name":"127.0.0.1:40521_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 993405 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1","base_url":"https://127.0.0.1:40521/solr","node_name":"127.0.0.1:40521_solr","state":"down","type":"NRT"}
[junit4] 2> 993405 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "node_name":"127.0.0.1:40521_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:42767/solr",
[junit4] 2> "node_name":"127.0.0.1:42767_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "base_url":"https://127.0.0.1:37968/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 993411 INFO (qtp1684568902-12294) [n:127.0.0.1:37968_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n4&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 993411 INFO (qtp1684568902-12294) [n:127.0.0.1:37968_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 993413 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:37968/solr",
[junit4] 2> "node_name":"127.0.0.1:37968_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 993413 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:37968/solr",
[junit4] 2> "node_name":"127.0.0.1:37968_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 993413 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node6:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4","base_url":"https://127.0.0.1:37968/solr","node_name":"127.0.0.1:37968_solr","state":"down","type":"NRT"}
[junit4] 2> 993413 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:40521/solr",
[junit4] 2> "node_name":"127.0.0.1:40521_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:42767/solr",
[junit4] 2> "node_name":"127.0.0.1:42767_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
[junit4] 2> "base_url":"https://127.0.0.1:37968/solr",
[junit4] 2> "node_name":"127.0.0.1:37968_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 993514 DEBUG (OverseerStateUpdate-73306224608149511-127.0.0.1:40521_solr-n_0000000000) [n:127.0.0.1:40521_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 1
[junit4] 2> 993514 INFO (zkCallback-2419-thread-1-processing-n:127.0.0.1:42767_solr) [n:127.0.0.1:42767_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 993514 INFO (zkCallback-2421-thread-1-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 993514 INFO (zkCallback-2427-thread-1-processing-n:127.0.0.1:37968_solr) [n:127.0.0.1:37968_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 993515 INFO (zkCallback-2427-thread-2-processing-n:127.0.0.1:37968_solr) [n:127.0.0.1:37968_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 993515 INFO (zkCallback-2419-thread-2-processing-n:127.0.0.1:42767_solr) [n:127.0.0.1:42767_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 993516 INFO (zkCallback-2421-thread-2-processing-n:127.0.0.1:40521_solr) [n:127.0.0.1:40521_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 993863 DEBUG (ScheduledTrigger-5013-thread-1) [n:127.0.0.1:40521_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 994394 INFO (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
[junit4] 2> 994394 INFO (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams request params refreshed to version 0
[junit4] 2> 994394 WARN (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib
[junit4] 2> 994394 WARN (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 994395 WARN (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib
[junit4] 2> 994395 WARN (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 994395 WARN (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib
[junit4] 2> 994395 WARN (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 994395 WARN (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/velocity/lib
[junit4] 2> 994396 WARN (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 994414 INFO (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
[junit4] 2> 994414 INFO (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 0
[junit4] 2> 994416 INFO (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 994419 INFO (qtp1684568902-12294) [n:127.0.0.1:37968_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
[junit4] 2> 994419 INFO (qtp1684568902-12294) [n:127.0.0.1:37968_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.RequestParams request params refreshed to version 0
[junit4] 2> 994419 WARN (qtp1684568902-12294) [n:127.0.0.1:37968_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/extraction/lib
[junit4] 2> 994419 WARN (qtp1684568902-12294) [n:127.0.0.1:37968_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
[junit4] 2> 994420 WARN (qtp1684568902-12294) [n:127.0.0.1:37968_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/clustering/lib
[junit4] 2> 994420 WARN (qtp1684568902-12294) [n:127.0.0.1:37968_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
[junit4] 2> 994420 WARN (qtp1684568902-12294) [n:127.0.0.1:37968_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/langid/lib
[junit4] 2> 994420 WARN (qtp1684568902-12294) [n:127.0.0.1:37968_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
[junit4] 2> 994420 WARN (qtp1684568902-12294) [n:127.0.0.1:37968_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/velocity/lib
[junit4] 2> 994421 WARN (qtp1684568902-12294) [n:127.0.0.1:37968_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
[junit4] 2> 994422 WARN (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/extraction/lib
[junit4] 2> 994423 WARN (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
[junit4] 2> 994423 WARN (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/clustering/lib
[junit4] 2> 994423 WARN (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
[junit4] 2> 994423 WARN (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/langid/lib
[junit4] 2> 994423 WARN (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
[junit4] 2> 994423 WARN (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/velocity/lib
[junit4] 2> 994424 WARN (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_A232C33C7659783A-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
[junit4] 2> 994430 INFO (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 994431 INFO (qtp1684568902-12294) [n:127.0.0.1:37968_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 994436 INFO (qtp1778005159-12288) [n:127.0.0.1:42767_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.s.IndexSchema [AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] Schema name=default-config
[junit4] 2> 994450 INFO (qtp876182406-12287) [n:127.0.0.1:40521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.s.IndexSchema [AutoscalingHis
[...truncated too long message...]
rc/test/org/apache/solr/highlight/HighlighterTest.java (at line 204)
[ecj-lint] Analyzer a1 = new WhitespaceAnalyzer();
[ecj-lint] ^^
[ecj-lint] Resource leak: 'a1' is never closed
[ecj-lint] ----------
[ecj-lint] 15. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 207)
[ecj-lint] OffsetWindowTokenFilter tots = new OffsetWindowTokenFilter(tokenStream);
[ecj-lint] ^^^^
[ecj-lint] Resource leak: 'tots' is never closed
[ecj-lint] ----------
[ecj-lint] 16. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 211)
[ecj-lint] Analyzer a2 = new WhitespaceAnalyzer();
[ecj-lint] ^^
[ecj-lint] Resource leak: 'a2' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 17. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/response/TestJavabinTupleStreamParser.java (at line 72)
[ecj-lint] JavabinTupleStreamParser parser = new JavabinTupleStreamParser(new ByteArrayInputStream(bytes), true);
[ecj-lint] ^^^^^^
[ecj-lint] Resource leak: 'parser' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 18. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/schema/TestSortableTextField.java (at line 491)
[ecj-lint] final SolrClient client = new EmbeddedSolrServer(h.getCore());
[ecj-lint] ^^^^^^
[ecj-lint] Resource leak: 'client' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 19. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 243)
[ecj-lint] return loadfactor!=0 ? new HashDocSet(a,0,n,1/loadfactor) : new HashDocSet(a,0,n);
[ecj-lint] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
[ecj-lint] ----------
[ecj-lint] 20. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 528)
[ecj-lint] DocSet a = new BitDocSet(bs);
[ecj-lint] ^
[ecj-lint] Resource leak: 'a' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 21. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 78)
[ecj-lint] final MockPKIAuthenticationPlugin mock = new MockPKIAuthenticationPlugin(null, nodeName);
[ecj-lint] ^^^^
[ecj-lint] Resource leak: 'mock' is never closed
[ecj-lint] ----------
[ecj-lint] 22. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 133)
[ecj-lint] MockPKIAuthenticationPlugin mock1 = new MockPKIAuthenticationPlugin(null, nodeName) {
[ecj-lint] ^^^^^
[ecj-lint] Resource leak: 'mock1' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 23. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestRuleBasedAuthorizationPlugin.java (at line 380)
[ecj-lint] RuleBasedAuthorizationPlugin plugin = new RuleBasedAuthorizationPlugin();
[ecj-lint] ^^^^^^
[ecj-lint] Resource leak: 'plugin' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 24. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestSha256AuthenticationProvider.java (at line 49)
[ecj-lint] BasicAuthPlugin basicAuthPlugin = new BasicAuthPlugin();
[ecj-lint] ^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: 'basicAuthPlugin' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 25. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/spelling/SimpleQueryConverter.java (at line 42)
[ecj-lint] WhitespaceAnalyzer analyzer = new WhitespaceAnalyzer();
[ecj-lint] ^^^^^^^^
[ecj-lint] Resource leak: 'analyzer' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 26. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 139)
[ecj-lint] IndexWriter w = new IndexWriter(d, newIndexWriterConfig(analyzer));
[ecj-lint] ^
[ecj-lint] Resource leak: 'w' is never closed
[ecj-lint] ----------
[ecj-lint] 27. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 172)
[ecj-lint] throw iae;
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'w' is not closed at this location
[ecj-lint] ----------
[ecj-lint] 28. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 178)
[ecj-lint] return;
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'w' is not closed at this location
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 29. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 134)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 30. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 333)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 31. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 367)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 32. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 413)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 33. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 458)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 34. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 516)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 35. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 181)
[ecj-lint] EmbeddedSolrServer server1 = new EmbeddedSolrServer(h.getCoreContainer(), "split1");
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'server1' is never closed
[ecj-lint] ----------
[ecj-lint] 36. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 182)
[ecj-lint] EmbeddedSolrServer server2 = new EmbeddedSolrServer(h.getCoreContainer(), "split2");
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'server2' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 37. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/processor/RecordingUpdateProcessorFactory.java (at line 67)
[ecj-lint] return recording ? new RecordingUpdateRequestProcessor(commandQueue, next) : next;
[ecj-lint] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
[ecj-lint] ----------
[ecj-lint] 37 problems (4 errors, 33 warnings)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:618: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:101: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build.xml:682: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:2087: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:2120: Compile failed; see the compiler error output for details.
Total time: 77 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-7.x - Build # 407 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/407/
2 tests failed.
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Could not find collection:collection2
Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
at __randomizedtesting.SeedInfo.seed([1B878E765BE6B3E1:93D3B1ACF51ADE19]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:915)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:612)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
expected:<5> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
at __randomizedtesting.SeedInfo.seed([1B878E765BE6B3E1:767B2A8BE1AE4CE6]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:265)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12269 lines...]
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/init-core-data-001
[junit4] 2> 83696 WARN (SUITE-FullSolrCloudDistribCmdsTest-seed#[1B878E765BE6B3E1]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 84212 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[1B878E765BE6B3E1]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 84213 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[1B878E765BE6B3E1]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 84213 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[1B878E765BE6B3E1]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 84217 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[1B878E765BE6B3E1]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 84224 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 84224 INFO (Thread-180) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 84224 INFO (Thread-180) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 84226 ERROR (Thread-180) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 84324 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.ZkTestServer start zk server on port:48110
[junit4] 2> 84336 INFO (zkConnectionManagerCallback-201-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 84351 INFO (zkConnectionManagerCallback-203-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 84356 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 84357 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 84359 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 84360 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 84361 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 84362 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 84363 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 84364 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 84365 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 84366 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 84367 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 84369 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 84455 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 84457 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 84457 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 84457 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 84457 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7edd55d0{/,null,AVAILABLE}
[junit4] 2> 84460 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4a1c9d5{HTTP/1.1,[http/1.1]}{127.0.0.1:54347}
[junit4] 2> 84460 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.Server Started @86681ms
[junit4] 2> 84460 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/tempDir-001/control/data, replicaType=NRT, hostContext=/, hostPort=54347, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/control-001/cores}
[junit4] 2> 84460 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 84460 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 84460 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 84460 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 84460 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T14:02:28.522Z
[junit4] 2> 84463 INFO (zkConnectionManagerCallback-205-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 84465 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 84465 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/control-001/solr.xml
[junit4] 2> 84469 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 84469 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 84470 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 84480 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48110/solr
[junit4] 2> 84481 INFO (zkConnectionManagerCallback-209-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 84487 INFO (zkConnectionManagerCallback-211-thread-1-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 84560 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:54347_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 84560 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:54347_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54347_
[junit4] 2> 84561 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:54347_ ] o.a.s.c.Overseer Overseer (id=73305508032348164-127.0.0.1:54347_-n_0000000000) starting
[junit4] 2> 84567 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:54347_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54347_
[junit4] 2> 84569 INFO (OverseerStateUpdate-73305508032348164-127.0.0.1:54347_-n_0000000000) [n:127.0.0.1:54347_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 84634 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:54347_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 84642 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:54347_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 84642 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:54347_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 84644 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:54347_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/control-001/cores
[junit4] 2> 84661 INFO (zkConnectionManagerCallback-217-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 84662 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 84663 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:48110/solr ready
[junit4] 2> 84665 INFO (qtp685239534-865) [n:127.0.0.1:54347_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:54347_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 84667 INFO (OverseerThreadFactory-390-thread-1-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 84775 INFO (qtp685239534-873) [n:127.0.0.1:54347_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 84775 INFO (qtp685239534-873) [n:127.0.0.1:54347_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 84879 INFO (zkCallback-210-thread-1-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 85793 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 85826 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 85935 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 85951 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 85951 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 85951 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 85951 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 85954 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 85957 WARN (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 85997 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 85998 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 85999 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 85999 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 86000 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 86001 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7ade3420[control_collection_shard1_replica_n1] main]
[junit4] 2> 86002 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 86003 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 86004 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 86005 INFO (searcherExecutor-393-thread-1-processing-n:127.0.0.1:54347_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@7ade3420[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 86005 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592566480966254592
[junit4] 2> 86014 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 86014 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 86014 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:54347/control_collection_shard1_replica_n1/
[junit4] 2> 86014 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 86014 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:54347/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 86014 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 86017 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:54347/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 86120 INFO (zkCallback-210-thread-2-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 86168 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 86171 INFO (qtp685239534-873) [n:127.0.0.1:54347_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1396
[junit4] 2> 86184 INFO (qtp685239534-865) [n:127.0.0.1:54347_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 86271 INFO (zkCallback-210-thread-2-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 86673 INFO (OverseerCollectionConfigSetProcessor-73305508032348164-127.0.0.1:54347_-n_0000000000) [n:127.0.0.1:54347_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 87185 INFO (qtp685239534-865) [n:127.0.0.1:54347_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:54347_&wt=javabin&version=2} status=0 QTime=2519
[junit4] 2> 87190 INFO (zkConnectionManagerCallback-221-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 87191 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 87192 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:48110/solr ready
[junit4] 2> 87192 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 87193 INFO (qtp685239534-873) [n:127.0.0.1:54347_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 87196 INFO (OverseerThreadFactory-390-thread-2-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 87196 WARN (OverseerThreadFactory-390-thread-2-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 87402 INFO (qtp685239534-873) [n:127.0.0.1:54347_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 87403 INFO (qtp685239534-873) [n:127.0.0.1:54347_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=209
[junit4] 2> 87491 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-1-001 of type NRT
[junit4] 2> 87492 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 87504 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 87504 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 87504 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 87505 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9e8a2c2{/,null,AVAILABLE}
[junit4] 2> 87505 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@79daf251{HTTP/1.1,[http/1.1]}{127.0.0.1:53251}
[junit4] 2> 87505 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.Server Started @89726ms
[junit4] 2> 87505 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=53251, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-1-001/cores}
[junit4] 2> 87506 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 87506 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 87506 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 87506 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 87506 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T14:02:31.568Z
[junit4] 2> 87508 INFO (zkConnectionManagerCallback-223-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 87510 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 87510 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-1-001/solr.xml
[junit4] 2> 87513 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 87513 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 87515 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 87523 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48110/solr
[junit4] 2> 87528 INFO (zkConnectionManagerCallback-227-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 87535 INFO (zkConnectionManagerCallback-229-thread-1-processing-n:127.0.0.1:53251_) [n:127.0.0.1:53251_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 87546 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:53251_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 87548 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:53251_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 87550 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:53251_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53251_
[junit4] 2> 87551 INFO (zkCallback-220-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 87551 INFO (zkCallback-210-thread-1-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 87558 INFO (zkCallback-228-thread-1-processing-n:127.0.0.1:53251_) [n:127.0.0.1:53251_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 87626 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:53251_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 87635 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:53251_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 87635 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:53251_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 87636 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:53251_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-1-001/cores
[junit4] 2> 87663 INFO (qtp1902026942-918) [n:127.0.0.1:53251_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:53251_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 89203 INFO (OverseerCollectionConfigSetProcessor-73305508032348164-127.0.0.1:54347_-n_0000000000) [n:127.0.0.1:54347_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 89210 INFO (OverseerThreadFactory-390-thread-3-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:53251_ for creating new replica
[junit4] 2> 89214 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 89214 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 90240 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 90255 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.IndexSchema [collection1_shard2_replica_n61] Schema name=test
[junit4] 2> 90395 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 90423 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n61' using configuration from collection collection1, trusted=true
[junit4] 2> 90423 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n61' (registry 'solr.core.collection1.shard2.replica_n61') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 90423 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 90423 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrCore [[collection1_shard2_replica_n61] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-1-001/cores/collection1_shard2_replica_n61], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-1-001/cores/collection1_shard2_replica_n61/data/]
[junit4] 2> 90426 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 90428 WARN (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 90465 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 90465 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 90466 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 90466 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 90467 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 90468 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.SolrIndexSearcher Opening [Searcher@37a323a1[collection1_shard2_replica_n61] main]
[junit4] 2> 90469 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 90469 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 90469 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 90470 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592566485648146432
[junit4] 2> 90476 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 90476 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 90476 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53251/collection1_shard2_replica_n61/
[junit4] 2> 90476 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 90476 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy http://127.0.0.1:53251/collection1_shard2_replica_n61/ has no replicas
[junit4] 2> 90476 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 90478 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:53251/collection1_shard2_replica_n61/ shard2
[junit4] 2> 90480 INFO (searcherExecutor-404-thread-1-processing-n:127.0.0.1:53251_ x:collection1_shard2_replica_n61 s:shard2 c:collection1) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrCore [collection1_shard2_replica_n61] Registered new searcher Searcher@37a323a1[collection1_shard2_replica_n61] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 90631 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 90633 INFO (qtp1902026942-922) [n:127.0.0.1:53251_ c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1419
[junit4] 2> 90636 INFO (qtp1902026942-918) [n:127.0.0.1:53251_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:53251_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=2973
[junit4] 2> 90736 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-2-001 of type NRT
[junit4] 2> 90736 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 90737 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 90737 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 90737 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 90738 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@31151a7e{/,null,AVAILABLE}
[junit4] 2> 90738 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3609125{HTTP/1.1,[http/1.1]}{127.0.0.1:34543}
[junit4] 2> 90738 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.Server Started @92959ms
[junit4] 2> 90738 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=34543, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-2-001/cores}
[junit4] 2> 90738 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 90740 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 90740 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 90740 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 90740 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T14:02:34.802Z
[junit4] 2> 90749 INFO (zkConnectionManagerCallback-233-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 90751 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 90751 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-2-001/solr.xml
[junit4] 2> 90755 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 90755 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 90756 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 90761 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48110/solr
[junit4] 2> 90771 INFO (zkConnectionManagerCallback-237-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 90787 INFO (zkConnectionManagerCallback-239-thread-1-processing-n:127.0.0.1:34543_) [n:127.0.0.1:34543_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 90793 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:34543_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 90795 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:34543_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 90796 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:34543_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34543_
[junit4] 2> 90798 INFO (zkCallback-228-thread-1-processing-n:127.0.0.1:53251_) [n:127.0.0.1:53251_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 90798 INFO (zkCallback-220-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 90798 INFO (zkCallback-210-thread-1-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 90803 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:34543_) [n:127.0.0.1:34543_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 90960 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:34543_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 90968 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:34543_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 90969 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:34543_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 90970 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:34543_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-2-001/cores
[junit4] 2> 91011 INFO (qtp1211887661-949) [n:127.0.0.1:34543_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:34543_&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 91013 INFO (OverseerCollectionConfigSetProcessor-73305508032348164-127.0.0.1:54347_-n_0000000000) [n:127.0.0.1:54347_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 91014 INFO (OverseerThreadFactory-390-thread-4-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:34543_ for creating new replica
[junit4] 2> 91017 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 91017 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 92029 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 92051 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.IndexSchema [collection1_shard3_replica_n63] Schema name=test
[junit4] 2> 92147 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 92177 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard3_replica_n63' using configuration from collection collection1, trusted=true
[junit4] 2> 92178 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard3.replica_n63' (registry 'solr.core.collection1.shard3.replica_n63') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 92178 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 92178 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrCore [[collection1_shard3_replica_n63] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-2-001/cores/collection1_shard3_replica_n63], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-2-001/cores/collection1_shard3_replica_n63/data/]
[junit4] 2> 92181 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 92183 WARN (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 92233 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 92233 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 92234 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 92234 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 92235 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 92235 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.SolrIndexSearcher Opening [Searcher@348b8de8[collection1_shard3_replica_n63] main]
[junit4] 2> 92236 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 92237 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 92237 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 92238 INFO (searcherExecutor-415-thread-1-processing-n:127.0.0.1:34543_ x:collection1_shard3_replica_n63 s:shard3 c:collection1) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrCore [collection1_shard3_replica_n63] Registered new searcher Searcher@348b8de8[collection1_shard3_replica_n63] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 92238 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592566487502028800
[junit4] 2> 92244 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 92244 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 92244 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34543/collection1_shard3_replica_n63/
[junit4] 2> 92244 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 92244 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy http://127.0.0.1:34543/collection1_shard3_replica_n63/ has no replicas
[junit4] 2> 92244 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 92247 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34543/collection1_shard3_replica_n63/ shard3
[junit4] 2> 92398 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 92399 INFO (qtp1211887661-953) [n:127.0.0.1:34543_ c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1382
[junit4] 2> 92402 INFO (qtp1211887661-949) [n:127.0.0.1:34543_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:34543_&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2} status=0 QTime=1390
[junit4] 2> 92487 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-3-001 of type NRT
[junit4] 2> 92487 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 92488 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 92488 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 92489 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 92489 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c1073d0{/,null,AVAILABLE}
[junit4] 2> 92489 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7ba61753{HTTP/1.1,[http/1.1]}{127.0.0.1:40663}
[junit4] 2> 92489 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.Server Started @94710ms
[junit4] 2> 92489 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/tempDir-001/jetty3, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=40663, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-3-001/cores}
[junit4] 2> 92490 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 92490 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 92490 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 92490 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 92490 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T14:02:36.552Z
[junit4] 2> 92492 INFO (zkConnectionManagerCallback-243-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 92493 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 92493 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-3-001/solr.xml
[junit4] 2> 92497 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 92497 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 92498 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 92501 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48110/solr
[junit4] 2> 92503 INFO (zkConnectionManagerCallback-247-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 92506 INFO (zkConnectionManagerCallback-249-thread-1-processing-n:127.0.0.1:40663_) [n:127.0.0.1:40663_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 92511 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:40663_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 92512 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:40663_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 92514 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:40663_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40663_
[junit4] 2> 92515 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:34543_) [n:127.0.0.1:34543_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 92515 INFO (zkCallback-210-thread-1-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 92515 INFO (zkCallback-220-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 92515 INFO (zkCallback-228-thread-1-processing-n:127.0.0.1:53251_) [n:127.0.0.1:53251_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 92516 INFO (zkCallback-248-thread-1-processing-n:127.0.0.1:40663_) [n:127.0.0.1:40663_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 92629 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:40663_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 92637 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:40663_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 92637 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:40663_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 92638 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:40663_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-3-001/cores
[junit4] 2> 92674 INFO (qtp1211887661-951) [n:127.0.0.1:34543_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40663_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 92676 INFO (OverseerCollectionConfigSetProcessor-73305508032348164-127.0.0.1:54347_-n_0000000000) [n:127.0.0.1:54347_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 92676 INFO (OverseerThreadFactory-390-thread-5-processing-n:127.0.0.1:54347_) [n:127.0.0.1:54347_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:40663_ for creating new replica
[junit4] 2> 92680 INFO (qtp310749201-980) [n:127.0.0.1:40663_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n65&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 92680 INFO (qtp310749201-980) [n:127.0.0.1:40663_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 93695 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 93708 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.s.IndexSchema [collection1_shard1_replica_n65] Schema name=test
[junit4] 2> 93820 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 93844 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n65' using configuration from collection collection1, trusted=true
[junit4] 2> 93845 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n65' (registry 'solr.core.collection1.shard1.replica_n65') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324
[junit4] 2> 93846 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 93846 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SolrCore [[collection1_shard1_replica_n65] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-3-001/cores/collection1_shard1_replica_n65], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-3-001/cores/collection1_shard1_replica_n65/data/]
[junit4] 2> 93848 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 93857 WARN (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 93898 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 93898 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 93899 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 93899 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 93900 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 93901 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.s.SolrIndexSearcher Opening [Searcher@459a2d24[collection1_shard1_replica_n65] main]
[junit4] 2> 93902 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 93904 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 93904 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 93905 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592566489250004992
[junit4] 2> 93906 INFO (searcherExecutor-426-thread-1-processing-n:127.0.0.1:40663_ x:collection1_shard1_replica_n65 s:shard1 c:collection1) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SolrCore [collection1_shard1_replica_n65] Registered new searcher Searcher@459a2d24[collection1_shard1_replica_n65] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 93911 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 93911 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 93911 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40663/collection1_shard1_replica_n65/
[junit4] 2> 93911 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 93911 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SyncStrategy http://127.0.0.1:40663/collection1_shard1_replica_n65/ has no replicas
[junit4] 2> 93911 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 93913 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40663/collection1_shard1_replica_n65/ shard1
[junit4] 2> 94064 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 94066 INFO (qtp310749201-980) [n:127.0.0.1:40663_ c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n65&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1386
[junit4] 2> 94068 INFO (qtp1211887661-951) [n:127.0.0.1:34543_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40663_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1394
[junit4] 2> 94153 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-4-001 of type NRT
[junit4] 2> 94154 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 94155 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 94155 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 94155 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 94156 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@56b539f2{/,null,AVAILABLE}
[junit4] 2> 94156 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@596a33d6{HTTP/1.1,[http/1.1]}{127.0.0.1:34005}
[junit4] 2> 94156 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.e.j.s.Server Started @96377ms
[junit4] 2> 94156 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/tempDir-001/jetty4, solrconfig=solrconfig.xml, hostContext=/, hostPort=34005, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-4-001/cores}
[junit4] 2> 94157 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 94158 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 94159 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 94159 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 94159 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-16T14:02:38.221Z
[junit4] 2> 94160 INFO (zkConnectionManagerCallback-253-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 94162 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 94162 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_1B878E765BE6B3E1-001/shard-4-001/solr.xml
[junit4] 2> 94165 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 94165 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 94177 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@26296324, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 94179 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48110/solr
[junit4] 2> 94185 INFO (zkConnectionManagerCallback-257-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 94188 INFO (zkConnectionManagerCallback-259-thread-1-processing-n:127.0.0.1:34005_) [n:127.0.0.1:34005_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 94194 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[1B878E765BE6B3E1]) [n:127.0.0.1:34005_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 94196 INFO (TEST-FullSolrCloudDistribCmdsTest
[...truncated too long message...]
rc/test/org/apache/solr/highlight/HighlighterTest.java (at line 204)
[ecj-lint] Analyzer a1 = new WhitespaceAnalyzer();
[ecj-lint] ^^
[ecj-lint] Resource leak: 'a1' is never closed
[ecj-lint] ----------
[ecj-lint] 15. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 207)
[ecj-lint] OffsetWindowTokenFilter tots = new OffsetWindowTokenFilter(tokenStream);
[ecj-lint] ^^^^
[ecj-lint] Resource leak: 'tots' is never closed
[ecj-lint] ----------
[ecj-lint] 16. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 211)
[ecj-lint] Analyzer a2 = new WhitespaceAnalyzer();
[ecj-lint] ^^
[ecj-lint] Resource leak: 'a2' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 17. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/response/TestJavabinTupleStreamParser.java (at line 72)
[ecj-lint] JavabinTupleStreamParser parser = new JavabinTupleStreamParser(new ByteArrayInputStream(bytes), true);
[ecj-lint] ^^^^^^
[ecj-lint] Resource leak: 'parser' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 18. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/schema/TestSortableTextField.java (at line 491)
[ecj-lint] final SolrClient client = new EmbeddedSolrServer(h.getCore());
[ecj-lint] ^^^^^^
[ecj-lint] Resource leak: 'client' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 19. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 243)
[ecj-lint] return loadfactor!=0 ? new HashDocSet(a,0,n,1/loadfactor) : new HashDocSet(a,0,n);
[ecj-lint] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
[ecj-lint] ----------
[ecj-lint] 20. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 528)
[ecj-lint] DocSet a = new BitDocSet(bs);
[ecj-lint] ^
[ecj-lint] Resource leak: 'a' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 21. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 78)
[ecj-lint] final MockPKIAuthenticationPlugin mock = new MockPKIAuthenticationPlugin(null, nodeName);
[ecj-lint] ^^^^
[ecj-lint] Resource leak: 'mock' is never closed
[ecj-lint] ----------
[ecj-lint] 22. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 133)
[ecj-lint] MockPKIAuthenticationPlugin mock1 = new MockPKIAuthenticationPlugin(null, nodeName) {
[ecj-lint] ^^^^^
[ecj-lint] Resource leak: 'mock1' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 23. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestRuleBasedAuthorizationPlugin.java (at line 380)
[ecj-lint] RuleBasedAuthorizationPlugin plugin = new RuleBasedAuthorizationPlugin();
[ecj-lint] ^^^^^^
[ecj-lint] Resource leak: 'plugin' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 24. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/security/TestSha256AuthenticationProvider.java (at line 49)
[ecj-lint] BasicAuthPlugin basicAuthPlugin = new BasicAuthPlugin();
[ecj-lint] ^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: 'basicAuthPlugin' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 25. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/spelling/SimpleQueryConverter.java (at line 42)
[ecj-lint] WhitespaceAnalyzer analyzer = new WhitespaceAnalyzer();
[ecj-lint] ^^^^^^^^
[ecj-lint] Resource leak: 'analyzer' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 26. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 139)
[ecj-lint] IndexWriter w = new IndexWriter(d, newIndexWriterConfig(analyzer));
[ecj-lint] ^
[ecj-lint] Resource leak: 'w' is never closed
[ecj-lint] ----------
[ecj-lint] 27. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 172)
[ecj-lint] throw iae;
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'w' is not closed at this location
[ecj-lint] ----------
[ecj-lint] 28. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 178)
[ecj-lint] return;
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'w' is not closed at this location
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 29. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 134)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 30. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 333)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 31. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 367)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 32. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 413)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 33. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 458)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 34. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 516)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 35. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 181)
[ecj-lint] EmbeddedSolrServer server1 = new EmbeddedSolrServer(h.getCoreContainer(), "split1");
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'server1' is never closed
[ecj-lint] ----------
[ecj-lint] 36. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 182)
[ecj-lint] EmbeddedSolrServer server2 = new EmbeddedSolrServer(h.getCoreContainer(), "split2");
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'server2' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 37. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test/org/apache/solr/update/processor/RecordingUpdateProcessorFactory.java (at line 67)
[ecj-lint] return recording ? new RecordingUpdateRequestProcessor(commandQueue, next) : next;
[ecj-lint] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
[ecj-lint] ----------
[ecj-lint] 37 problems (4 errors, 33 warnings)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:618: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:101: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build.xml:682: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:2087: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:2120: Compile failed; see the compiler error output for details.
Total time: 77 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any