You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/02/23 20:47:54 UTC
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 459 -
Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/459/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
4 tests failed.
FAILED: org.apache.solr.cloud.ReplaceNodeNoTargetTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([2765261D870EBA06:AF3119C729F2D7FE]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=37666, name=jetty-launcher-7298-thread-2-SendThread(127.0.0.1:36314), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063) 2) Thread[id=37596, name=jetty-launcher-7298-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) 3) Thread[id=37667, name=jetty-launcher-7298-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=37666, name=jetty-launcher-7298-thread-2-SendThread(127.0.0.1:36314), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
2) Thread[id=37596, name=jetty-launcher-7298-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
3) Thread[id=37667, name=jetty-launcher-7298-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
at __randomizedtesting.SeedInfo.seed([2765261D870EBA06]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=37666, name=jetty-launcher-7298-thread-2-SendThread(127.0.0.1:36314), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=37666, name=jetty-launcher-7298-thread-2-SendThread(127.0.0.1:36314), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
at __randomizedtesting.SeedInfo.seed([2765261D870EBA06]:0)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication
Error Message:
Index: 0, Size: 0
Stack Trace:
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at __randomizedtesting.SeedInfo.seed([2765261D870EBA06:332D7D48A4090718]:0)
at java.util.ArrayList.rangeCheck(ArrayList.java:657)
at java.util.ArrayList.get(ArrayList.java:433)
at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication(TestReplicationHandler.java:561)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13396 lines...]
[junit4] Suite: org.apache.solr.cloud.ReplaceNodeNoTargetTest
[junit4] 2> 2917752 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[2765261D870EBA06]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/init-core-data-001
[junit4] 2> 2917753 WARN (SUITE-ReplaceNodeNoTargetTest-seed#[2765261D870EBA06]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=21 numCloses=21
[junit4] 2> 2917753 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[2765261D870EBA06]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2917754 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[2765261D870EBA06]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 2917755 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[2765261D870EBA06]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 6 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001
[junit4] 2> 2917755 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[2765261D870EBA06]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2917755 INFO (Thread-1861) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2917755 INFO (Thread-1861) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2917791 ERROR (Thread-1861) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2917855 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[2765261D870EBA06]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:48387
[junit4] 2> 2917862 INFO (zkConnectionManagerCallback-2055-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917891 INFO (jetty-launcher-2052-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2917892 INFO (jetty-launcher-2052-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2917893 INFO (jetty-launcher-2052-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2917893 INFO (jetty-launcher-2052-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2917893 INFO (jetty-launcher-2052-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 2917893 INFO (jetty-launcher-2052-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a36053b{/solr,null,AVAILABLE}
[junit4] 2> 2917893 INFO (jetty-launcher-2052-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@624e0193{HTTP/1.1,[http/1.1]}{127.0.0.1:34283}
[junit4] 2> 2917893 INFO (jetty-launcher-2052-thread-1) [ ] o.e.j.s.Server Started @2924385ms
[junit4] 2> 2917893 INFO (jetty-launcher-2052-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34283}
[junit4] 2> 2917893 ERROR (jetty-launcher-2052-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2917893 INFO (jetty-launcher-2052-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 2917893 INFO (jetty-launcher-2052-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2917893 INFO (jetty-launcher-2052-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2917893 INFO (jetty-launcher-2052-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-23T20:00:19.853Z
[junit4] 2> 2917898 INFO (jetty-launcher-2052-thread-5) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2917898 INFO (jetty-launcher-2052-thread-6) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2917899 INFO (jetty-launcher-2052-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2917899 INFO (jetty-launcher-2052-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2917899 INFO (jetty-launcher-2052-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 2917899 INFO (jetty-launcher-2052-thread-4) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2917899 INFO (jetty-launcher-2052-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@14c5233b{/solr,null,AVAILABLE}
[junit4] 2> 2917900 INFO (jetty-launcher-2052-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@969d605{HTTP/1.1,[http/1.1]}{127.0.0.1:49548}
[junit4] 2> 2917900 INFO (jetty-launcher-2052-thread-2) [ ] o.e.j.s.Server Started @2924392ms
[junit4] 2> 2917900 INFO (jetty-launcher-2052-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49548}
[junit4] 2> 2917900 ERROR (jetty-launcher-2052-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2917900 INFO (jetty-launcher-2052-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 2917900 INFO (jetty-launcher-2052-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2917900 INFO (jetty-launcher-2052-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2917900 INFO (jetty-launcher-2052-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-23T20:00:19.860Z
[junit4] 2> 2917900 INFO (jetty-launcher-2052-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2917900 INFO (jetty-launcher-2052-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2917900 INFO (jetty-launcher-2052-thread-4) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2917901 INFO (jetty-launcher-2052-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2c8755c6{/solr,null,AVAILABLE}
[junit4] 2> 2917901 INFO (jetty-launcher-2052-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@64eb2b4a{HTTP/1.1,[http/1.1]}{127.0.0.1:52550}
[junit4] 2> 2917901 INFO (jetty-launcher-2052-thread-4) [ ] o.e.j.s.Server Started @2924393ms
[junit4] 2> 2917901 INFO (jetty-launcher-2052-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52550}
[junit4] 2> 2917901 ERROR (jetty-launcher-2052-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2917901 INFO (jetty-launcher-2052-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 2917901 INFO (jetty-launcher-2052-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2917901 INFO (jetty-launcher-2052-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2917901 INFO (jetty-launcher-2052-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-23T20:00:19.861Z
[junit4] 2> 2917902 INFO (jetty-launcher-2052-thread-5) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2917902 INFO (jetty-launcher-2052-thread-5) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2917902 INFO (jetty-launcher-2052-thread-5) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2917903 INFO (jetty-launcher-2052-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T12:27:37-09:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2917904 INFO (jetty-launcher-2052-thread-6) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2917904 INFO (jetty-launcher-2052-thread-6) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2917904 INFO (jetty-launcher-2052-thread-6) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-6) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@15cd5b4f{/solr,null,AVAILABLE}
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-5) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@59f4d4f8{/solr,null,AVAILABLE}
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-6) [ ] o.e.j.s.AbstractConnector Started ServerConnector@41499736{HTTP/1.1,[http/1.1]}{127.0.0.1:48767}
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-6) [ ] o.e.j.s.Server Started @2924397ms
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-6) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=48767}
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-5) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2dbab89a{HTTP/1.1,[http/1.1]}{127.0.0.1:50032}
[junit4] 2> 2917905 ERROR (jetty-launcher-2052-thread-6) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-5) [ ] o.e.j.s.Server Started @2924397ms
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-5) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=50032}
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-6) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-6) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-6) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2917905 INFO (jetty-launcher-2052-thread-6) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-23T20:00:19.865Z
[junit4] 2> 2917906 ERROR (jetty-launcher-2052-thread-5) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2917906 INFO (jetty-launcher-2052-thread-5) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 2917906 INFO (jetty-launcher-2052-thread-5) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2917906 INFO (jetty-launcher-2052-thread-5) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2917906 INFO (jetty-launcher-2052-thread-5) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-23T20:00:19.866Z
[junit4] 2> 2917910 INFO (zkConnectionManagerCallback-2057-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917917 INFO (jetty-launcher-2052-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2917917 INFO (jetty-launcher-2052-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2917917 INFO (jetty-launcher-2052-thread-3) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 2917917 INFO (jetty-launcher-2052-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@765692c8{/solr,null,AVAILABLE}
[junit4] 2> 2917918 INFO (jetty-launcher-2052-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@33c088d{HTTP/1.1,[http/1.1]}{127.0.0.1:45631}
[junit4] 2> 2917918 INFO (jetty-launcher-2052-thread-3) [ ] o.e.j.s.Server Started @2924409ms
[junit4] 2> 2917918 INFO (jetty-launcher-2052-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45631}
[junit4] 2> 2917918 ERROR (jetty-launcher-2052-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2917918 INFO (jetty-launcher-2052-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 2917918 INFO (jetty-launcher-2052-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2917918 INFO (jetty-launcher-2052-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2917918 INFO (jetty-launcher-2052-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-23T20:00:19.878Z
[junit4] 2> 2917919 INFO (jetty-launcher-2052-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2917919 INFO (zkConnectionManagerCallback-2065-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917920 INFO (zkConnectionManagerCallback-2063-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917921 INFO (zkConnectionManagerCallback-2061-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917923 INFO (jetty-launcher-2052-thread-6) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2917923 INFO (jetty-launcher-2052-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2917923 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100aedc3e0d0001, likely client has closed socket
[junit4] 2> 2917925 INFO (jetty-launcher-2052-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48387/solr
[junit4] 2> 2917926 INFO (zkConnectionManagerCallback-2059-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917944 INFO (jetty-launcher-2052-thread-6) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48387/solr
[junit4] 2> 2917944 INFO (jetty-launcher-2052-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48387/solr
[junit4] 2> 2917928 INFO (jetty-launcher-2052-thread-5) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2917927 INFO (zkConnectionManagerCallback-2071-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917954 INFO (zkConnectionManagerCallback-2079-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917927 INFO (zkConnectionManagerCallback-2067-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917949 INFO (zkConnectionManagerCallback-2077-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917948 INFO (jetty-launcher-2052-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2917959 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100aedc3e0d0004, likely client has closed socket
[junit4] 2> 2917961 INFO (jetty-launcher-2052-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48387/solr
[junit4] 2> 2917962 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100aedc3e0d0007, likely client has closed socket
[junit4] 2> 2917971 INFO (jetty-launcher-2052-thread-5) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48387/solr
[junit4] 2> 2917963 INFO (jetty-launcher-2052-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2917962 INFO (zkConnectionManagerCallback-2083-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917973 INFO (zkConnectionManagerCallback-2089-thread-1-processing-n:127.0.0.1:52550_solr) [n:127.0.0.1:52550_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917973 INFO (zkConnectionManagerCallback-2085-thread-1-processing-n:127.0.0.1:34283_solr) [n:127.0.0.1:34283_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2917978 INFO (zkConnectionManagerCallback-2093-thread-1-processing-n:127.0.0.1:48767_solr) [n:127.0.0.1:48767_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2918057 INFO (zkConnectionManagerCallback-2091-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2918060 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100aedc3e0d000d, likely client has closed socket
[junit4] 2> 2918071 INFO (zkConnectionManagerCallback-2096-thread-1-processing-n:127.0.0.1:50032_solr) [n:127.0.0.1:50032_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2918071 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100aedc3e0d0006, likely client has closed socket
[junit4] 2> 2918079 INFO (jetty-launcher-2052-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48387/solr
[junit4] 2> 2918083 INFO (zkConnectionManagerCallback-2100-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2918101 INFO (jetty-launcher-2052-thread-1) [n:127.0.0.1:34283_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2918100 INFO (jetty-launcher-2052-thread-6) [n:127.0.0.1:48767_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2918084 INFO (zkConnectionManagerCallback-2102-thread-1-processing-n:127.0.0.1:49548_solr) [n:127.0.0.1:49548_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2918115 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100aedc3e0d0010, likely client has closed socket
[junit4] 2> 2918116 INFO (jetty-launcher-2052-thread-1) [n:127.0.0.1:34283_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34283_solr
[junit4] 2> 2918120 INFO (jetty-launcher-2052-thread-5) [n:127.0.0.1:50032_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2918121 INFO (jetty-launcher-2052-thread-5) [n:127.0.0.1:50032_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50032_solr
[junit4] 2> 2918160 INFO (jetty-launcher-2052-thread-6) [n:127.0.0.1:48767_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48767_solr
[junit4] 2> 2918166 INFO (zkConnectionManagerCallback-2107-thread-1-processing-n:127.0.0.1:45631_solr) [n:127.0.0.1:45631_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2918169 INFO (jetty-launcher-2052-thread-6) [n:127.0.0.1:48767_solr ] o.a.s.c.Overseer Overseer (id=72249854995005454-127.0.0.1:48767_solr-n_0000000000) starting
[junit4] 2> 2918174 INFO (jetty-launcher-2052-thread-2) [n:127.0.0.1:49548_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2918176 INFO (jetty-launcher-2052-thread-2) [n:127.0.0.1:49548_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2918178 INFO (jetty-launcher-2052-thread-2) [n:127.0.0.1:49548_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49548_solr
[junit4] 2> 2918231 INFO (jetty-launcher-2052-thread-6) [n:127.0.0.1:48767_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48767_solr
[junit4] 2> 2918273 INFO (zkCallback-2095-thread-1-processing-n:127.0.0.1:50032_solr) [n:127.0.0.1:50032_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2918273 INFO (zkCallback-2084-thread-1-processing-n:127.0.0.1:34283_solr) [n:127.0.0.1:34283_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2918274 INFO (zkCallback-2092-thread-1-processing-n:127.0.0.1:48767_solr) [n:127.0.0.1:48767_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2918274 INFO (zkCallback-2101-thread-1-processing-n:127.0.0.1:49548_solr) [n:127.0.0.1:49548_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2918280 INFO (jetty-launcher-2052-thread-3) [n:127.0.0.1:45631_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2918280 INFO (zkCallback-2084-thread-3-processing-n:127.0.0.1:34283_solr) [n:127.0.0.1:34283_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2918280 INFO (zkCallback-2101-thread-2-processing-n:127.0.0.1:49548_solr) [n:127.0.0.1:49548_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2918284 INFO (jetty-launcher-2052-thread-3) [n:127.0.0.1:45631_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2918286 INFO (jetty-launcher-2052-thread-3) [n:127.0.0.1:45631_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45631_solr
[junit4] 2> 2918373 INFO (jetty-launcher-2052-thread-1) [n:127.0.0.1:34283_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34283.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918378 INFO (jetty-launcher-2052-thread-1) [n:127.0.0.1:34283_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34283.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918378 INFO (jetty-launcher-2052-thread-1) [n:127.0.0.1:34283_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34283.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918379 INFO (jetty-launcher-2052-thread-1) [n:127.0.0.1:34283_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node1/.
[junit4] 2> 2918380 INFO (zkCallback-2101-thread-2-processing-n:127.0.0.1:49548_solr) [n:127.0.0.1:49548_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2918380 INFO (zkCallback-2084-thread-3-processing-n:127.0.0.1:34283_solr) [n:127.0.0.1:34283_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2918380 INFO (zkCallback-2092-thread-3-processing-n:127.0.0.1:48767_solr) [n:127.0.0.1:48767_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 2918393 INFO (jetty-launcher-2052-thread-4) [n:127.0.0.1:52550_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 2918395 INFO (jetty-launcher-2052-thread-4) [n:127.0.0.1:52550_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2918398 INFO (jetty-launcher-2052-thread-4) [n:127.0.0.1:52550_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52550_solr
[junit4] 2> 2918409 INFO (zkCallback-2101-thread-2-processing-n:127.0.0.1:49548_solr) [n:127.0.0.1:49548_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 2918409 INFO (zkCallback-2084-thread-3-processing-n:127.0.0.1:34283_solr) [n:127.0.0.1:34283_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 2918410 INFO (zkCallback-2092-thread-3-processing-n:127.0.0.1:48767_solr) [n:127.0.0.1:48767_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 2918413 INFO (jetty-launcher-2052-thread-5) [n:127.0.0.1:50032_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50032.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918416 INFO (zkCallback-2106-thread-1-processing-n:127.0.0.1:45631_solr) [n:127.0.0.1:45631_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (6)
[junit4] 2> 2918416 INFO (zkCallback-2088-thread-1-processing-n:127.0.0.1:52550_solr) [n:127.0.0.1:52550_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 2918422 INFO (jetty-launcher-2052-thread-5) [n:127.0.0.1:50032_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50032.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918422 INFO (jetty-launcher-2052-thread-5) [n:127.0.0.1:50032_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50032.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918422 INFO (jetty-launcher-2052-thread-5) [n:127.0.0.1:50032_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node3/.
[junit4] 2> 2918449 INFO (zkCallback-2095-thread-4-processing-n:127.0.0.1:50032_solr) [n:127.0.0.1:50032_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (6)
[junit4] 2> 2918482 INFO (jetty-launcher-2052-thread-3) [n:127.0.0.1:45631_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45631.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918536 INFO (jetty-launcher-2052-thread-6) [n:127.0.0.1:48767_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48767.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918541 INFO (jetty-launcher-2052-thread-6) [n:127.0.0.1:48767_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48767.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918541 INFO (jetty-launcher-2052-thread-6) [n:127.0.0.1:48767_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48767.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918542 INFO (jetty-launcher-2052-thread-6) [n:127.0.0.1:48767_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node4/.
[junit4] 2> 2918655 INFO (jetty-launcher-2052-thread-2) [n:127.0.0.1:49548_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49548.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918659 INFO (jetty-launcher-2052-thread-3) [n:127.0.0.1:45631_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45631.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918659 INFO (jetty-launcher-2052-thread-3) [n:127.0.0.1:45631_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45631.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918663 INFO (jetty-launcher-2052-thread-3) [n:127.0.0.1:45631_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node6/.
[junit4] 2> 2918681 INFO (jetty-launcher-2052-thread-2) [n:127.0.0.1:49548_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49548.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918682 INFO (jetty-launcher-2052-thread-2) [n:127.0.0.1:49548_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49548.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918682 INFO (jetty-launcher-2052-thread-2) [n:127.0.0.1:49548_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node2/.
[junit4] 2> 2918722 INFO (jetty-launcher-2052-thread-4) [n:127.0.0.1:52550_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52550.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918726 INFO (jetty-launcher-2052-thread-4) [n:127.0.0.1:52550_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52550.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918726 INFO (jetty-launcher-2052-thread-4) [n:127.0.0.1:52550_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52550.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2918727 INFO (jetty-launcher-2052-thread-4) [n:127.0.0.1:52550_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node5/.
[junit4] 2> 2918859 INFO (zkConnectionManagerCallback-2117-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2918863 INFO (zkConnectionManagerCallback-2121-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2918865 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[2765261D870EBA06]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (6)
[junit4] 2> 2918866 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[2765261D870EBA06]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:48387/solr ready
[junit4] 2> 2919463 INFO (TEST-ReplaceNodeNoTargetTest.test-seed#[2765261D870EBA06]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 2919464 INFO (zkConnectionManagerCallback-2123-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2919466 INFO (TEST-ReplaceNodeNoTargetTest.test-seed#[2765261D870EBA06]) [ ] o.a.s.c.ReplaceNodeNoTargetTest total_jettys: 6
[junit4] 2> 2919469 INFO (qtp103419525-12726) [n:127.0.0.1:34283_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919471 INFO (qtp2097155962-12787) [n:127.0.0.1:45631_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919538 INFO (qtp1511530316-12770) [n:127.0.0.1:48767_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919539 INFO (qtp1134285751-12737) [n:127.0.0.1:49548_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919541 INFO (qtp2083173310-12757) [n:127.0.0.1:50032_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919544 INFO (qtp1933041858-12746) [n:127.0.0.1:52550_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919545 INFO (qtp1933041858-12747) [n:127.0.0.1:52550_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=77
[junit4] 2> 2919545 INFO (qtp1933041858-12749) [n:127.0.0.1:52550_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=2&collection.configName=conf1&name=replacenodetest_coll_notarget&nrtReplicas=2&action=CREATE&numShards=5&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2919548 INFO (OverseerThreadFactory-5033-thread-1-processing-n:127.0.0.1:48767_solr) [n:127.0.0.1:48767_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection replacenodetest_coll_notarget
[junit4] 2> 2919583 INFO (qtp103419525-12726) [n:127.0.0.1:34283_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919591 INFO (qtp2097155962-12787) [n:127.0.0.1:45631_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919592 INFO (qtp1511530316-12770) [n:127.0.0.1:48767_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919593 INFO (qtp1134285751-12737) [n:127.0.0.1:49548_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919594 INFO (qtp2083173310-12757) [n:127.0.0.1:50032_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919596 INFO (qtp1933041858-12748) [n:127.0.0.1:52550_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2919599 INFO (OverseerThreadFactory-5033-thread-1-processing-n:127.0.0.1:48767_solr) [n:127.0.0.1:48767_solr ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2933671230 sessionWrapper.createTime 2933671227344921, this.sessionWrapper.createTime 2933671227344921
[junit4] 2> 2919718 INFO (OverseerStateUpdate-72249854995005454-127.0.0.1:48767_solr-n_0000000000) [n:127.0.0.1:48767_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52550/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2919722 INFO (OverseerStateUpdate-72249854995005454-127.0.0.1:48767_solr-n_0000000000) [n:127.0.0.1:48767_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50032/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2919725 INFO (OverseerStateUpdate-72249854995005454-127.0.0.1:48767_solr-n_0000000000) [n:127.0.0.1:48767_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:49548/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2919730 INFO (OverseerStateUpdate-72249854995005454-127.0.0.1:48767_solr-n_0000000000) [n:127.0.0.1:48767_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard2_replica_n7",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48767/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2919734 INFO (OverseerStateUpdate-72249854995005454-127.0.0.1:48767_solr-n_0000000000) [n:127.0.0.1:48767_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard3_replica_n8",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45631/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2919737 INFO (OverseerStateUpdate-72249854995005454-127.0.0.1:48767_solr-n_0000000000) [n:127.0.0.1:48767_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard3_replica_n10",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34283/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2919740 INFO (OverseerStateUpdate-72249854995005454-127.0.0.1:48767_solr-n_0000000000) [n:127.0.0.1:48767_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard4",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard4_replica_n12",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34283/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2919744 INFO (OverseerStateUpdate-72249854995005454-127.0.0.1:48767_solr-n_0000000000) [n:127.0.0.1:48767_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard4",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard4_replica_n14",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45631/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2919758 INFO (OverseerStateUpdate-72249854995005454-127.0.0.1:48767_solr-n_0000000000) [n:127.0.0.1:48767_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard5",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard5_replica_n16",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48767/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2919763 INFO (OverseerStateUpdate-72249854995005454-127.0.0.1:48767_solr-n_0000000000) [n:127.0.0.1:48767_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard5",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard5_replica_n18",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:49548/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2919967 INFO (qtp1933041858-12748) [n:127.0.0.1:52550_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard1_replica_n1&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2919970 INFO (qtp1933041858-12748) [n:127.0.0.1:52550_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2919972 INFO (qtp2083173310-12757) [n:127.0.0.1:50032_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard1_replica_n2&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2919972 INFO (qtp2097155962-12792) [n:127.0.0.1:45631_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node17&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard4_replica_n14&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard4&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2919972 INFO (qtp2083173310-12757) [n:127.0.0.1:50032_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2919973 INFO (qtp2097155962-12792) [n:127.0.0.1:45631_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2919973 INFO (qtp103419525-12726) [n:127.0.0.1:34283_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard3_replica_n10&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2919973 INFO (qtp2097155962-12787) [n:127.0.0.1:45631_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard3_replica_n8&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2919973 INFO (qtp103419525-12726) [n:127.0.0.1:34283_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2919973 INFO (qtp103419525-12731) [n:127.0.0.1:34283_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard4_replica_n12&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard4&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2919973 INFO (qtp1134285751-12737) [n:127.0.0.1:49548_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard2_replica_n4&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2919973 INFO (qtp1134285751-12737) [n:127.0.0.1:49548_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2919973 INFO (qtp1134285751-12739) [n:127.0.0.1:49548_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node20&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard5_replica_n18&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard5&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2919974 INFO (qtp1511530316-12772) [n:127.0.0.1:48767_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard2_replica_n7&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2919974 INFO (qtp1511530316-12770) [n:127.0.0.1:48767_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node19&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard5_replica_n16&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard5&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2919974 INFO (qtp1511530316-12772) [n:127.0.0.1:48767_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2920093 INFO (zkCallback-2095-thread-4-processing-n:127.0.0.1:50032_solr) [n:127.0.0.1:50032_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2920093 INFO (zkCallback-2101-thread-1-processing-n:127.0.0.1:49548_solr) [n:127.0.0.1:49548_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2920093 INFO (zkCallback-2084-thread-3-processing-n:127.0.0.1:34283_solr) [n:127.0.0.1:34283_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2920093 INFO (zkCallback-2106-thread-1-processing-n:127.0.0.1:45631_solr) [n:127.0.0.1:45631_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2920093 INFO (zkCallback-2088-thread-1-processing-n:127.0.0.1:52550_solr) [n:127.0.0.1:52550_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2920093 INFO (zkCallback-2101-thread-2-processing-n:127.0.0.1:49548_solr) [n:127.0.0.1:49548_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2920093 INFO (zkCallback-2088-thread-2-processing-n:127.0.0.1:52550_solr) [n:127.0.0.1:52550_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2920093 INFO (zkCallback-2106-thread-2-processing-n:127.0.0.1:45631_solr) [n:127.0.0.1:45631_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2920093 INFO (zkCallback-2084-thread-2-processing-n:127.0.0.1:34283_solr) [n:127.0.0.1:34283_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2920093 INFO (zkCallback-2095-thread-3-processing-n:127.0.0.1:50032_solr) [n:127.0.0.1:50032_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2920094 INFO (zkCallback-2092-thread-3-processing-n:127.0.0.1:48767_solr) [n:127.0.0.1:48767_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2920095 INFO (zkCallback-2092-thread-2-processing-n:127.0.0.1:48767_solr) [n:127.0.0.1:48767_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 2921006 INFO (qtp103419525-12731) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2921010 INFO (qtp1511530316-12770) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2921019 INFO (qtp103419525-12731) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard4_replica_n12] Schema name=cloud-dynamic
[junit4] 2> 2921048 INFO (qtp2097155962-12787) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2921048 INFO (qtp2097155962-12792) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2921048 INFO (qtp103419525-12731) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 2921048 INFO (qtp103419525-12731) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard4_replica_n12' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 2921049 INFO (qtp103419525-12731) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34283.solr.core.replacenodetest_coll_notarget.shard4.replica_n12' (registry 'solr.core.replacenodetest_coll_notarget.shard4.replica_n12') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2921049 INFO (qtp103419525-12731) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2921049 INFO (qtp103419525-12731) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard4_replica_n12] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node1/replacenodetest_coll_notarget_shard4_replica_n12], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node1/./replacenodetest_coll_notarget_shard4_replica_n12/data/]
[junit4] 2> 2921063 INFO (qtp103419525-12726) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2921068 INFO (qtp1933041858-12748) [n:127.0.0.1:52550_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2921075 INFO (qtp1933041858-12748) [n:127.0.0.1:52550_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard1_replica_n1] Schema name=cloud-dynamic
[junit4] 2> 2921076 INFO (qtp2097155962-12792) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard4_replica_n14] Schema name=cloud-dynamic
[junit4] 2> 2921098 INFO (qtp103419525-12726) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard3_replica_n10] Schema name=cloud-dynamic
[junit4] 2> 2921105 INFO (qtp2097155962-12792) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 2921105 INFO (qtp2097155962-12792) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard4_replica_n14' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 2921105 INFO (qtp2097155962-12792) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45631.solr.core.replacenodetest_coll_notarget.shard4.replica_n14' (registry 'solr.core.replacenodetest_coll_notarget.shard4.replica_n14') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2921106 INFO (qtp2097155962-12792) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2921106 INFO (qtp2097155962-12792) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard4_replica_n14] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node6/replacenodetest_coll_notarget_shard4_replica_n14], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node6/./replacenodetest_coll_notarget_shard4_replica_n14/data/]
[junit4] 2> 2921107 INFO (qtp1933041858-12748) [n:127.0.0.1:52550_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 2921107 INFO (qtp1933041858-12748) [n:127.0.0.1:52550_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard1_replica_n1' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 2921107 INFO (qtp1933041858-12748) [n:127.0.0.1:52550_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52550.solr.core.replacenodetest_coll_notarget.shard1.replica_n1' (registry 'solr.core.replacenodetest_coll_notarget.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2921107 INFO (qtp1933041858-12748) [n:127.0.0.1:52550_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2921107 INFO (qtp1933041858-12748) [n:127.0.0.1:52550_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node5/replacenodetest_coll_notarget_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node5/./replacenodetest_coll_notarget_shard1_replica_n1/data/]
[junit4] 2> 2921123 INFO (qtp103419525-12726) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 2921123 INFO (qtp103419525-12726) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard3_replica_n10' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 2921124 INFO (qtp1511530316-12770) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard5_replica_n16] Schema name=cloud-dynamic
[junit4] 2> 2921124 INFO (qtp103419525-12726) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34283.solr.core.replacenodetest_coll_notarget.shard3.replica_n10' (registry 'solr.core.replacenodetest_coll_notarget.shard3.replica_n10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2921124 INFO (qtp103419525-12726) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2921124 INFO (qtp103419525-12726) [n:127.0.0.1:34283_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard3_replica_n10] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node1/replacenodetest_coll_notarget_shard3_replica_n10], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node1/./replacenodetest_coll_notarget_shard3_replica_n10/data/]
[junit4] 2> 2921127 INFO (qtp1134285751-12737) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard2 r:core_node6 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2921155 INFO (qtp1511530316-12770) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 2921155 INFO (qtp1511530316-12770) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard5_replica_n16' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 2921155 INFO (qtp1511530316-12770) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48767.solr.core.replacenodetest_coll_notarget.shard5.replica_n16' (registry 'solr.core.replacenodetest_coll_notarget.shard5.replica_n16') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2921156 INFO (qtp1511530316-12770) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2921156 INFO (qtp1511530316-12770) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard5_replica_n16] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node4/replacenodetest_coll_notarget_shard5_replica_n16], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node4/./replacenodetest_coll_notarget_shard5_replica_n16/data/]
[junit4] 2> 2921157 INFO (qtp2097155962-12787) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard3_replica_n8] Schema name=cloud-dynamic
[junit4] 2> 2921174 INFO (qtp2083173310-12757) [n:127.0.0.1:50032_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2921175 INFO (qtp1134285751-12739) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2921196 INFO (qtp1511530316-12772) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n7] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2921202 INFO (qtp2083173310-12757) [n:127.0.0.1:50032_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard1_replica_n2] Schema name=cloud-dynamic
[junit4] 2> 2921203 INFO (qtp1511530316-12772) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n7] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard2_replica_n7] Schema name=cloud-dynamic
[junit4] 2> 2921231 INFO (qtp2097155962-12787) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 2921231 INFO (qtp2097155962-12787) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard3_replica_n8' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 2921231 INFO (qtp1134285751-12739) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard5_replica_n18] Schema name=cloud-dynamic
[junit4] 2> 2921231 INFO (qtp2097155962-12787) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45631.solr.core.replacenodetest_coll_notarget.shard3.replica_n8' (registry 'solr.core.replacenodetest_coll_notarget.shard3.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2921231 INFO (qtp2097155962-12787) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2921231 INFO (qtp2097155962-12787) [n:127.0.0.1:45631_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard3_replica_n8] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node6/replacenodetest_coll_notarget_shard3_replica_n8], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node6/./replacenodetest_coll_notarget_shard3_replica_n8/data/]
[junit4] 2> 2921232 INFO (qtp1134285751-12737) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard2 r:core_node6 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard2_replica_n4] Schema name=cloud-dynamic
[junit4] 2> 2921235 INFO (qtp1511530316-12772) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n7] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 2921235 INFO (qtp1511530316-12772) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n7] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard2_replica_n7' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 2921235 INFO (qtp1511530316-12772) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n7] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_48767.solr.core.replacenodetest_coll_notarget.shard2.replica_n7' (registry 'solr.core.replacenodetest_coll_notarget.shard2.replica_n7') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2921235 INFO (qtp1511530316-12772) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n7] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2921235 INFO (qtp1511530316-12772) [n:127.0.0.1:48767_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n7] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard2_replica_n7] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node4/replacenodetest_coll_notarget_shard2_replica_n7], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node4/./replacenodetest_coll_notarget_shard2_replica_n7/data/]
[junit4] 2> 2921258 INFO (qtp2083173310-12757) [n:127.0.0.1:50032_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 2921258 INFO (qtp2083173310-12757) [n:127.0.0.1:50032_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard1_replica_n2' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 2921259 INFO (qtp1134285751-12739) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 2921259 INFO (qtp1134285751-12739) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard5_replica_n18' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 2921260 INFO (qtp1134285751-12739) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49548.solr.core.replacenodetest_coll_notarget.shard5.replica_n18' (registry 'solr.core.replacenodetest_coll_notarget.shard5.replica_n18') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5961dce5
[junit4] 2> 2921260 INFO (qtp1134285751-12739) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2921260 INFO (qtp1134285751-12739) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard5_replica_n18] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node2/replacenodetest_coll_notarget_shard5_replica_n18], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_2765261D870EBA06-001/tempDir-001/node2/./replacenodetest_coll_notarget_shard5_replica_n18/data/]
[junit4] 2> 2921260 INFO (qtp1134285751-12737) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard2 r:core_node6 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 2921260 INFO (qtp1134285751-12737) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard2 r:core_node6 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard2_replica_n4' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 2921261 INFO (qtp1134285751-12737) [n:127.0.0.1:49548_solr c:replacenodetest_coll_notarget s:shard2 r:co
[...truncated too long message...]
sPlanActionTest, MoveReplicaTest, TestClusterProperties, BlockCacheTest, TestFastWriter, BooleanFieldTest, TestRequestForwarding, PreAnalyzedFieldTest, ShardRoutingTest, TestSerializedLuceneMatchVersion, SimplePostToolTest, DistributedQueryComponentOptimizationTest, ZkSolrClientTest, ConcurrentCreateRoutedAliasTest, TestSchemaManager, SpellCheckComponentTest, DocExpirationUpdateProcessorFactoryTest, PeerSyncTest, DOMUtilTest, SolrShardReporterTest, HdfsCollectionsAPIDistributedZkTest, TestMacroExpander, TestRequestStatusCollectionAPI, TestManagedResourceStorage, TestCollationFieldDocValues, TestStressLucene, LIRRollingUpdatesTest, SuggestComponentTest, DistributedFacetPivotLargeTest, TestWordDelimiterFilterFactory, TestSha256AuthenticationProvider, TestTestInjection, MinimalSchemaTest, BasicAuthIntegrationTest, PeerSyncWithIndexFingerprintCachingTest, TestPKIAuthenticationPlugin, DebugComponentTest, TestSegmentSorting, TestLuceneIndexBackCompat, AliasIntegrationTest, CdcrVersionReplicationTest, DisMaxRequestHandlerTest, BasicFunctionalityTest, TestCryptoKeys, DistributedFacetPivotSmallAdvancedTest, PrimUtilsTest, UpdateRequestProcessorFactoryTest, TestAnalyzedSuggestions, ClusterStateTest, BlockJoinFacetRandomTest, TestSort, HdfsWriteToMultipleCollectionsTest, TestXmlQParser, DocValuesNotIndexedTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, ClusterStateUpdateTest, TestZkChroot, TestRandomDVFaceting, ZkCLITest, TestDistributedGrouping, TermVectorComponentDistributedTest, ZkControllerTest, TestRealTimeGet, TestStressReorder, TestJoin, TestReload, DistributedTermsComponentTest, TestRangeQuery, SimpleFacetsTest, TestSolr4Spatial, StatsComponentTest, QueryElevationComponentTest, TestFiltering, TestFunctionQuery, DirectUpdateHandlerTest, TestBadConfig, HighlighterTest, SoftAutoCommitTest, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SuggesterFSTTest, SolrRequestParserTest, TestFoldingMultitermQuery, SuggesterTSTTest, TestTrie, SuggesterWFSTTest, WordBreakSolrSpellCheckerTest, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, QueryEqualityTest, DefaultValueUpdateProcessorTest, TestRemoteStreaming, DocValuesMultiTest, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoBeanTest, XsltUpdateRequestHandlerTest, CacheHeaderTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, TestWriterPerf, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, PrimitiveFieldTypeTest, TestOmitPositions, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, RegexBoostProcessorTest, IndexSchemaTest, MBeansHandlerTest, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, CSVRequestHandlerTest, TestComponentsName, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, ResponseLogComponentTest, TestStressRecovery, TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, SampleTest, TestBinaryField, TestSearchPerf, NumericFieldsTest, TestElisionMultitermQuery, OutputWriterTest, TestFuzzyAnalyzedSuggestions, NotRequiredUniqueKeyTest, TestCharFilters, SynonymTokenizerTest, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestBM25SimilarityFactory, TimeZoneUtilsTest, ResourceLoaderTest, URLClassifyProcessorTest, TestFastLRUCache, TestSuggestSpellingConverter, DateFieldTest, TestLRUCache, SliceStateTest, SystemInfoHandlerTest, TestRTGBase, DistributedIntervalFacetingTest, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, TestTolerantSearch, TestJettySolrRunner, ActionThrottleTest, AddReplicaTest, AsyncCallRequestStatusResponseTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CleanupOldIndexTest, CollectionStateFormat2Test, CollectionsAPISolrJTest, ConfigSetsAPITest, ConnectionManagerTest, CreateCollectionCleanupTest, DeleteInactiveReplicaTest, DeleteNodeTest, DeleteReplicaTest, DeleteShardTest, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, DistributedQueueTest, DistributedVersionInfoTest, HttpPartitionOnCommitTest, HttpPartitionTest, LeaderFailoverAfterPartitionTest, LeaderFailureAfterFreshStartTest, LegacyCloudClusterPropTest, MigrateRouteKeyTest, MissingSegmentRecoveryTest, MoveReplicaHDFSFailoverTest, MoveReplicaHDFSTest, NodeMutatorTest, OverseerRolesTest, OverseerTaskQueueTest, PeerSyncReplicationTest, RecoveryAfterSoftCommitTest, RemoteQueryErrorTest, ReplicationFactorTest, RestartWhileUpdatingTest, RollingRestartTest, SSLMigrationTest, SolrCLIZkUtilsTest, SolrCloudExampleTest, TestCloudDeleteByQuery, TestCloudInspectUtil, TestCloudPivotFacet, TestCloudPseudoReturnFields, TestCloudSearcherWarming, TestConfigSetsAPI, TestConfigSetsAPIExclusivity, TestDownShardTolerantSearch, TestLeaderElectionWithEmptyReplica, TestRandomRequestDistribution, TestSizeLimitedDistributedMap, TestSolrCloudWithKerberosAlt, TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=2765261D870EBA06 -Dtests.slow=true -Dtests.locale=pl -Dtests.timezone=AST -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=37666, name=jetty-launcher-7298-thread-2-SendThread(127.0.0.1:36314), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] > 2) Thread[id=37596, name=jetty-launcher-7298-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] > 3) Thread[id=37667, name=jetty-launcher-7298-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4] > at __randomizedtesting.SeedInfo.seed([2765261D870EBA06]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=37666, name=jetty-launcher-7298-thread-2-SendThread(127.0.0.1:36314), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] > at __randomizedtesting.SeedInfo.seed([2765261D870EBA06]:0)
[junit4] Completed [574/777 (3!)] on J1 in 63.80s, 12 tests, 2 errors <<< FAILURES!
[...truncated 50876 lines...]
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 466 -
Still unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/466/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=33399, name=jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063) 2) Thread[id=33400, name=jetty-launcher-7743-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=33399, name=jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
2) Thread[id=33400, name=jetty-launcher-7743-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
at __randomizedtesting.SeedInfo.seed([DB2EA697A77E4AE7]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=33399, name=jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=33399, name=jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
at __randomizedtesting.SeedInfo.seed([DB2EA697A77E4AE7]:0)
Build Log:
[...truncated 14005 lines...]
[junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[junit4] 2> 3276387 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/init-core-data-001
[junit4] 2> 3276388 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 3276389 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 3276421 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/tempDir-001
[junit4] 2> 3276421 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3276422 INFO (Thread-9127) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3276422 INFO (Thread-9127) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3276434 ERROR (Thread-9127) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3276521 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:53461
[junit4] 2> 3276524 INFO (zkConnectionManagerCallback-7746-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276529 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T11:12:37+13:45, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 3276530 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T11:12:37+13:45, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 3276530 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 3276530 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 3276530 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4009d9c9{/solr,null,AVAILABLE}
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28adb0b1{/solr,null,AVAILABLE}
[junit4] 2> 3276531 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@35f10d0c{HTTP/1.1,[http/1.1]}{127.0.0.1:37475}
[junit4] 2> 3276532 INFO (jetty-launcher-7743-thread-2) [ ] o.e.j.s.Server Started @3280816ms
[junit4] 2> 3276532 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@32022f59{HTTP/1.1,[http/1.1]}{127.0.0.1:47813}
[junit4] 2> 3276532 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37475}
[junit4] 2> 3276532 INFO (jetty-launcher-7743-thread-1) [ ] o.e.j.s.Server Started @3280816ms
[junit4] 2> 3276532 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=47813}
[junit4] 2> 3276533 ERROR (jetty-launcher-7743-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3276533 ERROR (jetty-launcher-7743-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-28T18:35:00.400Z
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3276533 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-28T18:35:00.400Z
[junit4] 2> 3276535 INFO (zkConnectionManagerCallback-7750-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276535 INFO (zkConnectionManagerCallback-7748-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276536 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3276536 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3276543 INFO (jetty-launcher-7743-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53461/solr
[junit4] 2> 3276543 INFO (jetty-launcher-7743-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53461/solr
[junit4] 2> 3276545 INFO (zkConnectionManagerCallback-7756-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276545 INFO (zkConnectionManagerCallback-7758-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276548 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276548 INFO (zkConnectionManagerCallback-7762-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276708 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3276710 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47813_solr
[junit4] 2> 3276711 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.Overseer Overseer (id=72277727914229766-127.0.0.1:47813_solr-n_0000000000) starting
[junit4] 2> 3276718 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3276720 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37475_solr
[junit4] 2> 3276722 INFO (zkCallback-7761-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3276722 INFO (zkCallback-7759-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3276727 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47813_solr
[junit4] 2> 3276728 INFO (zkCallback-7759-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3276728 INFO (zkCallback-7761-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3276752 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 3276752 WARN (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3276752 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 3276754 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 3276754 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 3276754 WARN (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3276755 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 3276756 INFO (jetty-launcher-7743-thread-2-EventThread) [n:127.0.0.1:37475_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 3276756 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 3276758 INFO (jetty-launcher-7743-thread-1-EventThread) [n:127.0.0.1:47813_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 3276775 WARN (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3276785 WARN (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 3276846 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47813.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276850 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37475.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276852 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47813.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276852 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47813.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276853 INFO (jetty-launcher-7743-thread-1) [n:127.0.0.1:47813_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/tempDir-001/node1/.
[junit4] 2> 3276856 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37475.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276856 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37475.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3276857 INFO (jetty-launcher-7743-thread-2) [n:127.0.0.1:37475_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/tempDir-001/node2/.
[junit4] 2> 3276893 INFO (zkConnectionManagerCallback-7768-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3276895 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100c835e9800009, likely client has closed socket
[junit4] 2> 3276914 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
[junit4] 2> 3276918 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
[junit4] 2> 3276946 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
[junit4] 2> 3276948 INFO (zkConnectionManagerCallback-7771-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3277638 INFO (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3277639 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 3277640 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53461/solr ready
[junit4] 2> 3277664 INFO (qtp594512031-33278) [n:127.0.0.1:37475_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3277670 INFO (OverseerThreadFactory-12431-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection forwardingCollection
[junit4] 2> 3277781 INFO (OverseerStateUpdate-72277727914229766-127.0.0.1:47813_solr-n_0000000000) [n:127.0.0.1:47813_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"forwardingCollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"forwardingCollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37475/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3277987 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3277987 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3278093 INFO (zkCallback-7759-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3278093 INFO (zkCallback-7759-thread-2-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3279008 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3279038 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
[junit4] 2> 3279116 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3279134 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
[junit4] 2> 3279134 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37475.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3caba070
[junit4] 2> 3279134 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3279134 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/tempDir-001/node2/forwardingCollection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DB2EA697A77E4AE7-001/tempDir-001/node2/./forwardingCollection_shard1_replica_n1/data/]
[junit4] 2> 3279136 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1721715196, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 3279197 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3279197 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3279198 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3279198 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3279199 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=88.322265625, floorSegmentMB=1.353515625, forceMergeDeletesPctAllowed=7.033433996018158, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3221262889029142
[junit4] 2> 3279199 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7fbaa041[forwardingCollection_shard1_replica_n1] main]
[junit4] 2> 3279200 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 3279205 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 3279221 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3279222 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593670791949451264
[junit4] 2> 3279222 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 3279223 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 3279223 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 3279223 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 3279224 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 3279225 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 3279225 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 3279225 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 3279226 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 3279227 INFO (searcherExecutor-12436-thread-1-processing-n:127.0.0.1:37475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@7fbaa041[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/ has no replicas
[junit4] 2> 3279232 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 3279237 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/ shard1
[junit4] 2> 3279340 INFO (zkCallback-7759-thread-2-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3279340 INFO (zkCallback-7759-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3279388 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3279391 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1404
[junit4] 2> 3279395 INFO (qtp594512031-33278) [n:127.0.0.1:37475_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 3279492 INFO (zkCallback-7759-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3279493 INFO (zkCallback-7759-thread-2-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3279673 INFO (OverseerCollectionConfigSetProcessor-72277727914229766-127.0.0.1:47813_solr-n_0000000000) [n:127.0.0.1:47813_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 3280399 INFO (qtp594512031-33278) [n:127.0.0.1:37475_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=2736
[junit4] 2> 3280400 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
[junit4] 2> 3280401 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
[junit4] 2> 3280403 INFO (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3280406 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 3280409 INFO (qtp594512031-33282) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 3280409 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
[junit4] 2> 3280434 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
[junit4] 2> 3280438 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
[junit4] 2> 3280462 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
[junit4] 2> 3280478 INFO (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3280479 INFO (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3280479 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
[junit4] 2> 3280499 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
[junit4] 2> 3299760 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 20272ms for sessionid 0x100c835e9800005
[junit4] 2> 3299761 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100c835e9800005, likely client has closed socket
[junit4] 2> 3299762 WARN (jetty-launcher-7743-thread-1-SendThread(127.0.0.1:53461)) [n:127.0.0.1:47813_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 19288ms for sessionid 0x100c835e9800006
[junit4] 2> 3299763 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100c835e9800006, likely client has closed socket
[junit4] 2> 3299764 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
[junit4] 2> 3299808 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
[junit4] 2> 3299843 WARN (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: invalid user name: "bar"
[junit4] 2> id: invalid user name: "bar"
[junit4] 2>
[junit4] 2> 3299845 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
[junit4] 2> 3299863 INFO (jetty-launcher-7743-thread-2-EventThread) [n:127.0.0.1:37475_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 3299867 WARN (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e7e5f21 name: ZooKeeperConnection Watcher:127.0.0.1:53461/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 3299867 WARN (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 3299869 WARN (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1dbc8407 name: ZooKeeperConnection Watcher:127.0.0.1:53461/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 3299869 WARN (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 3299869 WARN (zkConnectionManagerCallback-7762-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ab885c3 name: ZooKeeperConnection Watcher:127.0.0.1:53461/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 3299873 WARN (zkConnectionManagerCallback-7762-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 3299905 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
[junit4] 2> 3299906 INFO (qtp1411566486-33272) [n:127.0.0.1:47813_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3300969 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DB2EA697A77E4AE7]-SendThread(127.0.0.1:53461)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100c835e980000b has expired
[junit4] 2> 3300969 WARN (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1dbc8407 name: ZooKeeperConnection Watcher:127.0.0.1:53461/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
[junit4] 2> 3300969 WARN (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 3300970 WARN (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
[junit4] 2> 3300971 INFO (zkConnectionManagerCallback-7774-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3300971 INFO (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
[junit4] 2> 3300973 INFO (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 3300975 INFO (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
[junit4] 2> 3300975 INFO (zkConnectionManagerCallback-7774-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient Connected:true
[junit4] 2> 3301073 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100c835e9800007 has expired
[junit4] 2> 3301373 INFO (zkConnectionManagerCallback-7762-thread-1-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3301374 INFO (qtp1411566486-33272) [n:127.0.0.1:47813_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=1468
[junit4] 2> 3301374 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
[junit4] 2> 3301374 INFO (zkCallback-7761-thread-7-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 3301405 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
[junit4] 2> 3301405 INFO (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.a.s.s.SolrDispatchFilter Error authenticating
[junit4] 2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:458)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:353)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:330)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 3301407 WARN (qtp1411566486-33274) [n:127.0.0.1:47813_solr ] o.e.j.s.HttpChannel /solr/admin/collections
[junit4] 2> org.apache.solr.common.SolrException: Error during request authentication,
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:464)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:353)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:330)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:458)
[junit4] 2> ... 31 more
[junit4] 2> 3301413 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
[junit4] 2> 3301442 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
[junit4] 2> 3301444 INFO (qtp1411566486-33272) [n:127.0.0.1:47813_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3301444 INFO (qtp1411566486-33272) [n:127.0.0.1:47813_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3301445 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
[junit4] 2> 3301476 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
[junit4] 2> 3301481 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
[junit4] 2> 3301514 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
[junit4] 2> 3301516 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
[junit4] 2> 3301548 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
[junit4] 2> 3301570 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[DB2EA697A77E4AE7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
[junit4] 2> 3301575 INFO (jetty-closer-7744-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@32022f59{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 3301576 INFO (jetty-closer-7744-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@35f10d0c{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 3301577 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=358670363
[junit4] 2> 3301577 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1850659926
[junit4] 2> 3301578 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 3301578 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6f07ebdf: rootName = solr_47813, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@577267d6
[junit4] 2> 3301578 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 3301578 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3f76a0e6: rootName = solr_37475, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1bb96d12
[junit4] 2> 3301594 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 3301594 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5fb46a47: rootName = solr_47813, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@18f9b081
[junit4] 2> 3301597 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 3301597 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@675ffd3e: rootName = solr_37475, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@18f9b081
[junit4] 2> 3301600 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 3301600 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2b81f176: rootName = solr_47813, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7133a8de
[junit4] 2> 3301602 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:47813_solr
[junit4] 2> 3301602 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 3301602 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5adb7471: rootName = solr_37475, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7133a8de
[junit4] 2> 3301603 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 3301604 INFO (zkCallback-7761-thread-7-processing-n:127.0.0.1:47813_solr) [n:127.0.0.1:47813_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 3301604 INFO (jetty-closer-7744-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72277727914229766-127.0.0.1:47813_solr-n_0000000000) closing
[junit4] 2> 3301605 INFO (OverseerStateUpdate-72277727914229766-127.0.0.1:47813_solr-n_0000000000) [n:127.0.0.1:47813_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:47813_solr
[junit4] 2> 3301605 WARN (OverseerAutoScalingTriggerThread-72277727914229766-127.0.0.1:47813_solr-n_0000000000) [n:127.0.0.1:47813_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 3301611 ERROR (Thread[Thread-9144,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:47813_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 3301622 WARN (jetty-launcher-7743-thread-1-SendThread(127.0.0.1:53461)) [n:127.0.0.1:47813_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100c835e9800008 has expired
[junit4] 2> 3301725 INFO (jetty-closer-7744-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4009d9c9{/solr,null,UNAVAILABLE}
[junit4] 2> 3301725 INFO (jetty-closer-7744-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 3301743 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100c835e9800005 has expired
[junit4] 2> 3301743 WARN (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e7e5f21 name: ZooKeeperConnection Watcher:127.0.0.1:53461/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
[junit4] 2> 3301743 WARN (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 3301743 WARN (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
[junit4] 2> 3301744 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr-EventThread) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3301745 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
[junit4] 2> 3301745 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration.
[junit4] 2> 3301747 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 3301753 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37475_solr
[junit4] 2> 3301756 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37475_solr
[junit4] 2> 3301757 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.ZkController Registering core forwardingCollection_shard1_replica_n1 afterExpiration? true
[junit4] 2> 3301757 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
[junit4] 2> 3301757 INFO (zkConnectionManagerCallback-7760-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ConnectionManager zkClient Connected:true
[junit4] 2> 3301758 INFO (zkCallback-7759-thread-6-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3301758 INFO (Thread-9152) [n:127.0.0.1:37475_solr ] o.a.s.c.SolrCore config update listener called for core forwardingCollection_shard1_replica_n1
[junit4] 2> 3301760 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3301760 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/
[junit4] 2> 3301760 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3301760 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/ has no replicas
[junit4] 2> 3301762 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37475/solr/forwardingCollection_shard1_replica_n1/ shard1
[junit4] 2> 3301762 INFO (coreZkRegister-12422-thread-1-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3301844 ERROR (jetty-closer-7744-thread-2) [ ] o.a.s.c.Overseer Could not create Overseer node
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:796)
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:662)
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:649)
[junit4] 2> at org.apache.solr.cloud.ZkController.publishNodeAsDown(ZkController.java:2727)
[junit4] 2> at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:747)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.destroy(SolrDispatchFilter.java:321)
[junit4] 2> at org.eclipse.jetty.servlet.FilterHolder.destroyInstance(FilterHolder.java:178)
[junit4] 2> at org.eclipse.jetty.servlet.FilterHolder.doStop(FilterHolder.java:155)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doStop(ServletHandler.java:234)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:144)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
[junit4] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:124)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doStop(SessionHandler.java:519)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:144)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
[junit4] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:124)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.stopContext(ContextHandler.java:863)
[junit4] 2> at org.eclipse.jetty.servlet.ServletContextHandler.stopContext(ServletContextHandler.java:355)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doStop(ContextHandler.java:927)
[junit4] 2> at org.eclipse.jetty.servlet.ServletContextHandler.doStop(ServletContextHandler.java:271)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:144)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
[junit4] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:124)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:144)
[junit4] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
[junit4] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:124)
[junit4] 2> at org.eclipse.jetty.server.Server.doStop(Server.java:489)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner.stop(JettySolrRunner.java:430)
[junit4] 2> at org.apache.solr.cloud.MiniSolrCloudCluster.stopJettySolrRunner(MiniSolrCloudCluster.java:423)
[junit4] 2> at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$shutdown$1(MiniSolrCloudCluster.java:460)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 3301844 WARN (jetty-closer-7744-thread-2) [ ] o.a.s.c.ZkController Could not publish node as down: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer
[junit4] 2> 3301844 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37475_solr
[junit4] 2> 3301846 INFO (zkCallback-7759-thread-6-processing-n:127.0.0.1:37475_solr) [n:127.0.0.1:37475_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 3301846 INFO (jetty-closer-7744-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 3301847 INFO (coreCloseExecutor-12442-thread-1) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@6786b16c
[junit4] 2> 3301847 INFO (coreCloseExecutor-12442-thread-1) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=1736880492
[junit4] 2> 3301847 INFO (coreCloseExecutor-12442-thread-1) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@14692c06: rootName = solr_37475, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@7c69265a
[junit4] 2> 3301856 INFO (coreCloseExecutor-12442-thread-1) [n:127.0.0.1:37475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=1736880492
[junit4] 2> 3301863 ERROR (Thread[Thread-9146,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:37475_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 3301868 INFO (jetty-closer-7744-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@28adb0b1{/solr,null,UNAVAILABLE}
[junit4] 2> 3301868 INFO (jetty-closer-7744-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 3301870 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3301871 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53461 53461
[junit4] 2> 3302682 INFO (Thread-9127) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53461 53461
[junit4] 2> 3302683 WARN (Thread-9127) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 3 /solr/security.json
[junit4] 2> 3 /solr/collections/forwardingCollection/terms/shard1
[junit4] 2> 2 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections/forwardingCollection/state.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 5 /solr/collections
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> 3302712 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DB2EA697A77E4AE7]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Feb 28, 2018 6:35:26 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> 3329948 ERROR (jetty-launcher-7743-thread-2-EventThread) [n:127.0.0.1:37475_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.IllegalStateException: Client is not started
[junit4] 2> at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:113)
[junit4] 2> at org.apache.curator.framework.imps.CuratorFrameworkImpl.getZooKeeper(CuratorFrameworkImpl.java:477)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceFacade.getZooKeeper(NamespaceFacade.java:112)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:302)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:291)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] 2> 3329950 WARN (jetty-launcher-7743-thread-2-EventThread) [n:127.0.0.1:37475_solr ] o.a.c.ConnectionState Session expired event received
[junit4] 2> 3329951 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3331054 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3332157 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3332769 ERROR (jetty-launcher-7743-thread-1-EventThread) [n:127.0.0.1:47813_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.IllegalStateException: Client is not started
[junit4] 2> at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:113)
[junit4] 2> at org.apache.curator.framework.imps.CuratorFrameworkImpl.getZooKeeper(CuratorFrameworkImpl.java:477)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceFacade.getZooKeeper(NamespaceFacade.java:112)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:302)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:291)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] 2> 3333265 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3334369 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3335475 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3336585 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3337687 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3338788 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 3339890 WARN (jetty-launcher-7743-thread-2-SendThread(127.0.0.1:53461)) [n:127.0.0.1:37475_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[...truncated too long message...]
y-launcher-1-thread-2-SendThread(127.0.0.1:39582)) [n:127.0.0.1:34265_solr ] o.a.z.c.StaticHostProvider Unexpected exception
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] 2> 124999 WARN (jetty-launcher-1-thread-1-SendThread(127.0.0.1:39582)) [n:127.0.0.1:42449_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> 124999 WARN (jetty-launcher-1-thread-2-SendThread(127.0.0.1:39582)) [n:127.0.0.1:34265_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
[junit4] 2> Feb 28, 2018 6:58:42 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=161, name=jetty-launcher-1-thread-1-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] 2> 2) Thread[id=159, name=jetty-launcher-1-thread-2-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1477, maxMBSortInHeap=6.977892473957818, sim=RandomSimilarity(queryNorm=false): {}, locale=be-BY, timezone=Pacific/Chatham
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=3,free=35223536,total=97583104
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=DB2EA697A77E4AE7 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=be-BY -Dtests.timezone=Pacific/Chatham -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=161, name=jetty-launcher-1-thread-1-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] > 2) Thread[id=162, name=jetty-launcher-1-thread-1-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4] > 3) Thread[id=159, name=jetty-launcher-1-thread-2-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1249)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1173)
[junit4] > 4) Thread[id=160, name=jetty-launcher-1-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4] > at __randomizedtesting.SeedInfo.seed([DB2EA697A77E4AE7]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=161, name=jetty-launcher-1-thread-1-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] > 2) Thread[id=159, name=jetty-launcher-1-thread-2-SendThread(127.0.0.1:39582), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
[junit4] > at __randomizedtesting.SeedInfo.seed([DB2EA697A77E4AE7]:0)
[junit4] Completed [2/5 (2!)] on J1 in 126.34s, 12 tests, 2 errors <<< FAILURES!
[...truncated 21 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1561: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1085: There were test failures: 5 suites, 60 tests, 4 suite-level errors, 36 ignored [seed: DB2EA697A77E4AE7]
Total time: 2 minutes 9 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 2/5 failed: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=f48fc470f665d2eda1b959ec3472cd5f711afaa0, workspace=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #464
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 465 -
Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/465/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC
No tests ran.
Build Log:
[...truncated 62658 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/465/consoleText
[repro] Revision: 9b7e35e69b694d9006c0964ae7a26ed2694ea055
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] No "reproduce with" lines found; exiting.
[...truncated 8 lines...]
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 464 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/464/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=2198, name=jetty-launcher-468-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) 2) Thread[id=2196, name=jetty-launcher-468-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=2198, name=jetty-launcher-468-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
2) Thread[id=2196, name=jetty-launcher-468-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
at __randomizedtesting.SeedInfo.seed([F89F48920C7E63FE]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 1) Thread[id=50195, name=jetty-launcher-11970-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) 2) Thread[id=50186, name=jetty-launcher-11970-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:
1) Thread[id=50195, name=jetty-launcher-11970-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
2) Thread[id=50186, name=jetty-launcher-11970-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
at __randomizedtesting.SeedInfo.seed([F89F48920C7E63FE]:0)
Build Log:
[...truncated 12336 lines...]
[junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[junit4] 2> 360278 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/init-core-data-001
[junit4] 2> 360278 WARN (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=33 numCloses=33
[junit4] 2> 360279 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 360280 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 360304 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/tempDir-001
[junit4] 2> 360305 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 360305 INFO (Thread-451) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 360305 INFO (Thread-451) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 360307 ERROR (Thread-451) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 360405 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:57294
[junit4] 2> 360408 INFO (zkConnectionManagerCallback-471-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360413 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 360413 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 360414 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 360414 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 360414 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 360415 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 360415 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 360415 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 360415 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6b5d522e{/solr,null,AVAILABLE}
[junit4] 2> 360415 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@969aa5c{/solr,null,AVAILABLE}
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@58fb3eb5{HTTP/1.1,[http/1.1]}{127.0.0.1:50694}
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-2) [ ] o.e.j.s.Server Started @362866ms
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=50694}
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7714b016{HTTP/1.1,[http/1.1]}{127.0.0.1:50290}
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-1) [ ] o.e.j.s.Server Started @362867ms
[junit4] 2> 360418 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=50290}
[junit4] 2> 360419 ERROR (jetty-launcher-468-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 360419 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 360419 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 360419 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 360419 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-26T01:48:11.280Z
[junit4] 2> 360420 ERROR (jetty-launcher-468-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 360421 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 360421 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 360421 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 360421 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-26T01:48:11.282Z
[junit4] 2> 360424 INFO (zkConnectionManagerCallback-475-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360424 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 360425 INFO (zkConnectionManagerCallback-473-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360426 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 360433 INFO (jetty-launcher-468-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57294/solr
[junit4] 2> 360433 INFO (jetty-launcher-468-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57294/solr
[junit4] 2> 360436 INFO (zkConnectionManagerCallback-481-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360437 INFO (zkConnectionManagerCallback-483-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360439 INFO (zkConnectionManagerCallback-485-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360441 INFO (zkConnectionManagerCallback-487-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360569 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 360569 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 360570 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50694_solr
[junit4] 2> 360571 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50290_solr
[junit4] 2> 360571 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.Overseer Overseer (id=72262434194391046-127.0.0.1:50694_solr-n_0000000000) starting
[junit4] 2> 360581 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 360581 INFO (zkCallback-486-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 360590 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50694_solr
[junit4] 2> 360591 INFO (zkCallback-486-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 360591 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 360622 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 360627 WARN (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 360631 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 360671 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 360671 WARN (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 360672 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 360694 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 360694 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 360715 INFO (jetty-launcher-468-thread-1-EventThread) [n:127.0.0.1:50290_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 360715 INFO (jetty-launcher-468-thread-2-EventThread) [n:127.0.0.1:50694_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 360823 WARN (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 360824 WARN (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 360862 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50694.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360867 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50694.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360868 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50694.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360869 INFO (jetty-launcher-468-thread-2) [n:127.0.0.1:50694_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/tempDir-001/node2/.
[junit4] 2> 360874 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50290.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360897 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50290.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360897 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50290.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 360899 INFO (jetty-launcher-468-thread-1) [n:127.0.0.1:50290_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/tempDir-001/node1/.
[junit4] 2> 360917 INFO (zkConnectionManagerCallback-493-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 360938 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
[junit4] 2> 374251 WARN (jetty-launcher-468-thread-1-SendThread(127.0.0.1:57294)) [n:127.0.0.1:50290_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13354ms for sessionid 0x100ba4d10c30005
[junit4] 2> 374251 WARN (jetty-launcher-468-thread-1-SendThread(127.0.0.1:57294)) [n:127.0.0.1:50290_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13433ms for sessionid 0x100ba4d10c30008
[junit4] 2> 374251 WARN (jetty-launcher-468-thread-2-SendThread(127.0.0.1:57294)) [n:127.0.0.1:50694_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13433ms for sessionid 0x100ba4d10c30007
[junit4] 2> 374251 WARN (jetty-launcher-468-thread-2-SendThread(127.0.0.1:57294)) [n:127.0.0.1:50694_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13384ms for sessionid 0x100ba4d10c30006
[junit4] 2> 374251 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30005, likely client has closed socket
[junit4] 2> 374252 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30008, likely client has closed socket
[junit4] 2> 374252 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30007, likely client has closed socket
[junit4] 2> 374252 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30006, likely client has closed socket
[junit4] 2> 374265 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1519645691809&s=EzzbqnAJtiyndyPFSCP+7jzTxaA="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:11 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:11 GMT
[junit4] 2> 374265 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
[junit4] 2> 374284 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
[junit4] 2> 374310 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=test&e=1519645705146&s=8rAm6KIvsuMjt0QyDcgNGxrgSOY="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:25 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:25 GMT
[junit4] 2> 374310 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
[junit4] 2> 374326 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
[junit4] 2> 374330 INFO (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 374330 INFO (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 374330 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1519645705187&s=arkL0bLKuBdhuoWbb2ZFMmZ0w88="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:25 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:25 GMT
[junit4] 2> 374331 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
[junit4] 2> 374350 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
[junit4] 2> 374353 WARN (zkConnectionManagerCallback-487-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2723808a name: ZooKeeperConnection Watcher:127.0.0.1:57294/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 374353 WARN (zkConnectionManagerCallback-487-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 374354 WARN (zkConnectionManagerCallback-485-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7f22a67c name: ZooKeeperConnection Watcher:127.0.0.1:57294/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 374354 WARN (zkConnectionManagerCallback-485-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 374354 INFO (zkConnectionManagerCallback-496-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 374922 INFO (zkConnectionManagerCallback-499-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 374924 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 374925 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57294/solr ready
[junit4] 2> 374928 INFO (qtp1528510916-2145) [n:127.0.0.1:50290_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 375746 INFO (jetty-launcher-468-thread-2-EventThread) [n:127.0.0.1:50694_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 376073 INFO (zkConnectionManagerCallback-485-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 376136 INFO (OverseerThreadFactory-924-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection forwardingCollection
[junit4] 2> 376137 INFO (zkConnectionManagerCallback-487-thread-1-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 376247 INFO (OverseerStateUpdate-72262434194391046-127.0.0.1:50694_solr-n_0000000000) [n:127.0.0.1:50694_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"forwardingCollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"forwardingCollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50290/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 376334 INFO (jetty-launcher-468-thread-1-EventThread) [n:127.0.0.1:50290_solr ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
[junit4] 2> 376452 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 376453 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 376562 INFO (zkCallback-484-thread-5-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 376562 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 377484 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 377502 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
[junit4] 2> 377602 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 377628 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
[junit4] 2> 377628 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_50290.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4df0ba08
[junit4] 2> 377628 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 377628 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/tempDir-001/node1/forwardingCollection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_F89F48920C7E63FE-001/tempDir-001/node1/./forwardingCollection_shard1_replica_n1/data/]
[junit4] 2> 377628 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.720355493720944]
[junit4] 2> 377695 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 377695 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 377696 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 377696 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 377697 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=27.5771484375, floorSegmentMB=1.6728515625, forceMergeDeletesPctAllowed=24.301358520999234, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 377697 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@552e3ec0[forwardingCollection_shard1_replica_n1] main]
[junit4] 2> 377698 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 377703 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 377724 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 377725 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 377725 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593426269790273536
[junit4] 2> 377725 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 377725 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 377725 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 377726 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 377726 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 377727 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 377727 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 377727 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 377728 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:50290_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@552e3ec0[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:50290/solr/forwardingCollection_shard1_replica_n1/
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:50290/solr/forwardingCollection_shard1_replica_n1/ has no replicas
[junit4] 2> 377736 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 377744 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:50290/solr/forwardingCollection_shard1_replica_n1/ shard1
[junit4] 2> 377846 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 377846 INFO (zkCallback-484-thread-5-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 377903 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 377905 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1453
[junit4] 2> 377906 WARN (httpShardExecutor-920-thread-1-processing-n:127.0.0.1:50694_solr [http:////127.0.0.1:50290//solr] http:////127.0.0.1:50290//solr) [n:127.0.0.1:50694_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1519645707312&s=0Atl8eY+ofcYH5FjKKCTYCNgm+U="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:27 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:27 GMT
[junit4] 2> 377910 INFO (qtp1528510916-2145) [n:127.0.0.1:50290_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 378014 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 378014 INFO (zkCallback-484-thread-5-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 378138 INFO (OverseerCollectionConfigSetProcessor-72262434194391046-127.0.0.1:50694_solr-n_0000000000) [n:127.0.0.1:50694_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 378911 INFO (qtp1528510916-2145) [n:127.0.0.1:50290_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3984
[junit4] 2> 378912 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1519645705789&s=JHYno0an5t2jzoHNSVMZOMCBZmc="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:25 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:25 GMT
[junit4] 2> 378912 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
[junit4] 2> 378913 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
[junit4] 2> 378915 INFO (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 378919 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 378920 WARN (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1519645709780&s=4EK+sezeVM8neb0NrmVeckmyqYo="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378920 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1519645709776&s=QCPv7G4tbN1HmU4PGyI36ObbVb8="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378920 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1519645709780&s=4EK+sezeVM8neb0NrmVeckmyqYo="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378923 INFO (qtp1528510916-2150) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 378923 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1519645709784&s=zOesxSkKojlNqjHs9iVhH9nEfrY="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378924 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
[junit4] 2> 378945 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
[junit4] 2> 378962 WARN (qtp217168763-2155) [ ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: invalid user name: "bar"
[junit4] 2> id: invalid user name: "bar"
[junit4] 2>
[junit4] 2> 378965 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=test&e=1519645709807&s=SObjn4j/loHlrE2up2V0E4b+JbI="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378965 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
[junit4] 2> 378993 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
[junit4] 2> 378995 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=test&e=1519645709854&s=YWDPbzlobvTEbB8JMreHpCmlCng="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 378995 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
[junit4] 2> 379023 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
[junit4] 2> 379029 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1519645709885&s=060twuZNtZKQzSCamdhQwkrKPUs="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 379029 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
[junit4] 2> 379061 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
[junit4] 2> 379063 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=test&e=1519645709923&s=TmOc3dTBsj7AM2Pekl3vndzYIMg="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 379063 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
[junit4] 2> 379090 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
[junit4] 2> 379090 INFO (qtp217168763-2155) [ ] o.a.s.s.SolrDispatchFilter Error authenticating
[junit4] 2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:454)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 379091 WARN (qtp217168763-2155) [ ] o.e.j.s.HttpChannel /solr/admin/collections
[junit4] 2> org.apache.solr.common.SolrException: Error during request authentication,
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:460)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:454)
[junit4] 2> ... 31 more
[junit4] 2> 379096 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
[junit4] 2> 379132 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
[junit4] 2> 379134 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=test&e=1519645709994&s=KGFkCs6of7y67ScjkQdl9bleO10="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:29 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:29 GMT
[junit4] 2> 379134 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
[junit4] 2> 379156 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
[junit4] 2> 379157 INFO (qtp217168763-2155) [n:127.0.0.1:50694_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 379157 INFO (qtp217168763-2155) [n:127.0.0.1:50694_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 379158 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=test&e=1519645710018&s=GgfYjUfeCq3B2GQJVZpHaJPth4U="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:30 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:30 GMT
[junit4] 2> 379158 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
[junit4] 2> 379177 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
[junit4] 2> 379178 INFO (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 379179 INFO (qtp217168763-2158) [n:127.0.0.1:50694_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 379179 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[F89F48920C7E63FE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=test&e=1519645710038&s=VYkxFeBX2yHUAXbikt+j7O60ZBo="; Path=/; Domain=127.0.0.1; Expires=ma, 26-helmikuuta-2018 11:48:30 GMT; HttpOnly". Invalid 'expires' attribute: ma, 26-helmikuuta-2018 11:48:30 GMT
[junit4] 2> 379179 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[F89F48920C7E63FE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
[junit4] 2> 379180 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c3000b, likely client has closed socket
[junit4] 2> 379181 INFO (jetty-closer-469-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@7714b016{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 379182 INFO (jetty-closer-469-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@58fb3eb5{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 379182 INFO (jetty-closer-469-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1150806005
[junit4] 2> 379182 INFO (jetty-closer-469-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=350578277
[junit4] 2> 379182 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 379182 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 379183 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@593567fe: rootName = solr_50694, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@4bf25941
[junit4] 2> 379183 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@655e5455: rootName = solr_50290, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3d4527c3
[junit4] 2> 379187 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 379187 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 379187 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@a57b8fc: rootName = solr_50290, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1a81ed3e
[junit4] 2> 379187 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@378a78f: rootName = solr_50694, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1a81ed3e
[junit4] 2> 379190 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 379190 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5e3cf17e: rootName = solr_50694, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@718ab80
[junit4] 2> 379190 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 379190 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@773ff30: rootName = solr_50290, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@718ab80
[junit4] 2> 379192 INFO (jetty-closer-469-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:50290_solr
[junit4] 2> 379192 INFO (jetty-closer-469-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:50694_solr
[junit4] 2> 379193 INFO (jetty-closer-469-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 379194 INFO (zkCallback-484-thread-5-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 379194 INFO (coreCloseExecutor-934-thread-1) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@68bfd465
[junit4] 2> 379194 INFO (coreCloseExecutor-934-thread-1) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=1757402213
[junit4] 2> 379194 INFO (coreCloseExecutor-934-thread-1) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4b131532: rootName = solr_50290, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@75f4e43c
[junit4] 2> 379195 INFO (jetty-closer-469-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 379195 INFO (zkCallback-486-thread-3-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 379197 INFO (jetty-closer-469-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72262434194391046-127.0.0.1:50694_solr-n_0000000000) closing
[junit4] 2> 379199 INFO (OverseerStateUpdate-72262434194391046-127.0.0.1:50694_solr-n_0000000000) [n:127.0.0.1:50694_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:50694_solr
[junit4] 2> 379199 WARN (OverseerAutoScalingTriggerThread-72262434194391046-127.0.0.1:50694_solr-n_0000000000) [n:127.0.0.1:50694_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 379203 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30006, likely client has closed socket
[junit4] 2> 379207 INFO (zkCallback-484-thread-1-processing-n:127.0.0.1:50290_solr) [n:127.0.0.1:50290_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50290_solr
[junit4] 2> 379211 INFO (coreCloseExecutor-934-thread-1) [n:127.0.0.1:50290_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=1757402213
[junit4] 2> 379219 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30005, likely client has closed socket
[junit4] 2> 379221 ERROR (Thread[Thread-468,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:50290_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 379233 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100ba4d10c30008, likely client has closed socket
[junit4] 2> 379234 INFO (jetty-closer-469-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6b5d522e{/solr,null,UNAVAILABLE}
[junit4] 2> 379234 INFO (jetty-closer-469-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 380702 WARN (zkCallback-486-thread-3-processing-n:127.0.0.1:50694_solr) [n:127.0.0.1:50694_solr ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:50694_solr
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:50694_solr
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
[junit4] 2> at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 380703 ERROR (Thread[Thread-470,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:50694_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 380705 INFO (jetty-closer-469-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@969aa5c{/solr,null,UNAVAILABLE}
[junit4] 2> 380706 INFO (jetty-closer-469-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 380707 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 380708 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57294 57294
[junit4] 2> 384460 INFO (Thread-451) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57294 57294
[junit4] 2> 384462 WARN (Thread-451) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/collections/forwardingCollection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 5 /solr/collections/forwardingCollection/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2> 3 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2> 3 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 3 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> 384486 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[F89F48920C7E63FE]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Feb 26, 2018 1:48:35 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> Feb 26, 2018 1:48:55 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] 2> 1) Thread[id=2198, name=jetty-launcher-468-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2>
[...truncated too long message...]
t, IndexSchemaTest, TestJmxIntegration, TestCollationField, ReturnFieldsTest, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, PingRequestHandlerTest, TestComponentsName, SearchHandlerTest, HighlighterConfigTest, SOLR749Test, UpdateParamsTest, TestQuerySenderNoQuery, CopyFieldTest, BadComponentTest, TestStressRecovery, TestMergePolicyConfig, TestElisionMultitermQuery, TestConfig, TestLuceneMatchVersion, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, OpenExchangeRatesOrgProviderTest, TestFastLRUCache, PreAnalyzedFieldTest, TestSystemIdResolver, TestSuggestSpellingConverter, DateFieldTest, DOMUtilTest, RAMDirectoryFactoryTest, TestSolrJ, TestDocumentBuilder, UUIDFieldTest, CursorPagingTest, TestDistributedMissingSort, TestTolerantSearch, TestLuceneIndexBackCompat, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, ConnectionReuseTest, AddReplicaTest, CollectionsAPISolrJTest, DeleteReplicaTest, DistributedQueueTest, HttpPartitionOnCommitTest, MoveReplicaHDFSTest, MultiThreadedOCPTest, RecoveryAfterSoftCommitTest, SolrXmlInZkTest, TestAuthenticationFramework, TestCloudInspectUtil, TestCloudSearcherWarming, TestExclusionRuleCollectionAccess, TestLockTree, TestOnReconnectListenerSupport, TestRandomFlRTGCloud, TestRandomRequestDistribution, TestRequestForwarding, TestSSLRandomization, TestSegmentSorting, TestSizeLimitedDistributedMap, TestSolrCloudWithDelegationTokens, TestTolerantUpdateProcessorRandomCloud, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, HdfsCollectionsAPIDistributedZkTest, ShardSplitTest, HttpTriggerListenerTest, MetricTriggerTest, NodeAddedTriggerTest, TriggerIntegrationTest, TestImplicitCoreProperties, TestInfoStreamLogging, TestNRTOpen, TestShardHandlerFactory, TestSimpleTextCodec, TestSolrConfigHandler, TestCoreBackup, TestSQLHandlerNonCloud, TestSolrConfigHandlerCloud, InfoHandlerTest, MetricsHandlerTest, PropertiesRequestHandlerTest, SecurityConfHandlerTest, SegmentsInfoRequestHandlerTest, StatsReloadRaceTest, TestApiFramework, TestCoreAdminApis, CustomHighlightComponentTest, DistributedFacetPivotLongTailTest, FacetPivotSmallTest, InfixSuggestersTest, ReplicaListTransformerTest, ShufflingReplicaListTransformerTest, SuggestComponentContextFilterQueryTest, TestExpandComponent, TestTrackingShardHandlerFactory, TestLegacyNumericUtils, TestLegacyTerms, TestNumericTokenStream, JvmMetricsTest, MetricsConfigTest, SolrCoreMetricManagerTest, SolrMetricManagerTest, SolrMetricReporterTest, SolrMetricsIntegrationTest, SolrGraphiteReporterTest, SolrJmxReporterCloudTest, SolrSlf4jReporterTest, SolrCloudReportersTest, SolrShardReporterTest, TestManagedResource, TestBulkSchemaAPI, TestSchemaVersionResource, TestUniqueKeyFieldResource, TestManagedSynonymFilterFactory, TestManagedSynonymGraphFilterFactory, EnumFieldTest, ManagedSchemaRoundRobinCloudTest, SpatialRPTFieldTypeTest, TestBulkSchemaConcurrent, TestHalfAndHalfDocValues, TestManagedSchema, TestManagedSchemaAPI, TestManagedSchemaThreadSafety, TestSchemalessBufferedUpdates, TestSortableTextField, TestUseDocValuesAsStored2, AnalyticsMergeStrategyTest, RankQueryTest, TestCollapseQParserPlugin, TestComplexPhraseQParserPlugin, TestInitQParser, TestLegacyNumericRangeQueryBuilder, TestMissingGroups, TestOverriddenPrefixQueryForCustomFieldType, TestQueryWrapperFilter, TestRecoveryHdfs, TestMinMaxOnMultiValuedField, TestSortByMinMaxFunction, GraphQueryTest, TestJsonRequest, SimpleMLTQParserTest, TestClassicSimilarityFactory, TestDFISimilarityFactory, TestNonDefinedSimilarityFactory, TestDistribIDF, PKIAuthenticationIntegrationTest, TestImpersonationWithHadoopAuth]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestImpersonationWithHadoopAuth -Dtests.seed=F89F48920C7E63FE -Dtests.slow=true -Dtests.locale=ko -Dtests.timezone=America/Nome -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J0 | TestImpersonationWithHadoopAuth (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:
[junit4] > 1) Thread[id=50195, name=jetty-launcher-11970-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] > 2) Thread[id=50186, name=jetty-launcher-11970-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
[junit4] > at __randomizedtesting.SeedInfo.seed([F89F48920C7E63FE]:0)
[junit4] Completed [752/777 (2!)] on J0 in 42.92s, 10 tests, 1 error, 1 skipped <<< FAILURES!
[...truncated 48605 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/464/consoleText
[repro] Revision: 72f23c89ec0a845d25129be2462c79147f6ff0e5
[repro] Repro line: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=F89F48920C7E63FE -Dtests.slow=true -Dtests.locale=fi-FI -Dtests.timezone=Europe/Prague -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Repro line: ant test -Dtestcase=TestImpersonationWithHadoopAuth -Dtests.seed=F89F48920C7E63FE -Dtests.slow=true -Dtests.locale=ko -Dtests.timezone=America/Nome -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestSolrCloudWithSecureImpersonation
[repro] TestImpersonationWithHadoopAuth
[repro] ant compile-test
[...truncated 3331 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.TestSolrCloudWithSecureImpersonation|*.TestImpersonationWithHadoopAuth" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=F89F48920C7E63FE -Dtests.slow=true -Dtests.locale=fi-FI -Dtests.timezone=Europe/Prague -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 194 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[repro] 0/5 failed: org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
[repro] Exiting with code 0
[...truncated 70 lines...]
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 463 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/463/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.cloud.CreateRoutedAliasTest.testUnParseableFutureFails
Error Message:
Error from server at http://127.0.0.1:37979/solr: Collection : testV1_2018-02-25_15 is part of alias testV1 remove or modify the alias before removing this collection.
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37979/solr: Collection : testV1_2018-02-25_15 is part of alias testV1 remove or modify the alias before removing this collection.
at __randomizedtesting.SeedInfo.seed([A65734BC3718D54:D16FCFEF60BEB5C9]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:444)
at org.apache.solr.cloud.CreateRoutedAliasTest.doBefore(CreateRoutedAliasTest.java:96)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12199 lines...]
[junit4] Suite: org.apache.solr.cloud.CreateRoutedAliasTest
[junit4] 2> 201035 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/init-core-data-001
[junit4] 2> 201036 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 201036 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
[junit4] 2> 201037 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001
[junit4] 2> 201037 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 201037 INFO (Thread-473) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 201037 INFO (Thread-473) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 201039 ERROR (Thread-473) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 201137 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:52947
[junit4] 2> 201140 INFO (zkConnectionManagerCallback-287-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201146 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 201146 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 201146 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 201146 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 201147 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 201147 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6cbf8bac{/solr,null,AVAILABLE}
[junit4] 2> 201148 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 201148 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 201148 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 201148 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9c6b33c{/solr,null,AVAILABLE}
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7bb6f8a6{HTTP/1.1,[http/1.1]}{127.0.0.1:37979}
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.e.j.s.Server Started @203069ms
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37979}
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3b559a01{HTTP/1.1,[http/1.1]}{127.0.0.1:40272}
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.e.j.s.Server Started @203069ms
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40272}
[junit4] 2> 201149 ERROR (jetty-launcher-284-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 201149 ERROR (jetty-launcher-284-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-25T15:31:37.834Z
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 201149 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-25T15:31:37.834Z
[junit4] 2> 201153 INFO (zkConnectionManagerCallback-291-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201153 INFO (zkConnectionManagerCallback-290-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201154 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 201155 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 201162 INFO (jetty-launcher-284-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52947/solr
[junit4] 2> 201163 INFO (jetty-launcher-284-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52947/solr
[junit4] 2> 201169 INFO (zkConnectionManagerCallback-297-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201169 INFO (zkConnectionManagerCallback-299-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201174 INFO (zkConnectionManagerCallback-301-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201174 INFO (zkConnectionManagerCallback-303-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201331 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 201332 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 201333 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37979_solr
[junit4] 2> 201333 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40272_solr
[junit4] 2> 201334 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.c.Overseer Overseer (id=72260008177762310-127.0.0.1:37979_solr-n_0000000000) starting
[junit4] 2> 201335 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 201336 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 201349 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37979_solr
[junit4] 2> 201351 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 201353 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 201427 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37979.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201432 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37979.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201432 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37979.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201433 INFO (jetty-launcher-284-thread-1) [n:127.0.0.1:37979_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/.
[junit4] 2> 201466 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40272.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201471 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40272.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201471 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40272.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 201472 INFO (jetty-launcher-284-thread-2) [n:127.0.0.1:40272_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/.
[junit4] 2> 201493 INFO (zkConnectionManagerCallback-309-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201496 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100b81836e70007, likely client has closed socket
[junit4] 2> 201514 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testV1
[junit4] 2> 201517 INFO (zkConnectionManagerCallback-314-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 201519 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 201520 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:52947/solr ready
[junit4] 2> 201522 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 201527 INFO (qtp1982654081-1689) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createroutedalias with params router.interval=%2B30MINUTE&router.start=2018-02-25T15:00:00Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testV1&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&create-collection.router.field=foo_s&wt=xml&create-collection.replicationFactor=2 and sendToOCPQueue=true
[junit4] 2> 201537 INFO (OverseerThreadFactory-807-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testV1_2018-02-25_15
[junit4] 2> 201650 INFO (OverseerStateUpdate-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testV1_2018-02-25_15",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testV1_2018-02-25_15_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37979/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 201653 INFO (OverseerStateUpdate-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testV1_2018-02-25_15",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testV1_2018-02-25_15_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40272/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 201860 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testV1_2018-02-25_15&version=2&replicaType=NRT&property.routedAliasName=testV1&coreNodeName=core_node3&name=testV1_2018-02-25_15_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 201860 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 201860 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testV1_2018-02-25_15&version=2&replicaType=NRT&property.routedAliasName=testV1&coreNodeName=core_node4&name=testV1_2018-02-25_15_shard1_replica_n2&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 201861 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 201970 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 201970 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 201970 INFO (zkCallback-302-thread-2-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 201971 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 202891 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.RequestParams conf resource params.json loaded . version : 1
[junit4] 2> 202892 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 1
[junit4] 2> 202893 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.RequestParams request params refreshed to version 1
[junit4] 2> 202893 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 1
[junit4] 2> 202894 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/extraction/lib
[junit4] 2> 202894 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/extraction/lib
[junit4] 2> 202895 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist
[junit4] 2> 202896 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/clustering/lib
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/clustering/lib
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist
[junit4] 2> 202896 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/langid/lib
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist
[junit4] 2> 202896 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/langid/lib
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../contrib/velocity/lib
[junit4] 2> 202896 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist
[junit4] 2> 202896 WARN (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1/../../../../dist
[junit4] 2> 202896 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../contrib/velocity/lib
[junit4] 2> 202897 WARN (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2/../../../../dist
[junit4] 2> 202900 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 202901 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 202921 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.IndexSchema [testV1_2018-02-25_15_shard1_replica_n1] Schema name=default-config
[junit4] 2> 202938 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.IndexSchema [testV1_2018-02-25_15_shard1_replica_n2] Schema name=default-config
[junit4] 2> 203168 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
[junit4] 2> 203168 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
[junit4] 2> 203219 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testV1_2018-02-25_15_shard1_replica_n1' using configuration from collection testV1_2018-02-25_15, trusted=true
[junit4] 2> 203221 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37979.solr.core.testV1_2018-02-25_15.shard1.replica_n1' (registry 'solr.core.testV1_2018-02-25_15.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 203221 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 203221 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrCore [[testV1_2018-02-25_15_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/testV1_2018-02-25_15_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node1/./testV1_2018-02-25_15_shard1_replica_n1/data/]
[junit4] 2> 203222 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testV1_2018-02-25_15_shard1_replica_n2' using configuration from collection testV1_2018-02-25_15, trusted=true
[junit4] 2> 203223 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40272.solr.core.testV1_2018-02-25_15.shard1.replica_n2' (registry 'solr.core.testV1_2018-02-25_15.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@67201657
[junit4] 2> 203224 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 203224 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrCore [[testV1_2018-02-25_15_shard1_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testV1_2018-02-25_15_shard1_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/./testV1_2018-02-25_15_shard1_replica_n2/data/]
[junit4] 2> 203251 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
[junit4] 2> 203251 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
[junit4] 2> 203514 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 203514 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 203515 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 203515 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 203517 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6662abbe[testV1_2018-02-25_15_shard1_replica_n1] main]
[junit4] 2> 203520 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/_default
[junit4] 2> 203520 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/_default
[junit4] 2> 203520 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/_default/managed-schema
[junit4] 2> 203545 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 1 is already the latest
[junit4] 2> 203549 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 203577 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
[junit4] 2> 203588 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 203588 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593387463761461248
[junit4] 2> 203591 INFO (searcherExecutor-812-thread-1-processing-n:127.0.0.1:37979_solr x:testV1_2018-02-25_15_shard1_replica_n1 s:shard1 c:testV1_2018-02-25_15 r:core_node3) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@6662abbe[testV1_2018-02-25_15_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 203592 INFO (searcherExecutor-812-thread-1-processing-n:127.0.0.1:37979_solr x:testV1_2018-02-25_15_shard1_replica_n1 s:shard1 c:testV1_2018-02-25_15 r:core_node3) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener done.
[junit4] 2> 203592 INFO (searcherExecutor-812-thread-1-processing-n:127.0.0.1:37979_solr x:testV1_2018-02-25_15_shard1_replica_n1 s:shard1 c:testV1_2018-02-25_15 r:core_node3) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 203602 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 203602 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 203604 INFO (searcherExecutor-812-thread-1-processing-n:127.0.0.1:37979_solr x:testV1_2018-02-25_15_shard1_replica_n1 s:shard1 c:testV1_2018-02-25_15 r:core_node3) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SolrCore [testV1_2018-02-25_15_shard1_replica_n1] Registered new searcher Searcher@6662abbe[testV1_2018-02-25_15_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 203643 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 203643 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 203644 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@368739ff[testV1_2018-02-25_15_shard1_replica_n2] main]
[junit4] 2> 203646 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/_default
[junit4] 2> 203646 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/_default
[junit4] 2> 203647 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/_default/managed-schema
[junit4] 2> 203647 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 1 is already the latest
[junit4] 2> 203648 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 203648 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
[junit4] 2> 203649 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 203650 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593387463826472960
[junit4] 2> 203653 INFO (searcherExecutor-813-thread-1-processing-n:127.0.0.1:40272_solr x:testV1_2018-02-25_15_shard1_replica_n2 s:shard1 c:testV1_2018-02-25_15 r:core_node4) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@368739ff[testV1_2018-02-25_15_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 203657 INFO (searcherExecutor-813-thread-1-processing-n:127.0.0.1:40272_solr x:testV1_2018-02-25_15_shard1_replica_n2 s:shard1 c:testV1_2018-02-25_15 r:core_node4) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.QuerySenderListener QuerySenderListener done.
[junit4] 2> 203657 INFO (searcherExecutor-813-thread-1-processing-n:127.0.0.1:40272_solr x:testV1_2018-02-25_15_shard1_replica_n2 s:shard1 c:testV1_2018-02-25_15 r:core_node4) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 203690 INFO (searcherExecutor-813-thread-1-processing-n:127.0.0.1:40272_solr x:testV1_2018-02-25_15_shard1_replica_n2 s:shard1 c:testV1_2018-02-25_15 r:core_node4) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.SolrCore [testV1_2018-02-25_15_shard1_replica_n2] Registered new searcher Searcher@368739ff[testV1_2018-02-25_15_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 203657 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.ZkShardTerms Failed to save terms, version is not match, retrying
[junit4] 2> 203691 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 203793 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 203793 INFO (zkCallback-302-thread-2-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 203793 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 203793 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204194 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 204194 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 204194 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37979/solr/testV1_2018-02-25_15_shard1_replica_n1/
[junit4] 2> 204194 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testV1_2018-02-25_15_shard1_replica_n1 url=http://127.0.0.1:37979/solr START replicas=[http://127.0.0.1:40272/solr/testV1_2018-02-25_15_shard1_replica_n2/] nUpdates=100
[junit4] 2> 204197 INFO (qtp423473488-1705) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.c.S.Request [testV1_2018-02-25_15_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 204494 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testV1_2018-02-25_15_shard1_replica_n1 url=http://127.0.0.1:37979/solr DONE. We have no versions. sync failed.
[junit4] 2> 204494 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 204494 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 204494 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 204500 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37979/solr/testV1_2018-02-25_15_shard1_replica_n1/ shard1
[junit4] 2> 204602 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204602 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204602 INFO (zkCallback-302-thread-3-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204603 INFO (zkCallback-302-thread-2-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204604 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 204607 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr c:testV1_2018-02-25_15 s:shard1 r:core_node3 x:testV1_2018-02-25_15_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testV1_2018-02-25_15&version=2&replicaType=NRT&property.routedAliasName=testV1&coreNodeName=core_node3&name=testV1_2018-02-25_15_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=2747
[junit4] 2> 204701 INFO (qtp423473488-1704) [n:127.0.0.1:40272_solr c:testV1_2018-02-25_15 s:shard1 r:core_node4 x:testV1_2018-02-25_15_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testV1_2018-02-25_15&version=2&replicaType=NRT&property.routedAliasName=testV1&coreNodeName=core_node4&name=testV1_2018-02-25_15_shard1_replica_n2&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=2841
[junit4] 2> 204702 INFO (OverseerThreadFactory-807-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 204806 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204806 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204806 INFO (zkCallback-302-thread-2-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 204806 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-25_15/state.json] for collection [testV1_2018-02-25_15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 205808 INFO (qtp1982654081-1689) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={router.interval=%2B30MINUTE&router.start=2018-02-25T15:00:00Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testV1&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&create-collection.router.field=foo_s&wt=xml&create-collection.replicationFactor=2} status=0 QTime=4282
[junit4] 2> 205815 INFO (zkConnectionManagerCallback-318-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 205817 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 205819 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:52947/solr ready
[junit4] 2> 205822 INFO (TEST-CreateRoutedAliasTest.testV1-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testV1
[junit4] 2> 205840 INFO (TEST-CreateRoutedAliasTest.testUnParseableFutureFails-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testUnParseableFutureFails
[junit4] 2> 205848 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 205852 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 205855 INFO (TEST-CreateRoutedAliasTest.testUnParseableFutureFails-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 205857 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=testV1_2018-02-25_15&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 205860 INFO (OverseerCollectionConfigSetProcessor-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 205860 ERROR (OverseerThreadFactory-807-thread-2-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.a.c.OverseerCollectionMessageHandler Collection: testV1_2018-02-25_15 operation: delete failed:org.apache.solr.common.SolrException: Collection : testV1_2018-02-25_15 is part of alias testV1 remove or modify the alias before removing this collection.
[junit4] 2> at org.apache.solr.cloud.api.collections.DeleteCollectionCmd.call(DeleteCollectionCmd.java:71)
[junit4] 2> at org.apache.solr.cloud.api.collections.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:254)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:469)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 205863 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=testV1_2018-02-25_15&action=DELETE&wt=javabin&version=2} status=500 QTime=5
[junit4] 2> 205863 ERROR (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Collection : testV1_2018-02-25_15 is part of alias testV1 remove or modify the alias before removing this collection.
[junit4] 2> at org.apache.solr.client.solrj.SolrResponse.getException(SolrResponse.java:53)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:260)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:232)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:195)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:380)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 205864 INFO (TEST-CreateRoutedAliasTest.testUnParseableFutureFails-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testUnParseableFutureFails
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CreateRoutedAliasTest -Dtests.method=testUnParseableFutureFails -Dtests.seed=A65734BC3718D54 -Dtests.slow=true -Dtests.locale=sq -Dtests.timezone=America/Sitka -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.05s J1 | CreateRoutedAliasTest.testUnParseableFutureFails <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37979/solr: Collection : testV1_2018-02-25_15 is part of alias testV1 remove or modify the alias before removing this collection.
[junit4] > at __randomizedtesting.SeedInfo.seed([A65734BC3718D54:D16FCFEF60BEB5C9]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
[junit4] > at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:444)
[junit4] > at org.apache.solr.cloud.CreateRoutedAliasTest.doBefore(CreateRoutedAliasTest.java:96)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 205889 INFO (TEST-CreateRoutedAliasTest.testTimeStampWithMsFails-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTimeStampWithMsFails
[junit4] 2> 205892 INFO (TEST-CreateRoutedAliasTest.testTimeStampWithMsFails-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 205894 INFO (qtp1982654081-1690) [n:127.0.0.1:37979_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=testV1_2018-02-25_15&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 205897 INFO (OverseerThreadFactory-807-thread-3-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.a.c.OverseerCollectionMessageHandler Executing Collection Cmd=action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true, asyncId=null
[junit4] 2> 205897 INFO (OverseerCollectionConfigSetProcessor-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 205898 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testV1_2018-02-25_15.shard1.replica_n1, tag=null
[junit4] 2> 205898 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@52a7caf1: rootName = solr_37979, domain = solr.core.testV1_2018-02-25_15.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.testV1_2018-02-25_15.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@27b781c
[junit4] 2> 205898 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testV1_2018-02-25_15.shard1.replica_n2, tag=null
[junit4] 2> 205898 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@77141f19: rootName = solr_40272, domain = solr.core.testV1_2018-02-25_15.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.testV1_2018-02-25_15.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@b35086f
[junit4] 2> 205916 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.c.SolrCore [testV1_2018-02-25_15_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@215b3210
[junit4] 2> 205916 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testV1_2018-02-25_15.shard1.replica_n1, tag=559624720
[junit4] 2> 205916 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testV1_2018-02-25_15.shard1.leader, tag=559624720
[junit4] 2> 205917 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.c.SolrCore [testV1_2018-02-25_15_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@2e60596e
[junit4] 2> 205917 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testV1_2018-02-25_15.shard1.replica_n2, tag=778066286
[junit4] 2> 205917 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testV1_2018-02-25_15.shard1.leader, tag=778066286
[junit4] 2> 205923 INFO (qtp1982654081-1694) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=testV1_2018-02-25_15_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=25
[junit4] 2> 205923 WARN (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.LeaderElector
[junit4] 2> org.apache.solr.common.SolrException: SolrCore not found:testV1_2018-02-25_15_shard1_replica_n2 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:311)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 205923 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.c.ZkShardTerms Failed to save terms, version is not match, retrying
[junit4] 2> 205926 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 205927 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=testV1_2018-02-25_15_shard1_replica_n2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=29
[junit4] 2> 206646 INFO (qtp1982654081-1690) [n:127.0.0.1:37979_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=testV1_2018-02-25_15&action=DELETE&wt=javabin&version=2} status=0 QTime=751
[junit4] 2> 206647 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createroutedalias with params router.interval=%2B30MINUTE&router.start=2018-01-15T00:00:00.001Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testTimeStampWithMsFails&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&wt=json and sendToOCPQueue=true
[junit4] 2> 206650 ERROR (OverseerThreadFactory-807-thread-4-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.a.c.OverseerCollectionMessageHandler Collection: testTimeStampWithMsFails operation: createroutedalias failed:org.apache.solr.common.SolrException: Date or date math for start time includes milliseconds, which is not supported. (Hint: 'NOW' used without rounding always has this problem)
[junit4] 2> at org.apache.solr.cloud.api.collections.CreateAliasCmd.checkMilis(CreateAliasCmd.java:141)
[junit4] 2> at org.apache.solr.cloud.api.collections.CreateAliasCmd.parseStart(CreateAliasCmd.java:135)
[junit4] 2> at org.apache.solr.cloud.api.collections.CreateAliasCmd.callCreateRoutedAlias(CreateAliasCmd.java:119)
[junit4] 2> at org.apache.solr.cloud.api.collections.CreateAliasCmd.call(CreateAliasCmd.java:65)
[junit4] 2> at org.apache.solr.cloud.api.collections.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:254)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:469)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 206651 INFO (OverseerCollectionConfigSetProcessor-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 206654 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={router.interval=%2B30MINUTE&router.start=2018-01-15T00:00:00.001Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testTimeStampWithMsFails&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&wt=json} status=400 QTime=6
[junit4] 2> 206655 INFO (TEST-CreateRoutedAliasTest.testTimeStampWithMsFails-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTimeStampWithMsFails
[junit4] 2> 206673 INFO (TEST-CreateRoutedAliasTest.testTimezoneAbsoluteDate-seed#[A65734BC3718D54]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTimezoneAbsoluteDate
[junit4] 2> 206676 INFO (TEST-CreateRoutedAliasTest.testTimezoneAbsoluteDate-seed#[A65734BC3718D54]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 206680 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 206681 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 206685 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 206686 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 206686 INFO (qtp423473488-1705) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 206686 INFO (qtp423473488-1705) [n:127.0.0.1:40272_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 206691 INFO (qtp423473488-1705) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createroutedalias with params router.start=2018-01-15T00:00:00Z&create-collection.collection.configName=_default&TZ=GMT-10:00&router.name=time&create-collection.numShards=1&create-collection.nrtReplicas=1&version=2&router.interval=%2B30MINUTE&router.field=evt_dt&name=testTimezoneAbsoluteDate&action=CREATEROUTEDALIAS&wt=javabin&create-collection.replicationFactor=1 and sendToOCPQueue=true
[junit4] 2> 206694 INFO (OverseerThreadFactory-807-thread-5-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testTimezoneAbsoluteDate_2018-01-15
[junit4] 2> 206694 INFO (OverseerCollectionConfigSetProcessor-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 206911 INFO (OverseerStateUpdate-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testTimezoneAbsoluteDate_2018-01-15",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40272/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 207114 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testTimezoneAbsoluteDate_2018-01-15&version=2&replicaType=NRT&property.routedAliasName=testTimezoneAbsoluteDate&coreNodeName=core_node2&name=testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 207220 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testTimezoneAbsoluteDate_2018-01-15/state.json] for collection [testTimezoneAbsoluteDate_2018-01-15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 207220 INFO (zkCallback-300-thread-1-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testTimezoneAbsoluteDate_2018-01-15/state.json] for collection [testTimezoneAbsoluteDate_2018-01-15] has occurred - updating... (live nodes size: [2])
[junit4] 2> 208136 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 1
[junit4] 2> 208137 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 1
[junit4] 2> 208137 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/extraction/lib
[junit4] 2> 208137 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/clustering/lib
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/langid/lib
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../contrib/velocity/lib
[junit4] 2> 208138 WARN (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001/tempDir-001/node2/testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1/../../../../dist
[junit4] 2> 208160 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 208176 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.s.IndexSchema [testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] Schema name=default-config
[junit4] 2> 208365 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
[junit4] 2> 208431 INFO (qtp423473488-1693) [n:127.0.0.1:40272_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1' using configurat
[...truncated too long message...]
NFO (jetty-closer-285-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 215776 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 215777 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7c1e7c5a: rootName = solr_40272, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2edb3319
[junit4] 2> 215777 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3379c62b: rootName = solr_37979, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@277005ca
[junit4] 2> 215782 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 215782 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@29252dc7: rootName = solr_40272, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@65c14d0d
[junit4] 2> 215785 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 215786 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4247fc7a: rootName = solr_40272, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@61fed56d
[junit4] 2> 215787 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 215787 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6e459578: rootName = solr_37979, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@65c14d0d
[junit4] 2> 215788 INFO (jetty-closer-285-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40272_solr
[junit4] 2> 215788 INFO (jetty-closer-285-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 215789 INFO (zkCallback-300-thread-2-processing-n:127.0.0.1:40272_solr) [n:127.0.0.1:40272_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 215792 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 215798 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 215799 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100b81836e70005, likely client has closed socket
[junit4] 2> 215799 INFO (jetty-closer-285-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@9c6b33c{/solr,null,UNAVAILABLE}
[junit4] 2> 215799 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@73a8507e: rootName = solr_37979, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@61fed56d
[junit4] 2> 215800 INFO (jetty-closer-285-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 215808 INFO (jetty-closer-285-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37979_solr
[junit4] 2> 215810 INFO (jetty-closer-285-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 215810 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:37979_solr) [n:127.0.0.1:37979_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 215813 INFO (jetty-closer-285-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72260008177762310-127.0.0.1:37979_solr-n_0000000000) closing
[junit4] 2> 215814 INFO (OverseerStateUpdate-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37979_solr
[junit4] 2> 215815 WARN (OverseerAutoScalingTriggerThread-72260008177762310-127.0.0.1:37979_solr-n_0000000000) [n:127.0.0.1:37979_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 215822 INFO (jetty-closer-285-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6cbf8bac{/solr,null,UNAVAILABLE}
[junit4] 2> 215825 INFO (jetty-closer-285-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 215827 ERROR (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 215828 INFO (SUITE-CreateRoutedAliasTest-seed#[A65734BC3718D54]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52947 52947
[junit4] 2> 215894 INFO (Thread-473) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52947 52947
[junit4] 2> 215894 WARN (Thread-473) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 15 /solr/clusterprops.json
[junit4] 2> 15 /solr/aliases.json
[junit4] 2> 7 /solr/configs/_default/managed-schema
[junit4] 2> 6 /solr/collections/testV1_2018-02-25_15/terms/shard1
[junit4] 2> 4 /solr/configs/_default
[junit4] 2> 4 /solr/collections/testV2_2018-02-25/terms/foo
[junit4] 2> 4 /solr/collections/testV2_2018-02-25/terms/bar
[junit4] 2> 3 /solr/collections/testTimezoneAbsoluteDate_2018-01-15/terms/shard1
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 22 /solr/aliases.json
[junit4] 2> 15 /solr/clusterstate.json
[junit4] 2> 12 /solr/collections/testV1_2018-02-25_15/state.json
[junit4] 2> 11 /solr/collections/testV2_2018-02-25/state.json
[junit4] 2> 5 /solr/collections/testTimezoneAbsoluteDate_2018-01-15/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 41 /solr/collections
[junit4] 2> 15 /solr/live_nodes
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_A65734BC3718D54-001
[junit4] 2> Feb 25, 2018 3:31:52 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=477, maxMBSortInHeap=6.448851584935259, sim=RandomSimilarity(queryNorm=false): {}, locale=sq, timezone=America/Sitka
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=1,free=102944544,total=282836992
[junit4] 2> NOTE: All tests run in this JVM: [DistributedIntervalFacetingTest, HdfsBasicDistributedZk2Test, BasicFunctionalityTest, HdfsTlogReplayBufferedWhileIndexingTest, MergeStrategyTest, CollectionsAPIAsyncDistributedZkTest, TestApiFramework, ExternalFileFieldSortTest, TestCrossCoreJoin, TestCoreBackup, TestDirectoryFactory, UUIDFieldTest, TlogReplayBufferedWhileIndexingTest, HighlighterConfigTest, TestDFRSimilarityFactory, TestBlendedInfixSuggestions, TestDistributedGrouping, BigEndianAscendingWordSerializerTest, TestRandomRequestDistribution, DistributedQueueTest, TestAtomicUpdateErrorCases, TestExecutePlanAction, OverseerStatusTest, TestJsonFacets, SortSpecParsingTest, IndexBasedSpellCheckerTest, TestFieldTypeCollectionResource, TestPushWriter, ReturnFieldsTest, CollectionStateFormat2Test, CSVRequestHandlerTest, TestConfigsApi, CreateRoutedAliasTest]
[junit4] Completed [46/777 (1!)] on J1 in 15.38s, 9 tests, 1 error <<< FAILURES!
[...truncated 50955 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/463/consoleText
[repro] Revision: 72f23c89ec0a845d25129be2462c79147f6ff0e5
[repro] Repro line: ant test -Dtestcase=CreateRoutedAliasTest -Dtests.method=testUnParseableFutureFails -Dtests.seed=A65734BC3718D54 -Dtests.slow=true -Dtests.locale=sq -Dtests.timezone=America/Sitka -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseConcMarkSweepGC"
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] CreateRoutedAliasTest
[repro] ant compile-test
[...truncated 3331 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.CreateRoutedAliasTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseConcMarkSweepGC" -Dtests.seed=A65734BC3718D54 -Dtests.slow=true -Dtests.locale=sq -Dtests.timezone=America/Sitka -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 108 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.CreateRoutedAliasTest
[repro] Exiting with code 0
[...truncated 70 lines...]
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 462 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/462/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.handler.component.DistributedSuggestComponentTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.handler.component.DistributedSuggestComponentTest: 1) Thread[id=7345, name=qtp1205317852-7345, state=TIMED_WAITING, group=TGRP-DistributedSuggestComponentTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.component.DistributedSuggestComponentTest:
1) Thread[id=7345, name=qtp1205317852-7345, state=TIMED_WAITING, group=TGRP-DistributedSuggestComponentTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([34907F54FED5B6D8]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.component.DistributedSuggestComponentTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=7345, name=qtp1205317852-7345, state=TIMED_WAITING, group=TGRP-DistributedSuggestComponentTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=7345, name=qtp1205317852-7345, state=TIMED_WAITING, group=TGRP-DistributedSuggestComponentTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([34907F54FED5B6D8]:0)
Build Log:
[...truncated 12418 lines...]
[junit4] Suite: org.apache.solr.handler.component.DistributedSuggestComponentTest
[junit4] 2> 575994 INFO (SUITE-DistributedSuggestComponentTest-seed#[34907F54FED5B6D8]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/init-core-data-001
[junit4] 2> 575994 WARN (SUITE-DistributedSuggestComponentTest-seed#[34907F54FED5B6D8]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
[junit4] 2> 575994 INFO (SUITE-DistributedSuggestComponentTest-seed#[34907F54FED5B6D8]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 575996 INFO (SUITE-DistributedSuggestComponentTest-seed#[34907F54FED5B6D8]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 575996 INFO (SUITE-DistributedSuggestComponentTest-seed#[34907F54FED5B6D8]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /wi/fy
[junit4] 2> 576172 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1
[junit4] 2> 576173 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 576174 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 576174 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 576174 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 576174 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1fa9a274{/wi/fy,null,AVAILABLE}
[junit4] 2> 576176 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4f24c62f{HTTP/1.1,[http/1.1]}{127.0.0.1:58182}
[junit4] 2> 576176 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.Server Started @578456ms
[junit4] 2> 576177 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig-suggestercomponent.xml, hostContext=/wi/fy, hostPort=58182, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores}
[junit4] 2> 576177 ERROR (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 576177 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 576177 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 576177 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 576177 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-25T07:17:26.289Z
[junit4] 2> 576178 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/solr.xml
[junit4] 2> 576181 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 576181 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 576183 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5a8dc2b0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 576229 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a8dc2b0
[junit4] 2> 576239 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a8dc2b0
[junit4] 2> 576240 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a8dc2b0
[junit4] 2> 576241 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores
[junit4] 2> 576241 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 576242 INFO (coreLoadExecutor-2087-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 576243 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 576273 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 576283 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 576383 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 576389 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 576389 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a8dc2b0
[junit4] 2> 576389 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 576389 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/]
[junit4] 2> 576391 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=27, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 576428 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 576428 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 576429 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=77.46875, floorSegmentMB=0.9208984375, forceMergeDeletesPctAllowed=25.384716777433294, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 576429 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@480ce83[collection1] main]
[junit4] 2> 576429 WARN (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 576430 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 576430 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_with_high_freq_dict,lookupImpl=FuzzyLookupFactory,field=cat,storeDir=suggest_fuzzy_with_high_freq_dict,suggestAnalyzerFieldType=text,buildOnCommit=true,threshold=0.0}
[junit4] 2> 576444 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester No dictionaryImpl parameter was provided falling back to org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory
[junit4] 2> 576445 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_with_high_freq_dict,lookupImpl=FuzzyLookupFactory,field=cat,storeDir=suggest_fuzzy_with_high_freq_dict,suggestAnalyzerFieldType=text,buildOnCommit=true,threshold=0.0}
[junit4] 2> 576446 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_fuzzy_with_high_freq_dict - SuggesterListener [core=org.apache.solr.core.SolrCore@619fc960, suggester=SolrSuggester [ name=suggest_fuzzy_with_high_freq_dict, sourceLocation=null, storeDir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_fuzzy_with_high_freq_dict, lookupImpl=FuzzyLookupFactory, dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory, sizeInBytes=0 ], buildOnCommit=true, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576446 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_file_based,lookupImpl=FuzzyLookupFactory,sourceLocation=fuzzysuggest.txt,storeDir=suggest_fuzzy_file_based,suggestAnalyzerFieldType=text,buildOnCommit=true}
[junit4] 2> 576446 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester No dictionaryImpl parameter was provided falling back to org.apache.solr.spelling.suggest.FileDictionaryFactory
[junit4] 2> 576446 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_file_based,lookupImpl=FuzzyLookupFactory,sourceLocation=fuzzysuggest.txt,storeDir=suggest_fuzzy_file_based,suggestAnalyzerFieldType=text,buildOnCommit=true}
[junit4] 2> 576446 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_fuzzy_file_based - SuggesterListener [core=org.apache.solr.core.SolrCore@619fc960, suggester=SolrSuggester [ name=suggest_fuzzy_file_based, sourceLocation=fuzzysuggest.txt, storeDir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_fuzzy_file_based, lookupImpl=FuzzyLookupFactory, dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory, sizeInBytes=0 ], buildOnCommit=true, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576446 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_doc_dict,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=true,buildOnStartup=false}
[junit4] 2> 576446 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_doc_dict,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=true,buildOnStartup=false}
[junit4] 2> 576446 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_fuzzy_doc_dict - SuggesterListener [core=org.apache.solr.core.SolrCore@619fc960, suggester=SolrSuggester [ name=suggest_fuzzy_doc_dict, sourceLocation=null, storeDir=, lookupImpl=FuzzyLookupFactory, dictionaryImpl=DocumentDictionaryFactory, sizeInBytes=0 ], buildOnCommit=true, buildOnOptimize=false, buildOnStartup=false, isCoreReload=false]
[junit4] 2> 576446 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_doc_expr_dict,dictionaryImpl=DocumentExpressionDictionaryFactory,lookupImpl=FuzzyLookupFactory,field=cat,weightExpression=((price * 2) + weight),sortField=weight,sortField=price,storeDir=suggest_fuzzy_doc_expr_dict,suggestAnalyzerFieldType=text,buildOnCommit=true}
[junit4] 2> 576460 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_doc_expr_dict,dictionaryImpl=DocumentExpressionDictionaryFactory,lookupImpl=FuzzyLookupFactory,field=cat,weightExpression=((price * 2) + weight),sortField=weight,sortField=price,storeDir=suggest_fuzzy_doc_expr_dict,suggestAnalyzerFieldType=text,buildOnCommit=true}
[junit4] 2> 576460 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_fuzzy_doc_expr_dict - SuggesterListener [core=org.apache.solr.core.SolrCore@619fc960, suggester=SolrSuggester [ name=suggest_fuzzy_doc_expr_dict, sourceLocation=null, storeDir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_fuzzy_doc_expr_dict, lookupImpl=FuzzyLookupFactory, dictionaryImpl=DocumentExpressionDictionaryFactory, sizeInBytes=0 ], buildOnCommit=true, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576460 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_doc_dict_build_startup,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=true}
[junit4] 2> 576460 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_doc_dict_build_startup,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=true}
[junit4] 2> 576460 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_fuzzy_doc_dict_build_startup - SuggesterListener [core=org.apache.solr.core.SolrCore@619fc960, suggester=SolrSuggester [ name=suggest_fuzzy_doc_dict_build_startup, sourceLocation=null, storeDir=, lookupImpl=FuzzyLookupFactory, dictionaryImpl=DocumentDictionaryFactory, sizeInBytes=0 ], buildOnCommit=false, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576460 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_doc_manal_build,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false,storeDir=suggest_fuzzy_doc_manal_build}
[junit4] 2> 576461 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_doc_manal_build,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false,storeDir=suggest_fuzzy_doc_manal_build}
[junit4] 2> 576461 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_doc_default_startup,lookupImpl=AnalyzingLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,storeDir=suggest_doc_default_startup}
[junit4] 2> 576461 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_doc_default_startup,lookupImpl=AnalyzingLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,storeDir=suggest_doc_default_startup}
[junit4] 2> 576461 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_doc_default_startup - SuggesterListener [core=org.apache.solr.core.SolrCore@619fc960, suggester=SolrSuggester [ name=suggest_doc_default_startup, sourceLocation=null, storeDir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_doc_default_startup, lookupImpl=AnalyzingLookupFactory, dictionaryImpl=DocumentDictionaryFactory, sizeInBytes=0 ], buildOnCommit=false, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576461 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_doc_default_startup_no_store,lookupImpl=AnalyzingLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false}
[junit4] 2> 576461 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_doc_default_startup_no_store,lookupImpl=AnalyzingLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false}
[junit4] 2> 576461 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_doc_default_startup_no_store - SuggesterListener [core=org.apache.solr.core.SolrCore@619fc960, suggester=SolrSuggester [ name=suggest_doc_default_startup_no_store, sourceLocation=null, storeDir=, lookupImpl=AnalyzingLookupFactory, dictionaryImpl=DocumentDictionaryFactory, sizeInBytes=0 ], buildOnCommit=false, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576461 INFO (coreLoadExecutor-2087-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 576462 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_fuzzy_with_high_freq_dict
[junit4] 2> 576462 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_with_high_freq_dict)
[junit4] 2> 576465 ERROR (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Store Lookup build failed
[junit4] 2> 576465 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_fuzzy_file_based
[junit4] 2> 576466 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_file_based)
[junit4] 2> 576478 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_fuzzy_file_based/fwfsta.bin
[junit4] 2> 576478 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_fuzzy_doc_expr_dict
[junit4] 2> 576478 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_expr_dict)
[junit4] 2> 576681 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1
[junit4] 2> 576682 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 576684 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 576684 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 576684 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 576684 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@43e0c488{/wi/fy,null,AVAILABLE}
[junit4] 2> 576685 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6a800d87{HTTP/1.1,[http/1.1]}{127.0.0.1:61214}
[junit4] 2> 576685 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.Server Started @578965ms
[junit4] 2> 576685 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig-suggestercomponent.xml, hostContext=/wi/fy, hostPort=61214, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores}
[junit4] 2> 576685 ERROR (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 576685 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 576685 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 576685 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 576685 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-25T07:17:26.797Z
[junit4] 2> 576686 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/solr.xml
[junit4] 2> 576689 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 576689 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 576690 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5a8dc2b0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 576743 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a8dc2b0
[junit4] 2> 576753 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a8dc2b0
[junit4] 2> 576753 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a8dc2b0
[junit4] 2> 576755 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores
[junit4] 2> 576755 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 576767 INFO (coreLoadExecutor-2097-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 576768 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 576798 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 576807 ERROR (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Store Lookup build failed
[junit4] 2> 576807 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_fuzzy_doc_dict_build_startup
[junit4] 2> 576807 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_dict_build_startup)
[junit4] 2> 576808 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 576808 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_doc_default_startup
[junit4] 2> 576808 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_doc_default_startup)
[junit4] 2> 576809 ERROR (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Store Lookup build failed
[junit4] 2> 576809 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_doc_default_startup_no_store
[junit4] 2> 576809 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_doc_default_startup_no_store)
[junit4] 2> 576811 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@480ce83[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 576899 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 576906 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 576906 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a8dc2b0
[junit4] 2> 576906 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 576906 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/]
[junit4] 2> 576908 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=27, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 576956 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 576956 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 576957 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=77.46875, floorSegmentMB=0.9208984375, forceMergeDeletesPctAllowed=25.384716777433294, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 576957 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@40a97027[collection1] main]
[junit4] 2> 576957 WARN (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 576958 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Initializing SuggestComponent
[junit4] 2> 576958 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_with_high_freq_dict,lookupImpl=FuzzyLookupFactory,field=cat,storeDir=suggest_fuzzy_with_high_freq_dict,suggestAnalyzerFieldType=text,buildOnCommit=true,threshold=0.0}
[junit4] 2> 576959 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester No dictionaryImpl parameter was provided falling back to org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory
[junit4] 2> 576959 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_with_high_freq_dict,lookupImpl=FuzzyLookupFactory,field=cat,storeDir=suggest_fuzzy_with_high_freq_dict,suggestAnalyzerFieldType=text,buildOnCommit=true,threshold=0.0}
[junit4] 2> 576959 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_fuzzy_with_high_freq_dict - SuggesterListener [core=org.apache.solr.core.SolrCore@62e22114, suggester=SolrSuggester [ name=suggest_fuzzy_with_high_freq_dict, sourceLocation=null, storeDir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_with_high_freq_dict, lookupImpl=FuzzyLookupFactory, dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory, sizeInBytes=0 ], buildOnCommit=true, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576959 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_file_based,lookupImpl=FuzzyLookupFactory,sourceLocation=fuzzysuggest.txt,storeDir=suggest_fuzzy_file_based,suggestAnalyzerFieldType=text,buildOnCommit=true}
[junit4] 2> 576959 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester No dictionaryImpl parameter was provided falling back to org.apache.solr.spelling.suggest.FileDictionaryFactory
[junit4] 2> 576959 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_file_based,lookupImpl=FuzzyLookupFactory,sourceLocation=fuzzysuggest.txt,storeDir=suggest_fuzzy_file_based,suggestAnalyzerFieldType=text,buildOnCommit=true}
[junit4] 2> 576959 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_fuzzy_file_based - SuggesterListener [core=org.apache.solr.core.SolrCore@62e22114, suggester=SolrSuggester [ name=suggest_fuzzy_file_based, sourceLocation=fuzzysuggest.txt, storeDir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_file_based, lookupImpl=FuzzyLookupFactory, dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory, sizeInBytes=0 ], buildOnCommit=true, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576959 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_doc_dict,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=true,buildOnStartup=false}
[junit4] 2> 576959 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_doc_dict,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=true,buildOnStartup=false}
[junit4] 2> 576959 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_fuzzy_doc_dict - SuggesterListener [core=org.apache.solr.core.SolrCore@62e22114, suggester=SolrSuggester [ name=suggest_fuzzy_doc_dict, sourceLocation=null, storeDir=, lookupImpl=FuzzyLookupFactory, dictionaryImpl=DocumentDictionaryFactory, sizeInBytes=0 ], buildOnCommit=true, buildOnOptimize=false, buildOnStartup=false, isCoreReload=false]
[junit4] 2> 576959 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_doc_expr_dict,dictionaryImpl=DocumentExpressionDictionaryFactory,lookupImpl=FuzzyLookupFactory,field=cat,weightExpression=((price * 2) + weight),sortField=weight,sortField=price,storeDir=suggest_fuzzy_doc_expr_dict,suggestAnalyzerFieldType=text,buildOnCommit=true}
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_doc_expr_dict,dictionaryImpl=DocumentExpressionDictionaryFactory,lookupImpl=FuzzyLookupFactory,field=cat,weightExpression=((price * 2) + weight),sortField=weight,sortField=price,storeDir=suggest_fuzzy_doc_expr_dict,suggestAnalyzerFieldType=text,buildOnCommit=true}
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_fuzzy_doc_expr_dict - SuggesterListener [core=org.apache.solr.core.SolrCore@62e22114, suggester=SolrSuggester [ name=suggest_fuzzy_doc_expr_dict, sourceLocation=null, storeDir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_doc_expr_dict, lookupImpl=FuzzyLookupFactory, dictionaryImpl=DocumentExpressionDictionaryFactory, sizeInBytes=0 ], buildOnCommit=true, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_doc_dict_build_startup,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=true}
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_doc_dict_build_startup,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=true}
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_fuzzy_doc_dict_build_startup - SuggesterListener [core=org.apache.solr.core.SolrCore@62e22114, suggester=SolrSuggester [ name=suggest_fuzzy_doc_dict_build_startup, sourceLocation=null, storeDir=, lookupImpl=FuzzyLookupFactory, dictionaryImpl=DocumentDictionaryFactory, sizeInBytes=0 ], buildOnCommit=false, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_fuzzy_doc_manal_build,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false,storeDir=suggest_fuzzy_doc_manal_build}
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_fuzzy_doc_manal_build,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,buildOnStartup=false,storeDir=suggest_fuzzy_doc_manal_build}
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_doc_default_startup,lookupImpl=AnalyzingLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,storeDir=suggest_doc_default_startup}
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_doc_default_startup,lookupImpl=AnalyzingLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false,storeDir=suggest_doc_default_startup}
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_doc_default_startup - SuggesterListener [core=org.apache.solr.core.SolrCore@62e22114, suggester=SolrSuggester [ name=suggest_doc_default_startup, sourceLocation=null, storeDir=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_doc_default_startup, lookupImpl=AnalyzingLookupFactory, dictionaryImpl=DocumentDictionaryFactory, sizeInBytes=0 ], buildOnCommit=false, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester init: {name=suggest_doc_default_startup_no_store,lookupImpl=AnalyzingLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false}
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.s.s.SolrSuggester Dictionary loaded with params: {name=suggest_doc_default_startup_no_store,lookupImpl=AnalyzingLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=text,buildOnCommit=false}
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.h.c.SuggestComponent Registering searcher listener for suggester: suggest_doc_default_startup_no_store - SuggesterListener [core=org.apache.solr.core.SolrCore@62e22114, suggester=SolrSuggester [ name=suggest_doc_default_startup_no_store, sourceLocation=null, storeDir=, lookupImpl=AnalyzingLookupFactory, dictionaryImpl=DocumentDictionaryFactory, sizeInBytes=0 ], buildOnCommit=false, buildOnOptimize=false, buildOnStartup=true, isCoreReload=false]
[junit4] 2> 576960 INFO (coreLoadExecutor-2097-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 576961 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_fuzzy_with_high_freq_dict
[junit4] 2> 576961 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_with_high_freq_dict)
[junit4] 2> 576962 ERROR (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Store Lookup build failed
[junit4] 2> 576962 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_fuzzy_file_based
[junit4] 2> 576962 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_file_based)
[junit4] 2> 576962 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 576966 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_file_based/fwfsta.bin
[junit4] 2> 576966 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_fuzzy_doc_expr_dict
[junit4] 2> 576966 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_expr_dict)
[junit4] 2> 576968 INFO (qtp1469152117-7192) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 576971 INFO (qtp1469152117-7192) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 3
[junit4] 2> 576973 ERROR (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Store Lookup build failed
[junit4] 2> 576973 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_fuzzy_doc_dict_build_startup
[junit4] 2> 576973 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_dict_build_startup)
[junit4] 2> 576974 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_doc_default_startup
[junit4] 2> 576974 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_doc_default_startup)
[junit4] 2> 576975 ERROR (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Store Lookup build failed
[junit4] 2> 576975 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnStartup: suggest_doc_default_startup_no_store
[junit4] 2> 576975 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_doc_default_startup_no_store)
[junit4] 2> 576977 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@40a97027[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 576978 INFO (qtp501369795-7210) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 576979 INFO (qtp501369795-7210) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 1
[junit4] 2> 576982 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[1]} 0 1
[junit4] 2> 576985 INFO (qtp501369795-7213) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[1]} 0 2
[junit4] 2> 576986 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[2]} 0 0
[junit4] 2> 576988 INFO (qtp501369795-7215) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[2]} 0 1
[junit4] 2> 576989 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[3]} 0 0
[junit4] 2> 576990 INFO (qtp501369795-7213) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[3]} 0 0
[junit4] 2> 576990 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[4]} 0 0
[junit4] 2> 576991 INFO (qtp501369795-7215) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[4]} 0 0
[junit4] 2> 576992 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[5]} 0 0
[junit4] 2> 576993 INFO (qtp501369795-7213) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[5]} 0 0
[junit4] 2> 576994 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[6]} 0 0
[junit4] 2> 576994 INFO (qtp501369795-7215) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[6]} 0 0
[junit4] 2> 576995 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[7]} 0 0
[junit4] 2> 576996 INFO (qtp501369795-7213) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[7]} 0 0
[junit4] 2> 576997 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[8]} 0 0
[junit4] 2> 576997 INFO (qtp501369795-7215) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[8]} 0 0
[junit4] 2> 576998 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[9]} 0 0
[junit4] 2> 576999 INFO (qtp501369795-7213) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[9]} 0 0
[junit4] 2> 577000 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[10]} 0 0
[junit4] 2> 577001 INFO (qtp501369795-7215) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={wt=javabin&version=2}{add=[10]} 0 0
[junit4] 2> 577001 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 577001 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@61af8b2e commitCommandVersion:0
[junit4] 2> 577035 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@38d599d1[collection1] main]
[junit4] 2> 577036 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 577036 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnCommit: suggest_fuzzy_with_high_freq_dict
[junit4] 2> 577036 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_with_high_freq_dict)
[junit4] 2> 577039 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_fuzzy_with_high_freq_dict/fwfsta.bin
[junit4] 2> 577039 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnCommit: suggest_fuzzy_file_based
[junit4] 2> 577039 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_file_based)
[junit4] 2> 577041 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_fuzzy_file_based/fwfsta.bin
[junit4] 2> 577041 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnCommit: suggest_fuzzy_doc_dict
[junit4] 2> 577041 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_dict)
[junit4] 2> 577044 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnCommit: suggest_fuzzy_doc_expr_dict
[junit4] 2> 577044 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_expr_dict)
[junit4] 2> 577050 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_fuzzy_doc_expr_dict/fwfsta.bin
[junit4] 2> 577051 INFO (searcherExecutor-2088-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@38d599d1[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.3.0):C10)))}
[junit4] 2> 577051 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 49
[junit4] 2> 577052 INFO (qtp501369795-7213) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 577052 INFO (qtp501369795-7213) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@410b579d commitCommandVersion:0
[junit4] 2> 577081 INFO (qtp501369795-7213) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1f2d886e[collection1] main]
[junit4] 2> 577081 INFO (qtp501369795-7213) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 577081 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnCommit: suggest_fuzzy_with_high_freq_dict
[junit4] 2> 577081 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_with_high_freq_dict)
[junit4] 2> 577084 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_with_high_freq_dict/fwfsta.bin
[junit4] 2> 577084 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnCommit: suggest_fuzzy_file_based
[junit4] 2> 577084 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_file_based)
[junit4] 2> 577085 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_file_based/fwfsta.bin
[junit4] 2> 577085 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnCommit: suggest_fuzzy_doc_dict
[junit4] 2> 577085 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_dict)
[junit4] 2> 577088 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SuggestComponent buildOnCommit: suggest_fuzzy_doc_expr_dict
[junit4] 2> 577088 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_expr_dict)
[junit4] 2> 577092 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_doc_expr_dict/fwfsta.bin
[junit4] 2> 577093 INFO (searcherExecutor-2098-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1f2d886e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.3.0):C10)))}
[junit4] 2> 577093 INFO (qtp501369795-7213) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/wi/fy path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 41
[junit4] 2> 577094 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : distrib=false&qt=/suggest&suggest.q=&suggest=true&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577095 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_expr_dict)
[junit4] 2> 577098 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_fuzzy_doc_expr_dict/fwfsta.bin
[junit4] 2> 577098 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_dict)
[junit4] 2> 577100 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_with_high_freq_dict)
[junit4] 2> 577102 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_fuzzy_with_high_freq_dict/fwfsta.bin
[junit4] 2> 577102 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_doc_default_startup)
[junit4] 2> 577104 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_doc_default_startup/wfsta.bin
[junit4] 2> 577104 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_doc_default_startup_no_store)
[junit4] 2> 577106 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_file_based)
[junit4] 2> 577108 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_fuzzy_file_based/fwfsta.bin
[junit4] 2> 577108 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_dict_build_startup)
[junit4] 2> 577110 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_manal_build)
[junit4] 2> 577112 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/control/cores/collection1/data/suggest_fuzzy_doc_manal_build/fwfsta.bin
[junit4] 2> 577112 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : distrib=false&qt=/suggest&suggest.q=&suggest=true&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577112 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/wi/fy path=/suggest params={distrib=false&qt=/suggest&suggest.q=&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest} status=0 QTime=18
[junit4] 2> 577115 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : shards=[ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy&qt=/suggest&suggest.q=&suggest=true&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577115 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_expr_dict)
[junit4] 2> 577119 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_doc_expr_dict/fwfsta.bin
[junit4] 2> 577119 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_dict)
[junit4] 2> 577121 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_with_high_freq_dict)
[junit4] 2> 577123 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_with_high_freq_dict/fwfsta.bin
[junit4] 2> 577123 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_doc_default_startup)
[junit4] 2> 577125 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_doc_default_startup/wfsta.bin
[junit4] 2> 577125 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_doc_default_startup_no_store)
[junit4] 2> 577126 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_file_based)
[junit4] 2> 577128 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_file_based/fwfsta.bin
[junit4] 2> 577128 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_dict_build_startup)
[junit4] 2> 577129 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_manal_build)
[junit4] 2> 577131 INFO (qtp501369795-7215) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_doc_manal_build/fwfsta.bin
[junit4] 2> 577132 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent distributedProcess with : shards=[ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy&qt=/suggest&suggest.q=&suggest=true&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577132 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent finishStage with : shards=[ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy&qt=/suggest&suggest.q=&suggest=true&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577132 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent distributedProcess with : shards=[ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy&qt=/suggest&suggest.q=&suggest=true&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577138 INFO (qtp501369795-7214) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : distrib=false&qt=/suggest&shards.purpose=4&suggest=true&shard.url=[ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy&version=2&shards.qt=/suggest&suggest.q=&NOW=1519543047227&isShard=true&suggest.buildAll=true&wt=javabin
[junit4] 2> 577138 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_expr_dict)
[junit4] 2> 577142 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_doc_expr_dict/fwfsta.bin
[junit4] 2> 577142 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_dict)
[junit4] 2> 577143 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_with_high_freq_dict)
[junit4] 2> 577145 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_with_high_freq_dict/fwfsta.bin
[junit4] 2> 577145 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_doc_default_startup)
[junit4] 2> 577148 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_doc_default_startup/wfsta.bin
[junit4] 2> 577148 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_doc_default_startup_no_store)
[junit4] 2> 577150 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_file_based)
[junit4] 2> 577151 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_file_based/fwfsta.bin
[junit4] 2> 577151 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_dict_build_startup)
[junit4] 2> 577153 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester SolrSuggester.build(suggest_fuzzy_doc_manal_build)
[junit4] 2> 577155 INFO (qtp501369795-7214) [ x:collection1] o.a.s.s.s.SolrSuggester Stored suggest data to: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedSuggestComponentTest_34907F54FED5B6D8-001/tempDir-001/shard0/cores/collection1/data/suggest_fuzzy_doc_manal_build/fwfsta.bin
[junit4] 2> 577155 INFO (qtp501369795-7214) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : distrib=false&qt=/suggest&shards.purpose=4&suggest=true&shard.url=[ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy&version=2&shards.qt=/suggest&suggest.q=&NOW=1519543047227&isShard=true&suggest.buildAll=true&wt=javabin
[junit4] 2> 577155 INFO (qtp501369795-7214) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/wi/fy path=/suggest params={distrib=false&qt=/suggest&suggest.q=&shards.purpose=4&NOW=1519543047227&isShard=true&suggest=true&shard.url=[ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest} status=0 QTime=17
[junit4] 2> 577155 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent finishStage with : shards=[ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy&qt=/suggest&suggest.q=&suggest=true&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577155 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent distributedProcess with : shards=[ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy&qt=/suggest&suggest.q=&suggest=true&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577155 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent finishStage with : shards=[ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy&qt=/suggest&suggest.q=&suggest=true&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577155 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent [ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy : {}
[junit4] 2> 577155 INFO (qtp501369795-7215) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/wi/fy path=/suggest params={shards=[ff01::114]:33332/wi/fy|http://127.0.0.1:61214/wi/fy/collection1|[ff01::083]:33332/wi/fy|[ff01::213]:33332/wi/fy&qt=/suggest&suggest.q=&suggest.buildAll=true&wt=javabin&version=2&shards.qt=/suggest} status=0 QTime=40
[junit4] 2> 577156 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : q=exampel&distrib=false&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577156 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : q=exampel&distrib=false&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577157 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/wi/fy path=/suggest params={q=exampel&distrib=false&qt=/suggest&suggest.count=2&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin&version=2&shards.qt=/suggest} status=0 QTime=0
[junit4] 2> 577159 INFO (qtp501369795-7213) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : q=exampel&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577159 INFO (qtp501369795-7213) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent distributedProcess with : q=exampel&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577159 INFO (qtp501369795-7213) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent finishStage with : q=exampel&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577159 INFO (qtp501369795-7213) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent distributedProcess with : q=exampel&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577160 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : distrib=false&qt=/suggest&shards.purpose=4&suggest=true&shard.url=http://127.0.0.1:61214/wi/fy/collection1&version=2&shards.qt=/suggest&q=exampel&NOW=1519543047271&suggest.count=2&isShard=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin
[junit4] 2> 577160 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : distrib=false&qt=/suggest&shards.purpose=4&suggest=true&shard.url=http://127.0.0.1:61214/wi/fy/collection1&version=2&shards.qt=/suggest&q=exampel&NOW=1519543047271&suggest.count=2&isShard=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin
[junit4] 2> 577160 INFO (qtp501369795-7215) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/wi/fy path=/suggest params={distrib=false&qt=/suggest&shards.purpose=4&suggest=true&shard.url=http://127.0.0.1:61214/wi/fy/collection1&version=2&shards.qt=/suggest&q=exampel&NOW=1519543047271&suggest.count=2&isShard=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin} status=0 QTime=0
[junit4] 2> 577161 INFO (qtp501369795-7213) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent finishStage with : q=exampel&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577161 INFO (qtp501369795-7213) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent distributedProcess with : q=exampel&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577161 INFO (qtp501369795-7213) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent finishStage with : q=exampel&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577161 INFO (qtp501369795-7213) [ x:collection1] o.a.s.h.c.SuggestComponent http://127.0.0.1:61214/wi/fy/collection1 : {suggest_fuzzy_doc_dict={exampel={numFound=2,suggestions=[{term=example inputdata,weight=45,payload=}, {term=example data,weight=40,payload=}]}}}
[junit4] 2> 577162 INFO (qtp501369795-7213) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/wi/fy path=/suggest params={q=exampel&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest.dictionary=suggest_fuzzy_doc_dict&wt=javabin&version=2&shards.qt=/suggest} status=0 QTime=2
[junit4] 2> 577163 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : q=Yet&distrib=false&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577163 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : q=Yet&distrib=false&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577163 INFO (qtp1469152117-7196) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/wi/fy path=/suggest params={q=Yet&distrib=false&qt=/suggest&suggest.count=2&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest} status=0 QTime=0
[junit4] 2> 577164 INFO (qtp501369795-7214) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : q=Yet&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577164 INFO (qtp501369795-7214) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent distributedProcess with : q=Yet&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577164 INFO (qtp501369795-7214) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent finishStage with : q=Yet&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577164 INFO (qtp501369795-7214) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent distributedProcess with : q=Yet&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577165 INFO (qtp501369795-7213) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : distrib=false&qt=/suggest&shards.purpose=4&suggest=true&shard.url=http://127.0.0.1:61214/wi/fy/collection1&version=2&shards.qt=/suggest&q=Yet&NOW=1519543047276&suggest.count=2&isShard=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin
[junit4] 2> 577165 INFO (qtp501369795-7213) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : distrib=false&qt=/suggest&shards.purpose=4&suggest=true&shard.url=http://127.0.0.1:61214/wi/fy/collection1&version=2&shards.qt=/suggest&q=Yet&NOW=1519543047276&suggest.count=2&isShard=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin
[junit4] 2> 577165 INFO (qtp501369795-7213) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/wi/fy path=/suggest params={distrib=false&qt=/suggest&shards.purpose=4&suggest=true&shard.url=http://127.0.0.1:61214/wi/fy/collection1&version=2&shards.qt=/suggest&q=Yet&NOW=1519543047276&suggest.count=2&isShard=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin} status=0 QTime=0
[junit4] 2> 577166 INFO (qtp501369795-7214) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent finishStage with : q=Yet&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577166 INFO (qtp501369795-7214) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent distributedProcess with : q=Yet&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577166 INFO (qtp501369795-7214) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent finishStage with : q=Yet&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577166 INFO (qtp501369795-7214) [ x:collection1] o.a.s.h.c.SuggestComponent http://127.0.0.1:61214/wi/fy/collection1 : {suggest_fuzzy_doc_expr_dict={Yet={numFound=2,suggestions=[{term=Yet another title,weight=60,payload=}, {term=Yet another,weight=40,payload=}]}}}
[junit4] 2> 577166 INFO (qtp501369795-7214) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/wi/fy path=/suggest params={q=Yet&shards=http://127.0.0.1:61214/wi/fy/collection1&qt=/suggest&suggest.count=2&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest} status=0 QTime=1
[junit4] 2> 577167 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : distrib=false&qt=/suggest&suggest.q=blah&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577167 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent process with : distrib=false&qt=/suggest&suggest.q=blah&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577167 INFO (qtp1469152117-7191) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/wi/fy path=/suggest params={distrib=false&qt=/suggest&suggest.q=blah&suggest.count=2&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest} status=0 QTime=0
[junit4] 2> 577168 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent prepare with : shards=http://127.0.0.1:61214/wi/fy/collection1|[ff01::114]:33332/wi/fy&qt=/suggest&suggest.q=blah&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577168 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent distributedProcess with : shards=http://127.0.0.1:61214/wi/fy/collection1|[ff01::114]:33332/wi/fy&qt=/suggest&suggest.q=blah&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&shards.qt=/suggest
[junit4] 2> 577168 INFO (qtp501369795-7215) [ x:collection1] o.a.s.h.c.SuggestComponent SuggestComponent finishStage with : shards=http://127.0.0.1:61214/wi/fy/collection1|[ff01::114]:33332/wi/fy&qt=/suggest&suggest.q=blah&suggest.count=2&suggest=true&suggest.dictionary=suggest_fuzzy_doc_expr_dict&wt=javabin&version=2&sha
[...truncated too long message...]
e.collection1, tag=774962908
[junit4] 2> 612740 INFO (coreCloseExecutor-2188-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5b336240: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@679c37c
[junit4] 2> 612749 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6d326abd{/wi/fy,null,UNAVAILABLE}
[junit4] 2> 612749 INFO (TEST-DistributedSuggestComponentTest.test-seed#[34907F54FED5B6D8]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 612752 INFO (SUITE-DistributedSuggestComponentTest-seed#[34907F54FED5B6D8]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Feb 25, 2018 7:18:03 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Feb 25, 2018 7:18:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.handler.component.DistributedSuggestComponentTest:
[junit4] 2> 1) Thread[id=7345, name=qtp1205317852-7345, state=TIMED_WAITING, group=TGRP-DistributedSuggestComponentTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Feb 25, 2018 7:18:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=7345, name=qtp1205317852-7345, state=TIMED_WAITING, group=TGRP-DistributedSuggestComponentTest]
[junit4] 2> Feb 25, 2018 7:18:26 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=7345, name=qtp1205317852-7345, state=TIMED_WAITING, group=TGRP-DistributedSuggestComponentTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {multiDefault=PostingsFormat(name=Memory), cat=Lucene50(blocksize=128), id=BlockTreeOrds(blocksize=128)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene70), range_facet_i_dv=DocValuesFormat(name=Lucene70), intDvoDefault=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=1736, maxMBSortInHeap=7.450201583088487, sim=RandomSimilarity(queryNorm=false): {}, locale=es-CO, timezone=America/Virgin
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=2,free=284827000,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [OverseerTaskQueueTest, AssignBackwardCompatibilityTest, TestStressLiveNodes, TestSortByMinMaxFunction, TestGenericDistributedQueue, TestDelegationWithHadoopAuth, EnumFieldTest, TestTrackingShardHandlerFactory, TestDefaultStatsCache, DistributedQueryComponentCustomSortTest, TestZkChroot, SuggestComponentContextFilterQueryTest, ZkStateReaderTest, TestPerFieldSimilarityWithDefaultOverride, UniqFieldsUpdateProcessorFactoryTest, TestCollectionAPI, TestConfigSetImmutable, MultiThreadedOCPTest, ResourceLoaderTest, SolrJmxReporterTest, TimeRoutedAliasUpdateProcessorTest, RAMDirectoryFactoryTest, DistributedMLTComponentTest, DirectUpdateHandlerOptimizeTest, TestGeoJSONResponseWriter, TestTrieFacet, SearchHandlerTest, ChangedSchemaMergeTest, TestFieldCacheWithThreads, SolrTestCaseJ4Test, TestXmlQParserPlugin, TestExceedMaxTermLength, TestPolicyCloud, TestFoldingMultitermQuery, SolrCoreTest, TestReplicaProperties, MetricsConfigTest, TestFieldCacheSortRandom, TestStandardQParsers, MBeansHandlerTest, TestSolrCloudSnapshots, TestRawResponseWriter, TestLeaderElectionZkExpiry, DistributedQueryElevationComponentTest, ZkNodePropsTest, SolrIndexSplitterTest, StatsReloadRaceTest, MetricsHandlerTest, SampleTest, RegexBytesRefFilterTest, TestTolerantSearch, TestCustomStream, XmlUpdateRequestHandlerTest, RollingRestartTest, DeleteNodeTest, DistributedSuggestComponentTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DistributedSuggestComponentTest -Dtests.seed=34907F54FED5B6D8 -Dtests.slow=true -Dtests.locale=es-CO -Dtests.timezone=America/Virgin -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | DistributedSuggestComponentTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.component.DistributedSuggestComponentTest:
[junit4] > 1) Thread[id=7345, name=qtp1205317852-7345, state=TIMED_WAITING, group=TGRP-DistributedSuggestComponentTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([34907F54FED5B6D8]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=7345, name=qtp1205317852-7345, state=TIMED_WAITING, group=TGRP-DistributedSuggestComponentTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([34907F54FED5B6D8]:0)
[junit4] Completed [103/777 (1!)] on J0 in 60.18s, 1 test, 2 errors <<< FAILURES!
[...truncated 50720 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/462/consoleText
[repro] Revision: 72f23c89ec0a845d25129be2462c79147f6ff0e5
[repro] Repro line: ant test -Dtestcase=DistributedSuggestComponentTest -Dtests.seed=34907F54FED5B6D8 -Dtests.slow=true -Dtests.locale=es-CO -Dtests.timezone=America/Virgin -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] DistributedSuggestComponentTest
[repro] ant compile-test
[...truncated 3331 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.DistributedSuggestComponentTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=34907F54FED5B6D8 -Dtests.slow=true -Dtests.locale=es-CO -Dtests.timezone=America/Virgin -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 68 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.handler.component.DistributedSuggestComponentTest
[repro] Exiting with code 0
[...truncated 70 lines...]
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 461 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/461/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC
2 tests failed.
FAILED: org.apache.solr.cloud.ReplaceNodeNoTargetTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([45B87FA4ED6EE6A5:CDEC407E43928B5D]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster.testBasic
Error Message:
Stack Trace:
java.util.concurrent.TimeoutException
at __randomizedtesting.SeedInfo.seed([45B87FA4ED6EE6A5:EE4262B132B2608B]:0)
at org.apache.solr.cloud.autoscaling.sim.SimSolrCloudTestCase.waitForState(SimSolrCloudTestCase.java:261)
at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster.testBasic(TestLargeCluster.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13879 lines...]
[junit4] Suite: org.apache.solr.cloud.ReplaceNodeNoTargetTest
[junit4] 2> 3293030 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[45B87FA4ED6EE6A5]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/init-core-data-001
[junit4] 2> 3293031 WARN (SUITE-ReplaceNodeNoTargetTest-seed#[45B87FA4ED6EE6A5]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=34 numCloses=34
[junit4] 2> 3293031 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[45B87FA4ED6EE6A5]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 3293032 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[45B87FA4ED6EE6A5]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 3293032 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[45B87FA4ED6EE6A5]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 6 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001
[junit4] 2> 3293032 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[45B87FA4ED6EE6A5]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3293033 INFO (Thread-6763) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3293033 INFO (Thread-6763) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3293034 ERROR (Thread-6763) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3293133 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[45B87FA4ED6EE6A5]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:54266
[junit4] 2> 3293135 INFO (zkConnectionManagerCallback-5624-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293140 INFO (jetty-launcher-5621-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 3293141 INFO (jetty-launcher-5621-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 3293141 INFO (jetty-launcher-5621-thread-4) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 3293142 INFO (jetty-launcher-5621-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 3293142 INFO (jetty-launcher-5621-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 3293142 INFO (jetty-launcher-5621-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 3293142 INFO (jetty-launcher-5621-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 3293142 INFO (jetty-launcher-5621-thread-5) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 3293143 INFO (jetty-launcher-5621-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1067ac64{/solr,null,AVAILABLE}
[junit4] 2> 3293143 INFO (jetty-launcher-5621-thread-6) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 3293143 INFO (jetty-launcher-5621-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 3293143 INFO (jetty-launcher-5621-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 3293143 INFO (jetty-launcher-5621-thread-3) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 3293144 INFO (jetty-launcher-5621-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 3293144 INFO (jetty-launcher-5621-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 3293144 INFO (jetty-launcher-5621-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@f7baa94{HTTP/1.1,[http/1.1]}{127.0.0.1:40061}
[junit4] 2> 3293144 INFO (jetty-launcher-5621-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 3293144 INFO (jetty-launcher-5621-thread-1) [ ] o.e.j.s.Server Started @3297528ms
[junit4] 2> 3293144 INFO (jetty-launcher-5621-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40061}
[junit4] 2> 3293145 ERROR (jetty-launcher-5621-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3293145 INFO (jetty-launcher-5621-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 3293145 INFO (jetty-launcher-5621-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3293145 INFO (jetty-launcher-5621-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3293145 INFO (jetty-launcher-5621-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-24T20:08:12.828Z
[junit4] 2> 3293146 INFO (jetty-launcher-5621-thread-5) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 3293146 INFO (jetty-launcher-5621-thread-5) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 3293146 INFO (jetty-launcher-5621-thread-5) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 3293147 INFO (jetty-launcher-5621-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4dbe16ea{/solr,null,AVAILABLE}
[junit4] 2> 3293147 INFO (jetty-launcher-5621-thread-5) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@288bce20{/solr,null,AVAILABLE}
[junit4] 2> 3293147 INFO (jetty-launcher-5621-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4c9cc7db{/solr,null,AVAILABLE}
[junit4] 2> 3293147 INFO (jetty-launcher-5621-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4cf9eaa9{HTTP/1.1,[http/1.1]}{127.0.0.1:62320}
[junit4] 2> 3293147 INFO (jetty-launcher-5621-thread-3) [ ] o.e.j.s.Server Started @3297531ms
[junit4] 2> 3293148 INFO (jetty-launcher-5621-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=62320}
[junit4] 2> 3293148 ERROR (jetty-launcher-5621-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3293148 INFO (jetty-launcher-5621-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 3293148 INFO (jetty-launcher-5621-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3293148 INFO (jetty-launcher-5621-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3293148 INFO (jetty-launcher-5621-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-24T20:08:12.831Z
[junit4] 2> 3293148 INFO (jetty-launcher-5621-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 3293148 INFO (jetty-launcher-5621-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 3293149 INFO (jetty-launcher-5621-thread-4) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 3293149 INFO (jetty-launcher-5621-thread-6) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 3293149 INFO (jetty-launcher-5621-thread-6) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 3293149 INFO (jetty-launcher-5621-thread-6) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 3293149 INFO (jetty-launcher-5621-thread-5) [ ] o.e.j.s.AbstractConnector Started ServerConnector@926439e{HTTP/1.1,[http/1.1]}{127.0.0.1:52300}
[junit4] 2> 3293149 INFO (jetty-launcher-5621-thread-5) [ ] o.e.j.s.Server Started @3297533ms
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-5) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52300}
[junit4] 2> 3293149 INFO (zkConnectionManagerCallback-5626-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293150 ERROR (jetty-launcher-5621-thread-5) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-6) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@79d332ce{/solr,null,AVAILABLE}
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-5) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-5) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-5) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-5) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-24T20:08:12.833Z
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-6) [ ] o.e.j.s.AbstractConnector Started ServerConnector@73f90a79{HTTP/1.1,[http/1.1]}{127.0.0.1:64588}
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-6) [ ] o.e.j.s.Server Started @3297534ms
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-6) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64588}
[junit4] 2> 3293150 ERROR (jetty-launcher-5621-thread-6) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-6) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-6) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-6) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3293150 INFO (jetty-launcher-5621-thread-6) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-24T20:08:12.833Z
[junit4] 2> 3293151 INFO (jetty-launcher-5621-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@655b99e1{/solr,null,AVAILABLE}
[junit4] 2> 3293151 INFO (jetty-launcher-5621-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@54331d27{HTTP/1.1,[http/1.1]}{127.0.0.1:53881}
[junit4] 2> 3293151 INFO (jetty-launcher-5621-thread-4) [ ] o.e.j.s.Server Started @3297535ms
[junit4] 2> 3293151 INFO (jetty-launcher-5621-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53881}
[junit4] 2> 3293152 ERROR (jetty-launcher-5621-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3293152 INFO (jetty-launcher-5621-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 3293152 INFO (jetty-launcher-5621-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3293152 INFO (jetty-launcher-5621-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3293152 INFO (jetty-launcher-5621-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3293152 INFO (jetty-launcher-5621-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-24T20:08:12.835Z
[junit4] 2> 3293154 INFO (zkConnectionManagerCallback-5632-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293154 INFO (jetty-launcher-5621-thread-6) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3293155 INFO (jetty-launcher-5621-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@33199539{HTTP/1.1,[http/1.1]}{127.0.0.1:53556}
[junit4] 2> 3293155 INFO (jetty-launcher-5621-thread-2) [ ] o.e.j.s.Server Started @3297539ms
[junit4] 2> 3293155 INFO (jetty-launcher-5621-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53556}
[junit4] 2> 3293156 ERROR (jetty-launcher-5621-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3293156 INFO (jetty-launcher-5621-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 3293156 INFO (jetty-launcher-5621-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3293156 INFO (jetty-launcher-5621-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 3293156 INFO (jetty-launcher-5621-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-24T20:08:12.839Z
[junit4] 2> 3293157 INFO (zkConnectionManagerCallback-5630-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293158 INFO (zkConnectionManagerCallback-5628-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293158 INFO (zkConnectionManagerCallback-5634-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293159 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100b3ee5e220004, likely client has closed socket
[junit4] 2> 3293159 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100b3ee5e220001, likely client has closed socket
[junit4] 2> 3293160 INFO (jetty-launcher-5621-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3293160 INFO (jetty-launcher-5621-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3293160 INFO (zkConnectionManagerCallback-5636-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293161 INFO (jetty-launcher-5621-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54266/solr
[junit4] 2> 3293161 INFO (jetty-launcher-5621-thread-6) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54266/solr
[junit4] 2> 3293161 INFO (jetty-launcher-5621-thread-5) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3293162 INFO (jetty-launcher-5621-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 3293165 INFO (zkConnectionManagerCallback-5642-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293167 INFO (zkConnectionManagerCallback-5644-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293168 INFO (jetty-launcher-5621-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54266/solr
[junit4] 2> 3293168 INFO (jetty-launcher-5621-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54266/solr
[junit4] 2> 3293168 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100b3ee5e220007, likely client has closed socket
[junit4] 2> 3293171 INFO (jetty-launcher-5621-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54266/solr
[junit4] 2> 3293172 INFO (zkConnectionManagerCallback-5652-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293173 INFO (zkConnectionManagerCallback-5650-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293174 INFO (jetty-launcher-5621-thread-5) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54266/solr
[junit4] 2> 3293174 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100b3ee5e220008, likely client has closed socket
[junit4] 2> 3293175 INFO (zkConnectionManagerCallback-5658-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293175 INFO (zkConnectionManagerCallback-5661-thread-1-processing-n:127.0.0.1:64588_solr) [n:127.0.0.1:64588_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293175 INFO (zkConnectionManagerCallback-5664-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293176 INFO (zkConnectionManagerCallback-5654-thread-1-processing-n:127.0.0.1:40061_solr) [n:127.0.0.1:40061_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293177 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100b3ee5e22000a, likely client has closed socket
[junit4] 2> 3293179 INFO (zkConnectionManagerCallback-5666-thread-1-processing-n:127.0.0.1:53881_solr) [n:127.0.0.1:53881_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293188 INFO (zkConnectionManagerCallback-5668-thread-1-processing-n:127.0.0.1:53556_solr) [n:127.0.0.1:53556_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293190 INFO (zkConnectionManagerCallback-5670-thread-1-processing-n:127.0.0.1:52300_solr) [n:127.0.0.1:52300_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293197 INFO (zkConnectionManagerCallback-5672-thread-1-processing-n:127.0.0.1:62320_solr) [n:127.0.0.1:62320_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293217 INFO (jetty-launcher-5621-thread-5) [n:127.0.0.1:52300_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3293218 INFO (jetty-launcher-5621-thread-6) [n:127.0.0.1:64588_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3293218 INFO (jetty-launcher-5621-thread-5) [n:127.0.0.1:52300_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:52300_solr
[junit4] 2> 3293220 INFO (jetty-launcher-5621-thread-5) [n:127.0.0.1:52300_solr ] o.a.s.c.Overseer Overseer (id=72255430400802832-127.0.0.1:52300_solr-n_0000000000) starting
[junit4] 2> 3293221 INFO (jetty-launcher-5621-thread-6) [n:127.0.0.1:64588_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64588_solr
[junit4] 2> 3293241 INFO (zkCallback-5660-thread-1-processing-n:127.0.0.1:64588_solr) [n:127.0.0.1:64588_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3293243 INFO (zkCallback-5671-thread-1-processing-n:127.0.0.1:62320_solr) [n:127.0.0.1:62320_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3293244 INFO (zkCallback-5669-thread-1-processing-n:127.0.0.1:52300_solr) [n:127.0.0.1:52300_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3293245 INFO (jetty-launcher-5621-thread-3) [n:127.0.0.1:62320_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3293248 INFO (jetty-launcher-5621-thread-3) [n:127.0.0.1:62320_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62320_solr
[junit4] 2> 3293249 INFO (zkCallback-5669-thread-1-processing-n:127.0.0.1:52300_solr) [n:127.0.0.1:52300_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3293250 INFO (zkCallback-5671-thread-1-processing-n:127.0.0.1:62320_solr) [n:127.0.0.1:62320_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3293250 INFO (zkCallback-5660-thread-1-processing-n:127.0.0.1:64588_solr) [n:127.0.0.1:64588_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3293265 INFO (jetty-launcher-5621-thread-5) [n:127.0.0.1:52300_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52300_solr
[junit4] 2> 3293268 INFO (zkCallback-5671-thread-1-processing-n:127.0.0.1:62320_solr) [n:127.0.0.1:62320_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 3293278 INFO (OverseerStateUpdate-72255430400802832-127.0.0.1:52300_solr-n_0000000000) [n:127.0.0.1:52300_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 3293294 INFO (zkCallback-5660-thread-1-processing-n:127.0.0.1:64588_solr) [n:127.0.0.1:64588_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 3293347 INFO (jetty-launcher-5621-thread-2) [n:127.0.0.1:53556_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 3293347 INFO (jetty-launcher-5621-thread-3) [n:127.0.0.1:62320_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62320.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293351 INFO (jetty-launcher-5621-thread-2) [n:127.0.0.1:53556_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3293355 INFO (jetty-launcher-5621-thread-3) [n:127.0.0.1:62320_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62320.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293355 INFO (jetty-launcher-5621-thread-3) [n:127.0.0.1:62320_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62320.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293355 INFO (jetty-launcher-5621-thread-2) [n:127.0.0.1:53556_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53556_solr
[junit4] 2> 3293357 INFO (jetty-launcher-5621-thread-3) [n:127.0.0.1:62320_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node5/.
[junit4] 2> 3293358 INFO (zkCallback-5669-thread-1-processing-n:127.0.0.1:52300_solr) [n:127.0.0.1:52300_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 3293358 INFO (zkCallback-5660-thread-1-processing-n:127.0.0.1:64588_solr) [n:127.0.0.1:64588_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 3293359 INFO (zkCallback-5667-thread-1-processing-n:127.0.0.1:53556_solr) [n:127.0.0.1:53556_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 3293360 INFO (zkCallback-5671-thread-1-processing-n:127.0.0.1:62320_solr) [n:127.0.0.1:62320_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 3293369 INFO (jetty-launcher-5621-thread-4) [n:127.0.0.1:53881_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 3293370 INFO (jetty-launcher-5621-thread-4) [n:127.0.0.1:53881_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3293372 INFO (jetty-launcher-5621-thread-4) [n:127.0.0.1:53881_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53881_solr
[junit4] 2> 3293378 INFO (zkCallback-5669-thread-2-processing-n:127.0.0.1:52300_solr) [n:127.0.0.1:52300_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 3293382 INFO (zkCallback-5660-thread-1-processing-n:127.0.0.1:64588_solr) [n:127.0.0.1:64588_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 3293382 INFO (zkCallback-5671-thread-1-processing-n:127.0.0.1:62320_solr) [n:127.0.0.1:62320_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 3293385 INFO (zkCallback-5665-thread-1-processing-n:127.0.0.1:53881_solr) [n:127.0.0.1:53881_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 3293386 INFO (zkCallback-5667-thread-1-processing-n:127.0.0.1:53556_solr) [n:127.0.0.1:53556_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 3293442 INFO (jetty-launcher-5621-thread-5) [n:127.0.0.1:52300_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52300.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293448 INFO (jetty-launcher-5621-thread-5) [n:127.0.0.1:52300_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52300.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293448 INFO (jetty-launcher-5621-thread-5) [n:127.0.0.1:52300_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52300.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293449 INFO (jetty-launcher-5621-thread-5) [n:127.0.0.1:52300_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node3/.
[junit4] 2> 3293489 INFO (jetty-launcher-5621-thread-4) [n:127.0.0.1:53881_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53881.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293494 INFO (jetty-launcher-5621-thread-4) [n:127.0.0.1:53881_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53881.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293495 INFO (jetty-launcher-5621-thread-4) [n:127.0.0.1:53881_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53881.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293495 INFO (jetty-launcher-5621-thread-4) [n:127.0.0.1:53881_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node4/.
[junit4] 2> 3293503 INFO (jetty-launcher-5621-thread-1) [n:127.0.0.1:40061_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 3293505 INFO (jetty-launcher-5621-thread-1) [n:127.0.0.1:40061_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3293511 INFO (jetty-launcher-5621-thread-1) [n:127.0.0.1:40061_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40061_solr
[junit4] 2> 3293521 INFO (jetty-launcher-5621-thread-2) [n:127.0.0.1:53556_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53556.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293528 INFO (jetty-launcher-5621-thread-2) [n:127.0.0.1:53556_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53556.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293528 INFO (jetty-launcher-5621-thread-2) [n:127.0.0.1:53556_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53556.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293529 INFO (zkCallback-5671-thread-1-processing-n:127.0.0.1:62320_solr) [n:127.0.0.1:62320_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 3293530 INFO (zkCallback-5653-thread-1-processing-n:127.0.0.1:40061_solr) [n:127.0.0.1:40061_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 3293530 INFO (zkCallback-5669-thread-2-processing-n:127.0.0.1:52300_solr) [n:127.0.0.1:52300_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 3293530 INFO (zkCallback-5665-thread-1-processing-n:127.0.0.1:53881_solr) [n:127.0.0.1:53881_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 3293530 INFO (zkCallback-5660-thread-1-processing-n:127.0.0.1:64588_solr) [n:127.0.0.1:64588_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 3293530 INFO (zkCallback-5667-thread-1-processing-n:127.0.0.1:53556_solr) [n:127.0.0.1:53556_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 3293531 INFO (jetty-launcher-5621-thread-2) [n:127.0.0.1:53556_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node2/.
[junit4] 2> 3293536 INFO (jetty-launcher-5621-thread-6) [n:127.0.0.1:64588_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64588.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293542 INFO (jetty-launcher-5621-thread-6) [n:127.0.0.1:64588_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64588.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293542 INFO (jetty-launcher-5621-thread-6) [n:127.0.0.1:64588_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64588.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293560 INFO (jetty-launcher-5621-thread-6) [n:127.0.0.1:64588_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node6/.
[junit4] 2> 3293636 INFO (jetty-launcher-5621-thread-1) [n:127.0.0.1:40061_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40061.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293641 INFO (jetty-launcher-5621-thread-1) [n:127.0.0.1:40061_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40061.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293641 INFO (jetty-launcher-5621-thread-1) [n:127.0.0.1:40061_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40061.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3293642 INFO (jetty-launcher-5621-thread-1) [n:127.0.0.1:40061_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node1/.
[junit4] 2> 3293679 INFO (zkConnectionManagerCallback-5686-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293698 INFO (zkConnectionManagerCallback-5690-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293700 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[45B87FA4ED6EE6A5]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (6)
[junit4] 2> 3293701 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[45B87FA4ED6EE6A5]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54266/solr ready
[junit4] 2> 3293747 INFO (TEST-ReplaceNodeNoTargetTest.test-seed#[45B87FA4ED6EE6A5]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 3293749 INFO (zkConnectionManagerCallback-5692-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 3293751 INFO (TEST-ReplaceNodeNoTargetTest.test-seed#[45B87FA4ED6EE6A5]) [ ] o.a.s.c.ReplaceNodeNoTargetTest total_jettys: 6
[junit4] 2> 3293757 INFO (qtp959153243-26833) [n:127.0.0.1:40061_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293758 INFO (qtp1249410927-26861) [n:127.0.0.1:52300_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293760 INFO (qtp1773278144-26851) [n:127.0.0.1:53556_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293761 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293763 INFO (qtp1811605054-26842) [n:127.0.0.1:62320_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293764 INFO (qtp747869103-26858) [n:127.0.0.1:64588_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293765 INFO (qtp1570228765-26850) [n:127.0.0.1:53881_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=14
[junit4] 2> 3293766 INFO (qtp747869103-26873) [n:127.0.0.1:64588_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=2&collection.configName=conf1&name=replacenodetest_coll_notarget&nrtReplicas=2&action=CREATE&numShards=5&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3293771 INFO (OverseerThreadFactory-10536-thread-1-processing-n:127.0.0.1:52300_solr) [n:127.0.0.1:52300_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection replacenodetest_coll_notarget
[junit4] 2> 3293774 INFO (qtp959153243-26838) [n:127.0.0.1:40061_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293776 INFO (qtp1249410927-26864) [n:127.0.0.1:52300_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293777 INFO (qtp1773278144-26855) [n:127.0.0.1:53556_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293778 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293779 INFO (qtp1811605054-26846) [n:127.0.0.1:62320_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293780 INFO (qtp747869103-26886) [n:127.0.0.1:64588_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 3293782 INFO (OverseerThreadFactory-10536-thread-1-processing-n:127.0.0.1:52300_solr) [n:127.0.0.1:52300_solr ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 3018744079 sessionWrapper.createTime 3018744077418752, this.sessionWrapper.createTime 3018744077418752
[junit4] 2> 3293895 INFO (OverseerStateUpdate-72255430400802832-127.0.0.1:52300_solr-n_0000000000) [n:127.0.0.1:52300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:64588/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3293899 INFO (OverseerStateUpdate-72255430400802832-127.0.0.1:52300_solr-n_0000000000) [n:127.0.0.1:52300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:62320/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3293904 INFO (OverseerStateUpdate-72255430400802832-127.0.0.1:52300_solr-n_0000000000) [n:127.0.0.1:52300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53881/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3293907 INFO (OverseerStateUpdate-72255430400802832-127.0.0.1:52300_solr-n_0000000000) [n:127.0.0.1:52300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53556/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3293910 INFO (OverseerStateUpdate-72255430400802832-127.0.0.1:52300_solr-n_0000000000) [n:127.0.0.1:52300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard3_replica_n8",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52300/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3293913 INFO (OverseerStateUpdate-72255430400802832-127.0.0.1:52300_solr-n_0000000000) [n:127.0.0.1:52300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard3_replica_n10",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40061/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3293917 INFO (OverseerStateUpdate-72255430400802832-127.0.0.1:52300_solr-n_0000000000) [n:127.0.0.1:52300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard4",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard4_replica_n12",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40061/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3293920 INFO (OverseerStateUpdate-72255430400802832-127.0.0.1:52300_solr-n_0000000000) [n:127.0.0.1:52300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard4",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard4_replica_n14",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52300/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3293924 INFO (OverseerStateUpdate-72255430400802832-127.0.0.1:52300_solr-n_0000000000) [n:127.0.0.1:52300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard5",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard5_replica_n16",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53556/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3293927 INFO (OverseerStateUpdate-72255430400802832-127.0.0.1:52300_solr-n_0000000000) [n:127.0.0.1:52300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"replacenodetest_coll_notarget",
[junit4] 2> "shard":"shard5",
[junit4] 2> "core":"replacenodetest_coll_notarget_shard5_replica_n18",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53881/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 3294130 INFO (qtp747869103-26886) [n:127.0.0.1:64588_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard1_replica_n1&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3294131 INFO (qtp747869103-26886) [n:127.0.0.1:64588_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3294133 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node20&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard5_replica_n18&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard5&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3294133 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3294133 INFO (qtp959153243-26838) [n:127.0.0.1:40061_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard3_replica_n10&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3294133 INFO (qtp959153243-26838) [n:127.0.0.1:40061_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3294133 INFO (qtp1249410927-26864) [n:127.0.0.1:52300_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard3_replica_n8&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3294134 INFO (qtp1570228765-26878) [n:127.0.0.1:53881_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard2_replica_n4&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3294134 INFO (qtp1249410927-26864) [n:127.0.0.1:52300_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3294134 INFO (qtp1773278144-26855) [n:127.0.0.1:53556_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard2_replica_n6&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3294134 INFO (qtp1811605054-26846) [n:127.0.0.1:62320_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard1_replica_n2&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3294134 INFO (qtp1773278144-26855) [n:127.0.0.1:53556_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3294134 INFO (qtp1249410927-26865) [n:127.0.0.1:52300_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node17&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard4_replica_n14&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard4&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3294134 INFO (qtp1811605054-26846) [n:127.0.0.1:62320_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 3294134 INFO (qtp959153243-26836) [n:127.0.0.1:40061_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard4_replica_n12&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard4&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3294135 INFO (qtp1773278144-26857) [n:127.0.0.1:53556_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node19&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard5_replica_n16&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard5&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3294248 INFO (zkCallback-5671-thread-1-processing-n:127.0.0.1:62320_solr) [n:127.0.0.1:62320_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3294248 INFO (zkCallback-5660-thread-1-processing-n:127.0.0.1:64588_solr) [n:127.0.0.1:64588_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3294248 INFO (zkCallback-5669-thread-2-processing-n:127.0.0.1:52300_solr) [n:127.0.0.1:52300_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3294248 INFO (zkCallback-5671-thread-2-processing-n:127.0.0.1:62320_solr) [n:127.0.0.1:62320_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3294248 INFO (zkCallback-5669-thread-1-processing-n:127.0.0.1:52300_solr) [n:127.0.0.1:52300_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3294248 INFO (zkCallback-5660-thread-2-processing-n:127.0.0.1:64588_solr) [n:127.0.0.1:64588_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3294248 INFO (zkCallback-5667-thread-1-processing-n:127.0.0.1:53556_solr) [n:127.0.0.1:53556_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3294248 INFO (zkCallback-5667-thread-2-processing-n:127.0.0.1:53556_solr) [n:127.0.0.1:53556_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3294248 INFO (zkCallback-5653-thread-1-processing-n:127.0.0.1:40061_solr) [n:127.0.0.1:40061_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3294248 INFO (zkCallback-5665-thread-1-processing-n:127.0.0.1:53881_solr) [n:127.0.0.1:53881_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3294248 INFO (zkCallback-5653-thread-2-processing-n:127.0.0.1:40061_solr) [n:127.0.0.1:40061_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3294248 INFO (zkCallback-5665-thread-2-processing-n:127.0.0.1:53881_solr) [n:127.0.0.1:53881_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
[junit4] 2> 3295154 INFO (qtp747869103-26886) [n:127.0.0.1:64588_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3295154 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3295161 INFO (qtp747869103-26886) [n:127.0.0.1:64588_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard1_replica_n1] Schema name=cloud-dynamic
[junit4] 2> 3295166 INFO (qtp1249410927-26864) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3295167 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard5_replica_n18] Schema name=cloud-dynamic
[junit4] 2> 3295200 INFO (qtp747869103-26886) [n:127.0.0.1:64588_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3295201 INFO (qtp747869103-26886) [n:127.0.0.1:64588_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard1_replica_n1' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 3295201 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3295201 INFO (qtp747869103-26886) [n:127.0.0.1:64588_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64588.solr.core.replacenodetest_coll_notarget.shard1.replica_n1' (registry 'solr.core.replacenodetest_coll_notarget.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3295201 INFO (qtp747869103-26886) [n:127.0.0.1:64588_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3295201 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard5_replica_n18' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 3295201 INFO (qtp747869103-26886) [n:127.0.0.1:64588_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node6/replacenodetest_coll_notarget_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node6/./replacenodetest_coll_notarget_shard1_replica_n1/data/]
[junit4] 2> 3295201 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53881.solr.core.replacenodetest_coll_notarget.shard5.replica_n18' (registry 'solr.core.replacenodetest_coll_notarget.shard5.replica_n18') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3295202 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3295202 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard5_replica_n18] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node4/replacenodetest_coll_notarget_shard5_replica_n18], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node4/./replacenodetest_coll_notarget_shard5_replica_n18/data/]
[junit4] 2> 3295228 INFO (qtp1570228765-26878) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3295228 INFO (qtp1773278144-26855) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3295235 INFO (qtp1249410927-26864) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard3_replica_n8] Schema name=cloud-dynamic
[junit4] 2> 3295236 INFO (qtp1249410927-26865) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3295261 INFO (qtp1249410927-26865) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard4_replica_n14] Schema name=cloud-dynamic
[junit4] 2> 3295266 INFO (qtp1249410927-26864) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3295266 INFO (qtp1249410927-26864) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard3_replica_n8' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 3295266 INFO (qtp1249410927-26864) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52300.solr.core.replacenodetest_coll_notarget.shard3.replica_n8' (registry 'solr.core.replacenodetest_coll_notarget.shard3.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3295266 INFO (qtp1249410927-26864) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3295266 INFO (qtp1249410927-26864) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard3_replica_n8] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node3/replacenodetest_coll_notarget_shard3_replica_n8], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node3/./replacenodetest_coll_notarget_shard3_replica_n8/data/]
[junit4] 2> 3295270 INFO (qtp1811605054-26846) [n:127.0.0.1:62320_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3295271 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3295272 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3295274 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3295274 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3295275 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.s.SolrIndexSearcher Opening [Searcher@1a1fff0c[replacenodetest_coll_notarget_shard5_replica_n18] main]
[junit4] 2> 3295278 INFO (qtp1249410927-26865) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3295278 INFO (qtp959153243-26836) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3295279 INFO (qtp1249410927-26865) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard4_replica_n14' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 3295279 INFO (qtp1249410927-26865) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52300.solr.core.replacenodetest_coll_notarget.shard4.replica_n14' (registry 'solr.core.replacenodetest_coll_notarget.shard4.replica_n14') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3295279 INFO (qtp1249410927-26865) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3295279 INFO (qtp1249410927-26865) [n:127.0.0.1:52300_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard4_replica_n14] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node3/replacenodetest_coll_notarget_shard4_replica_n14], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node3/./replacenodetest_coll_notarget_shard4_replica_n14/data/]
[junit4] 2> 3295283 INFO (qtp1570228765-26878) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard2_replica_n4] Schema name=cloud-dynamic
[junit4] 2> 3295288 INFO (qtp1773278144-26855) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard2_replica_n6] Schema name=cloud-dynamic
[junit4] 2> 3295309 INFO (qtp1773278144-26857) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3295313 INFO (qtp1570228765-26878) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3295313 INFO (qtp1570228765-26878) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard2_replica_n4' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 3295313 INFO (qtp1570228765-26878) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53881.solr.core.replacenodetest_coll_notarget.shard2.replica_n4' (registry 'solr.core.replacenodetest_coll_notarget.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3295313 INFO (qtp1570228765-26878) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3295313 INFO (qtp1570228765-26878) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard2_replica_n4] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node4/replacenodetest_coll_notarget_shard2_replica_n4], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node4/./replacenodetest_coll_notarget_shard2_replica_n4/data/]
[junit4] 2> 3295321 INFO (qtp1811605054-26846) [n:127.0.0.1:62320_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard1_replica_n2] Schema name=cloud-dynamic
[junit4] 2> 3295335 INFO (qtp1773278144-26857) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard5_replica_n16] Schema name=cloud-dynamic
[junit4] 2> 3295366 INFO (qtp959153243-26836) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard4_replica_n12] Schema name=cloud-dynamic
[junit4] 2> 3295367 INFO (qtp959153243-26838) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 3295370 INFO (qtp1773278144-26857) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3295370 INFO (qtp1773278144-26857) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard5_replica_n16' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 3295370 INFO (qtp1773278144-26857) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53556.solr.core.replacenodetest_coll_notarget.shard5.replica_n16' (registry 'solr.core.replacenodetest_coll_notarget.shard5.replica_n16') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3295371 INFO (qtp1773278144-26857) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3295371 INFO (qtp1773278144-26857) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard5_replica_n16] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node2/replacenodetest_coll_notarget_shard5_replica_n16], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node2/./replacenodetest_coll_notarget_shard5_replica_n16/data/]
[junit4] 2> 3295377 INFO (qtp959153243-26838) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard3_replica_n10] Schema name=cloud-dynamic
[junit4] 2> 3295405 INFO (qtp959153243-26836) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3295405 INFO (qtp959153243-26836) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard4_replica_n12' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 3295405 INFO (qtp959153243-26836) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40061.solr.core.replacenodetest_coll_notarget.shard4.replica_n12' (registry 'solr.core.replacenodetest_coll_notarget.shard4.replica_n12') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3295405 INFO (qtp959153243-26836) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3295405 INFO (qtp959153243-26836) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard4_replica_n12] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node1/replacenodetest_coll_notarget_shard4_replica_n12], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node1/./replacenodetest_coll_notarget_shard4_replica_n12/data/]
[junit4] 2> 3295410 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3295405 INFO (qtp1773278144-26855) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3295423 INFO (qtp1773278144-26855) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard2_replica_n6' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 3295419 INFO (qtp959153243-26838) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3295423 INFO (qtp959153243-26838) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard3_replica_n10' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 3295423 INFO (qtp1773278144-26855) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53556.solr.core.replacenodetest_coll_notarget.shard2.replica_n6' (registry 'solr.core.replacenodetest_coll_notarget.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3295423 INFO (qtp959153243-26838) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40061.solr.core.replacenodetest_coll_notarget.shard3.replica_n10' (registry 'solr.core.replacenodetest_coll_notarget.shard3.replica_n10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3295423 INFO (qtp1773278144-26855) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3295423 INFO (qtp959153243-26838) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3295423 INFO (qtp1773278144-26855) [n:127.0.0.1:53556_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard2_replica_n6] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node2/replacenodetest_coll_notarget_shard2_replica_n6], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node2/./replacenodetest_coll_notarget_shard2_replica_n6/data/]
[junit4] 2> 3295423 INFO (qtp959153243-26838) [n:127.0.0.1:40061_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard3_replica_n10] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node1/replacenodetest_coll_notarget_shard3_replica_n10], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node1/./replacenodetest_coll_notarget_shard3_replica_n10/data/]
[junit4] 2> 3295426 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3295427 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3295427 INFO (searcherExecutor-10550-thread-1-processing-n:127.0.0.1:53881_solr x:replacenodetest_coll_notarget_shard5_replica_n18 s:shard5 c:replacenodetest_coll_notarget r:core_node20) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrCore [replacenodetest_coll_notarget_shard5_replica_n18] Registered new searcher Searcher@1a1fff0c[replacenodetest_coll_notarget_shard5_replica_n18] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3295428 INFO (qtp1570228765-26880) [n:127.0.0.1:53881_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593314267743911936
[junit4] 2> 3295432 INFO (qtp1811605054-26846) [n:127.0.0.1:62320_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 3295433 INFO (qtp1811605054-26846) [n:127.0.0.1:62320_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard1_replica_n2' using configuration from collection replacenodetest_coll_notarget, trusted=true
[junit4] 2> 3295433 INFO (qtp1811605054-26846) [n:127.0.0.1:62320_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62320.solr.core.replacenodetest_coll_notarget.shard1.replica_n2' (registry 'solr.core.replacenodetest_coll_notarget.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@700b8cde
[junit4] 2> 3295433 INFO (qtp1811605054-26846) [n:127.0.0.1:62320_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3295433 INFO (qtp1811605054-26846) [n:127.0.0.1:62320_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard1_replica_n2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node5/replacenodetest_coll_notarget_shard1_replica_n2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_45B87FA4ED6EE6A5-001/tempDir-001/node5/./re
[...truncated too long message...]
2> 181111 INFO (TEST-TestLargeCluster.testBasic-seed#[45B87FA4ED6EE6A5]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - autoscaling 2
[junit4] 2> 181111 INFO (TEST-TestLargeCluster.testBasic-seed#[45B87FA4ED6EE6A5]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - update 5
[junit4] 2> 181111 INFO (TEST-TestLargeCluster.testBasic-seed#[45B87FA4ED6EE6A5]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
[junit4] 2> 181112 INFO (TEST-TestLargeCluster.testBasic-seed#[45B87FA4ED6EE6A5]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * Trigger: .auto_add_replicas
[junit4] 2> 181112 INFO (TEST-TestLargeCluster.testBasic-seed#[45B87FA4ED6EE6A5]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - STARTED 1
[junit4] 2> 181112 INFO (TEST-TestLargeCluster.testBasic-seed#[45B87FA4ED6EE6A5]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - SUCCEEDED 1
[junit4] 2> 181112 INFO (TEST-TestLargeCluster.testBasic-seed#[45B87FA4ED6EE6A5]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * Trigger: node_lost_trigger
[junit4] 2> 181112 INFO (TEST-TestLargeCluster.testBasic-seed#[45B87FA4ED6EE6A5]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - STARTED 2
[junit4] 2> 181112 INFO (TEST-TestLargeCluster.testBasic-seed#[45B87FA4ED6EE6A5]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - SUCCEEDED 1
[junit4] OK 5.13s J1 | TestLargeCluster.testBasic
[junit4] 2> 181112 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 181113 DEBUG (SUITE-TestLargeCluster-seed#[45B87FA4ED6EE6A5]-worker) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 181113 WARN (AutoscalingActionExecutor-472-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Exception executing actions
[junit4] 2> java.lang.Exception: Error executing action: execute for trigger event: {
[junit4] 2> "id":"ac041a5e76132T1tau8jjcd1ftatf87lk4q95g6",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":3026137955918130,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[
[junit4] 2> 3026137955918130,
[junit4] 2> 3026137967465830,
[junit4] 2> 3026137963555030,
[junit4] 2> 3026137951884230,
[junit4] 2> 3026137968335880,
[junit4] 2> 3026137953811930,
[junit4] 2> 3026137962741480,
[junit4] 2> 3026137954569480,
[junit4] 2> 3026137969427830,
[junit4] 2> 3026137964743580],
[junit4] 2> "_enqueue_time_":3026143328601030,
[junit4] 2> "nodeNames":[
[junit4] 2> "127.0.0.1:10206_solr",
[junit4] 2> "127.0.0.1:10269_solr",
[junit4] 2> "127.0.0.1:10201_solr",
[junit4] 2> "127.0.0.1:10279_solr",
[junit4] 2> "127.0.0.1:10246_solr",
[junit4] 2> "127.0.0.1:10273_solr",
[junit4] 2> "127.0.0.1:10222_solr",
[junit4] 2> "127.0.0.1:10143_solr",
[junit4] 2> "127.0.0.1:10193_solr",
[junit4] 2> "127.0.0.1:10215_solr"]}}
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:301)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: Unexpected exception while processing event: {
[junit4] 2> "id":"ac041a5e76132T1tau8jjcd1ftatf87lk4q95g6",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":3026137955918130,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[
[junit4] 2> 3026137955918130,
[junit4] 2> 3026137967465830,
[junit4] 2> 3026137963555030,
[junit4] 2> 3026137951884230,
[junit4] 2> 3026137968335880,
[junit4] 2> 3026137953811930,
[junit4] 2> 3026137962741480,
[junit4] 2> 3026137954569480,
[junit4] 2> 3026137969427830,
[junit4] 2> 3026137964743580],
[junit4] 2> "_enqueue_time_":3026143328601030,
[junit4] 2> "nodeNames":[
[junit4] 2> "127.0.0.1:10206_solr",
[junit4] 2> "127.0.0.1:10269_solr",
[junit4] 2> "127.0.0.1:10201_solr",
[junit4] 2> "127.0.0.1:10279_solr",
[junit4] 2> "127.0.0.1:10246_solr",
[junit4] 2> "127.0.0.1:10273_solr",
[junit4] 2> "127.0.0.1:10222_solr",
[junit4] 2> "127.0.0.1:10143_solr",
[junit4] 2> "127.0.0.1:10193_solr",
[junit4] 2> "127.0.0.1:10215_solr"]}}
[junit4] 2> at org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:120)
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:298)
[junit4] 2> ... 6 more
[junit4] 2> Caused by: org.apache.solr.common.SolrException: Unexpected exception executing operation: action=MOVEREPLICA&async=node_lost_trigger/ac041a5e76132T1tau8jjcd1ftatf87lk4q95g6/0&waitForFinalState=true&collection=testBasic&targetNode=127.0.0.1:10170_solr&inPlaceMove=true&replica=core_node26
[junit4] 2> at org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:110)
[junit4] 2> ... 7 more
[junit4] 2> Caused by: java.io.IOException: java.lang.InterruptedException
[junit4] 2> at org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:462)
[junit4] 2> at org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:80)
[junit4] 2> ... 7 more
[junit4] 2> Caused by: java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:404)
[junit4] 2> at java.util.concurrent.FutureTask.get(FutureTask.java:191)
[junit4] 2> at org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:460)
[junit4] 2> ... 8 more
[junit4] 2> 181114 DEBUG (AutoscalingActionExecutor-472-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 98660 ms for event id=ac041a5e76132T1tau8jjcd1ftatf87lk4q95g6
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestLargeCluster_45B87FA4ED6EE6A5-001
[junit4] 2> Feb 24, 2018 8:56:04 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 93 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=786, maxMBSortInHeap=5.844735566384474, sim=RandomSimilarity(queryNorm=false): {}, locale=hu-HU, timezone=Iran
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=1,free=213256352,total=446693376
[junit4] 2> NOTE: All tests run in this JVM: [ReplaceNodeNoTargetTest, ReplaceNodeNoTargetTest, ReplaceNodeNoTargetTest, ReplaceNodeNoTargetTest, TestLargeCluster, TestLargeCluster]
[junit4] Completed [10/10 (3!)] on J1 in 44.52s, 4 tests, 1 failure <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1560: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1085: There were test failures: 10 suites, 25 tests, 3 failures [seed: 45B87FA4ED6EE6A5]
Total time: 3 minutes 5 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 1/5 failed: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster
[repro] 2/5 failed: org.apache.solr.cloud.ReplaceNodeNoTargetTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=d7f6cb93837e1bde1066c96606845c4ab04e50cf, workspace=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #460
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 460 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/460/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.cdcr.CdcrVersionReplicationTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.cdcr.CdcrVersionReplicationTest: 1) Thread[id=2149, name=Connection evictor, state=TIMED_WAITING, group=TGRP-CdcrVersionReplicationTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.cdcr.CdcrVersionReplicationTest:
1) Thread[id=2149, name=Connection evictor, state=TIMED_WAITING, group=TGRP-CdcrVersionReplicationTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([6186D302DE8376C0]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.cdcr.CdcrVersionReplicationTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=2149, name=Connection evictor, state=TIMED_WAITING, group=TGRP-CdcrVersionReplicationTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=2149, name=Connection evictor, state=TIMED_WAITING, group=TGRP-CdcrVersionReplicationTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([6186D302DE8376C0]:0)
FAILED: org.apache.solr.cloud.ReplaceNodeNoTargetTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([6186D302DE8376C0:E9D2ECD8707F1B38]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12221 lines...]
[junit4] Suite: org.apache.solr.cloud.cdcr.CdcrVersionReplicationTest
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/init-core-data-001
[junit4] 2> 255837 INFO (SUITE-CdcrVersionReplicationTest-seed#[6186D302DE8376C0]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 255839 INFO (SUITE-CdcrVersionReplicationTest-seed#[6186D302DE8376C0]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 255839 INFO (SUITE-CdcrVersionReplicationTest-seed#[6186D302DE8376C0]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 255870 INFO (SUITE-CdcrVersionReplicationTest-seed#[6186D302DE8376C0]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 255872 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 255872 INFO (Thread-427) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 255872 INFO (Thread-427) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 255874 ERROR (Thread-427) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 255980 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.ZkTestServer start zk server on port:54513
[junit4] 2> 255985 INFO (zkConnectionManagerCallback-432-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 256018 INFO (zkConnectionManagerCallback-434-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 256038 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 256040 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 256042 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 256052 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 256053 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 256055 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 256057 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 256058 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 256060 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 256061 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 256063 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 256081 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCdcrDocVersions
[junit4] 2> 256502 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 256503 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 256503 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 256503 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 256505 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@16e600d6{/,null,AVAILABLE}
[junit4] 2> 256525 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@770d488a{HTTP/1.1,[http/1.1]}{127.0.0.1:48975}
[junit4] 2> 256525 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.Server Started @258412ms
[junit4] 2> 256525 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1, hostContext=/, hostPort=48975, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-001/cores}
[junit4] 2> 256525 ERROR (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 256525 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 256525 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 256525 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 256525 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-24T06:31:45.420Z
[junit4] 2> 256530 INFO (zkConnectionManagerCallback-436-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 256534 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 256534 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-001/solr.xml
[junit4] 2> 256538 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 256538 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 256543 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 256566 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54513/solr
[junit4] 2> 256573 INFO (zkConnectionManagerCallback-440-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 256601 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100b1025ff40003, likely client has closed socket
[junit4] 2> 256603 INFO (zkConnectionManagerCallback-442-thread-1-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 256893 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:48975_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 256895 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:48975_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48975_
[junit4] 2> 256897 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:48975_ ] o.a.s.c.Overseer Overseer (id=72252217795805188-127.0.0.1:48975_-n_0000000000) starting
[junit4] 2> 256922 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:48975_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48975_
[junit4] 2> 256927 INFO (OverseerStateUpdate-72252217795805188-127.0.0.1:48975_-n_0000000000) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 257083 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:48975_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 257106 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:48975_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 257106 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:48975_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 257108 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:48975_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-001/cores
[junit4] 2> 257453 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 257477 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 257477 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 257477 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 257477 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@49e7941f{/,null,AVAILABLE}
[junit4] 2> 257478 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7c5f1cbe{HTTP/1.1,[http/1.1]}{127.0.0.1:58398}
[junit4] 2> 257478 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.Server Started @259365ms
[junit4] 2> 257478 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2, hostContext=/, hostPort=58398, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-002/cores}
[junit4] 2> 257478 ERROR (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 257478 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 257478 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 257478 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 257478 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-24T06:31:46.373Z
[junit4] 2> 257481 INFO (zkConnectionManagerCallback-446-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 257483 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 257483 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-002/solr.xml
[junit4] 2> 257486 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 257486 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 257487 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 257488 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54513/solr
[junit4] 2> 257494 INFO (zkConnectionManagerCallback-450-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 257509 INFO (zkConnectionManagerCallback-452-thread-1-processing-n:127.0.0.1:58398_) [n:127.0.0.1:58398_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 257619 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:58398_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 257626 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:58398_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 257672 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:58398_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58398_
[junit4] 2> 257673 INFO (zkCallback-441-thread-1-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 257709 INFO (zkCallback-451-thread-1-processing-n:127.0.0.1:58398_) [n:127.0.0.1:58398_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 257892 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:58398_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 257921 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:58398_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 257922 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:58398_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 257924 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:58398_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-002/cores
[junit4] 2> 258536 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 258537 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 258537 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 258538 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 258538 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2dbf535a{/,null,AVAILABLE}
[junit4] 2> 258538 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@640cdaef{HTTP/1.1,[http/1.1]}{127.0.0.1:60313}
[junit4] 2> 258538 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.Server Started @260426ms
[junit4] 2> 258539 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard3, hostContext=/, hostPort=60313, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-003/cores}
[junit4] 2> 258539 ERROR (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 258539 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 258539 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 258539 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 258539 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-24T06:31:47.434Z
[junit4] 2> 258601 INFO (zkConnectionManagerCallback-456-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 258603 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 258603 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-003/solr.xml
[junit4] 2> 258607 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 258607 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 258608 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 258677 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54513/solr
[junit4] 2> 258692 INFO (zkConnectionManagerCallback-460-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 258742 INFO (zkConnectionManagerCallback-462-thread-1-processing-n:127.0.0.1:60313_) [n:127.0.0.1:60313_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 258828 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:60313_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 258831 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:60313_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 258859 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:60313_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60313_
[junit4] 2> 258874 INFO (zkCallback-441-thread-1-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 258875 INFO (zkCallback-451-thread-1-processing-n:127.0.0.1:58398_) [n:127.0.0.1:58398_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 258929 INFO (zkCallback-461-thread-1-processing-n:127.0.0.1:60313_) [n:127.0.0.1:60313_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 259237 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:60313_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 259248 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:60313_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 259248 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:60313_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 259250 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:60313_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-003/cores
[junit4] 2> 259915 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 259917 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 259917 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 259917 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 259917 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@618713d3{/,null,AVAILABLE}
[junit4] 2> 259918 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1a3b8fb3{HTTP/1.1,[http/1.1]}{127.0.0.1:39183}
[junit4] 2> 259918 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.e.j.s.Server Started @261806ms
[junit4] 2> 259918 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard4, hostContext=/, hostPort=39183, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-004/cores}
[junit4] 2> 259918 ERROR (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 259918 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 259918 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 259918 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 259918 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-24T06:31:48.813Z
[junit4] 2> 259959 INFO (zkConnectionManagerCallback-466-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 259968 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 259968 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-004/solr.xml
[junit4] 2> 259973 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 259973 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 259974 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 259986 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54513/solr
[junit4] 2> 260017 INFO (zkConnectionManagerCallback-470-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 260028 INFO (zkConnectionManagerCallback-472-thread-1-processing-n:127.0.0.1:39183_) [n:127.0.0.1:39183_ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 260053 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:39183_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 260073 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:39183_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 260077 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:39183_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39183_
[junit4] 2> 260082 INFO (zkCallback-441-thread-2-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 260083 INFO (zkCallback-461-thread-1-processing-n:127.0.0.1:60313_) [n:127.0.0.1:60313_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 260084 INFO (zkCallback-471-thread-1-processing-n:127.0.0.1:39183_) [n:127.0.0.1:39183_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 260086 INFO (zkCallback-451-thread-1-processing-n:127.0.0.1:58398_) [n:127.0.0.1:58398_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 260250 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:39183_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 260264 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:39183_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 260264 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:39183_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 260266 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [n:127.0.0.1:39183_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-004/cores
[junit4] 2> 260498 INFO (zkConnectionManagerCallback-478-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 260501 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 260503 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[6186D302DE8376C0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54513/solr ready
[junit4] 2> 260513 INFO (qtp1937411511-2024) [n:127.0.0.1:39183_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=tmp_collection&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 260519 INFO (OverseerThreadFactory-1053-thread-1-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection tmp_collection
[junit4] 2> 260550 WARN (OverseerThreadFactory-1053-thread-1-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (tmp_collection) without cores.
[junit4] 2> 260678 INFO (qtp1937411511-2024) [n:127.0.0.1:39183_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 260679 INFO (qtp1937411511-2024) [n:127.0.0.1:39183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=tmp_collection&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&wt=javabin&version=2} status=0 QTime=169
[junit4] 2> 260681 INFO (qtp1937411511-2030) [n:127.0.0.1:39183_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:48975_&action=ADDREPLICA&collection=tmp_collection&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 260694 INFO (OverseerCollectionConfigSetProcessor-72252217795805188-127.0.0.1:48975_-n_0000000000) [n:127.0.0.1:48975_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 260697 INFO (OverseerThreadFactory-1053-thread-2-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:48975_ for creating new replica
[junit4] 2> 260732 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n41&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 260738 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 260859 INFO (zkCallback-441-thread-2-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 261800 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 261824 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.s.IndexSchema [tmp_collection_shard1_replica_n41] Schema name=test
[junit4] 2> 261941 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 262045 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'tmp_collection_shard1_replica_n41' using configuration from collection tmp_collection, trusted=true
[junit4] 2> 262046 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.tmp_collection.shard1.replica_n41' (registry 'solr.core.tmp_collection.shard1.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 262046 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 262046 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.SolrCore [[tmp_collection_shard1_replica_n41] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-001/cores/tmp_collection_shard1_replica_n41], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-001/cores/tmp_collection_shard1_replica_n41/data/]
[junit4] 2> 262059 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=34, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8531262231945422]
[junit4] 2> 262295 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 262295 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 262299 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 262299 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 262302 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 262302 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@6f616c28[tmp_collection_shard1_replica_n41] main]
[junit4] 2> 262321 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 262322 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 262322 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 262350 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.h.CdcrBufferStateManager Created znode /collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 262368 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.h.CdcrProcessStateManager Created znode /collections/tmp_collection/cdcr/state/process
[junit4] 2> 262455 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593262904547737600
[junit4] 2> 262456 INFO (searcherExecutor-1074-thread-1-processing-n:127.0.0.1:48975_ x:tmp_collection_shard1_replica_n41 s:shard1 c:tmp_collection) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.SolrCore [tmp_collection_shard1_replica_n41] Registered new searcher Searcher@6f616c28[tmp_collection_shard1_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 262475 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 262475 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 262475 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:48975/tmp_collection_shard1_replica_n41/
[junit4] 2> 262475 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 262475 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:48975/tmp_collection_shard1_replica_n41/ has no replicas
[junit4] 2> 262475 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 262482 INFO (zkCallback-441-thread-2-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ tmp_collection:shard1
[junit4] 2> 262487 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:48975/tmp_collection_shard1_replica_n41/ shard1
[junit4] 2> 262592 INFO (zkCallback-441-thread-2-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 262641 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 262646 INFO (qtp1151330776-1945) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n41&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1914
[junit4] 2> 262672 INFO (qtp1937411511-2030) [n:127.0.0.1:39183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:48975_&action=ADDREPLICA&collection=tmp_collection&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1991
[junit4] 2> 262673 INFO (qtp1937411511-2036) [n:127.0.0.1:39183_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:58398_&action=ADDREPLICA&collection=tmp_collection&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 262677 INFO (OverseerCollectionConfigSetProcessor-72252217795805188-127.0.0.1:48975_-n_0000000000) [n:127.0.0.1:48975_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 262677 INFO (OverseerThreadFactory-1053-thread-3-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:58398_ for creating new replica
[junit4] 2> 262684 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard2_replica_n43&action=CREATE&collection=tmp_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 262685 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 262795 INFO (zkCallback-451-thread-1-processing-n:127.0.0.1:58398_) [n:127.0.0.1:58398_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 262795 INFO (zkCallback-441-thread-1-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 262907 INFO (zkCallback-451-thread-1-processing-n:127.0.0.1:58398_) [n:127.0.0.1:58398_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 262907 INFO (zkCallback-441-thread-1-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 263768 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 263876 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.s.IndexSchema [tmp_collection_shard2_replica_n43] Schema name=test
[junit4] 2> 264084 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 264221 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'tmp_collection_shard2_replica_n43' using configuration from collection tmp_collection, trusted=true
[junit4] 2> 264222 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.tmp_collection.shard2.replica_n43' (registry 'solr.core.tmp_collection.shard2.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 264222 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 264222 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.SolrCore [[tmp_collection_shard2_replica_n43] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-002/cores/tmp_collection_shard2_replica_n43], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-002/cores/tmp_collection_shard2_replica_n43/data/]
[junit4] 2> 264225 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=34, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8531262231945422]
[junit4] 2> 264383 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 264383 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 264384 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 264384 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 264386 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 264388 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@7e5a0e89[tmp_collection_shard2_replica_n43] main]
[junit4] 2> 264389 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 264391 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 264391 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 264407 INFO (searcherExecutor-1080-thread-1-processing-n:127.0.0.1:58398_ x:tmp_collection_shard2_replica_n43 s:shard2 c:tmp_collection) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.SolrCore [tmp_collection_shard2_replica_n43] Registered new searcher Searcher@7e5a0e89[tmp_collection_shard2_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 264431 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593262906619723776
[junit4] 2> 264519 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 264519 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 264519 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:58398/tmp_collection_shard2_replica_n43/
[junit4] 2> 264520 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 264520 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:58398/tmp_collection_shard2_replica_n43/ has no replicas
[junit4] 2> 264520 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 264525 INFO (zkCallback-451-thread-1-processing-n:127.0.0.1:58398_) [n:127.0.0.1:58398_ ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ tmp_collection:shard2
[junit4] 2> 264529 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:58398/tmp_collection_shard2_replica_n43/ shard2
[junit4] 2> 264651 INFO (zkCallback-451-thread-1-processing-n:127.0.0.1:58398_) [n:127.0.0.1:58398_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 264652 INFO (zkCallback-441-thread-2-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 264702 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 264707 INFO (qtp962052781-1974) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard2_replica_n43&action=CREATE&collection=tmp_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2022
[junit4] 2> 264716 INFO (qtp1937411511-2036) [n:127.0.0.1:39183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:58398_&action=ADDREPLICA&collection=tmp_collection&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=2043
[junit4] 2> 264728 INFO (qtp1937411511-2030) [n:127.0.0.1:39183_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:60313_&action=ADDREPLICA&collection=tmp_collection&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 264731 INFO (OverseerCollectionConfigSetProcessor-72252217795805188-127.0.0.1:48975_-n_0000000000) [n:127.0.0.1:48975_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 264735 INFO (OverseerThreadFactory-1053-thread-4-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:60313_ for creating new replica
[junit4] 2> 264806 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n45&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 264807 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 264849 INFO (zkCallback-441-thread-2-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 264856 INFO (zkCallback-451-thread-1-processing-n:127.0.0.1:58398_) [n:127.0.0.1:58398_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 264966 INFO (zkCallback-441-thread-2-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 264967 INFO (zkCallback-451-thread-1-processing-n:127.0.0.1:58398_) [n:127.0.0.1:58398_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 264968 INFO (zkCallback-461-thread-1-processing-n:127.0.0.1:60313_) [n:127.0.0.1:60313_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 265918 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 265972 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.s.IndexSchema [tmp_collection_shard1_replica_n45] Schema name=test
[junit4] 2> 266236 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 266305 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.c.CoreContainer Creating SolrCore 'tmp_collection_shard1_replica_n45' using configuration from collection tmp_collection, trusted=true
[junit4] 2> 266312 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.tmp_collection.shard1.replica_n45' (registry 'solr.core.tmp_collection.shard1.replica_n45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 266312 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 266312 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.c.SolrCore [[tmp_collection_shard1_replica_n45] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-003/cores/tmp_collection_shard1_replica_n45], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-003/cores/tmp_collection_shard1_replica_n45/data/]
[junit4] 2> 266315 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=34, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8531262231945422]
[junit4] 2> 266480 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 266480 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 266481 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 266481 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 266483 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 266483 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.s.SolrIndexSearcher Opening [Searcher@7819ff0[tmp_collection_shard1_replica_n45] main]
[junit4] 2> 266493 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 266494 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 266495 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 266502 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593262908791324672
[junit4] 2> 266505 INFO (searcherExecutor-1086-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.c.SolrCore [tmp_collection_shard1_replica_n45] Registered new searcher Searcher@7819ff0[tmp_collection_shard1_replica_n45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 266512 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.c.ZkController Core needs to recover:tmp_collection_shard1_replica_n45
[junit4] 2> 266513 INFO (qtp616040523-2002) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n45&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1707
[junit4] 2> 266514 INFO (updateExecutor-457-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 266521 INFO (qtp1937411511-2030) [n:127.0.0.1:39183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:60313_&action=ADDREPLICA&collection=tmp_collection&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1793
[junit4] 2> 266521 INFO (qtp1937411511-2036) [n:127.0.0.1:39183_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:39183_&action=ADDREPLICA&collection=tmp_collection&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 266523 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 266551 INFO (qtp1151330776-1950) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 r:core_node42 x:tmp_collection_shard1_replica_n41] o.a.s.c.S.Request [tmp_collection_shard1_replica_n41] webapp= path=/cdcr params={action=LASTPROCESSEDVERSION&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 266553 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 266561 INFO (OverseerThreadFactory-1053-thread-5-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:39183_ for creating new replica
[junit4] 2> 266577 INFO (qtp1151330776-1948) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 r:core_node42 x:tmp_collection_shard1_replica_n41] o.a.s.c.S.Request [tmp_collection_shard1_replica_n41] webapp= path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 266577 INFO (qtp1151330776-1948) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 r:core_node42 x:tmp_collection_shard1_replica_n41] o.a.s.c.S.Request [tmp_collection_shard1_replica_n41] webapp= path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 266577 INFO (OverseerCollectionConfigSetProcessor-72252217795805188-127.0.0.1:48975_-n_0000000000) [n:127.0.0.1:48975_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 266577 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[tmp_collection_shard1_replica_n45]
[junit4] 2> 266577 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 266577 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.c.RecoveryStrategy Publishing state of core [tmp_collection_shard1_replica_n45] as recovering, leader is [http://127.0.0.1:48975/tmp_collection_shard1_replica_n41/] and I am [http://127.0.0.1:60313/tmp_collection_shard1_replica_n45/]
[junit4] 2> 266579 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard2_replica_n47&action=CREATE&collection=tmp_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 266579 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 266582 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:48975]; [WaitForState: action=PREPRECOVERY&core=tmp_collection_shard1_replica_n41&nodeName=127.0.0.1:60313_&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 266615 INFO (qtp1151330776-1948) [n:127.0.0.1:48975_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 266616 INFO (qtp1151330776-1948) [n:127.0.0.1:48975_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=tmp_collection, shard=shard1, thisCore=tmp_collection_shard1_replica_n41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:60313_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"tmp_collection_shard1_replica_n45","base_url":"http://127.0.0.1:60313","node_name":"127.0.0.1:60313_","state":"down","type":"NRT"}
[junit4] 2> 266719 INFO (zkCallback-471-thread-1-processing-n:127.0.0.1:39183_) [n:127.0.0.1:39183_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 266719 INFO (zkCallback-441-thread-1-processing-n:127.0.0.1:48975_) [n:127.0.0.1:48975_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 266720 INFO (zkCallback-461-thread-1-processing-n:127.0.0.1:60313_) [n:127.0.0.1:60313_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 266722 INFO (zkCallback-451-thread-1-processing-n:127.0.0.1:58398_) [n:127.0.0.1:58398_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 267556 INFO (qtp1151330776-1950) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 r:core_node42 x:tmp_collection_shard1_replica_n41] o.a.s.c.S.Request [tmp_collection_shard1_replica_n41] webapp= path=/cdcr params={action=LASTPROCESSEDVERSION&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 267623 INFO (qtp1151330776-1948) [n:127.0.0.1:48975_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=tmp_collection, shard=shard1, thisCore=tmp_collection_shard1_replica_n41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:60313_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"tmp_collection_shard1_replica_n45","base_url":"http://127.0.0.1:60313","node_name":"127.0.0.1:60313_","state":"recovering","type":"NRT"}
[junit4] 2> 267623 INFO (qtp1151330776-1948) [n:127.0.0.1:48975_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 267623 INFO (qtp1151330776-1948) [n:127.0.0.1:48975_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:60313_&onlyIfLeaderActive=true&core=tmp_collection_shard1_replica_n41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1008
[junit4] 2> 267638 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 267698 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.s.IndexSchema [tmp_collection_shard2_replica_n47] Schema name=test
[junit4] 2> 267849 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 267947 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.c.CoreContainer Creating SolrCore 'tmp_collection_shard2_replica_n47' using configuration from collection tmp_collection, trusted=true
[junit4] 2> 267948 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.tmp_collection.shard2.replica_n47' (registry 'solr.core.tmp_collection.shard2.replica_n47') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25bedf11
[junit4] 2> 267948 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 267948 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.c.SolrCore [[tmp_collection_shard2_replica_n47] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-004/cores/tmp_collection_shard2_replica_n47], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_6186D302DE8376C0-001/jetty-004/cores/tmp_collection_shard2_replica_n47/data/]
[junit4] 2> 267950 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=34, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8531262231945422]
[junit4] 2> 268043 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 268043 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 268044 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 268044 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 268065 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 268065 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.s.SolrIndexSearcher Opening [Searcher@7287277e[tmp_collection_shard2_replica_n47] main]
[junit4] 2> 268070 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 268070 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 268071 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 268074 INFO (qtp1937411511-2037) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593262910439686144
[junit4] 2> 268085 INFO (qtp962052781-1977) [n:127.0.0.1:58398_ c:tmp_collection s:shard2 r:core_node44 x:tmp_collection_shard2_replica_n43] o.a.s.c.S.Request [tmp_collection_shard2_replica_n43] webapp= path=/cdcr params={action=LASTPROCESSEDVERSION&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 268089 INFO (searcherExecutor-1092-thread-1-processing-n:127.0.0.1:39183_ x:tmp_collection_shard2_replica_n47 s:shard2 c:tmp_collection) [n:127.0.0.1:39183_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n47] o.a.s.c.SolrCore [tmp_collection_shard2_replica_n47] Registered new searcher Searcher@7287277e[tmp_collection_shard2_replica_n47] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 268137 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [http://127.0.0.1:48975/tmp_collection_shard1_replica_n41/] - recoveringAfterStartup=[true]
[junit4] 2> 268138 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.u.PeerSync PeerSync: core=tmp_collection_shard1_replica_n45 url=http://127.0.0.1:60313 START replicas=[http://127.0.0.1:48975/tmp_collection_shard1_replica_n41/] nUpdates=100
[junit4] 2> 268142 INFO (qtp1151330776-1948) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 r:core_node42 x:tmp_collection_shard1_replica_n41] o.a.s.u.IndexFingerprint IndexFingerprint millis:1.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
[junit4] 2> 268142 INFO (qtp1151330776-1948) [n:127.0.0.1:48975_ c:tmp_collection s:shard1 r:core_node42 x:tmp_collection_shard1_replica_n41] o.a.s.c.S.Request [tmp_collection_shard1_replica_n41] webapp= path=/get params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 268143 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
[junit4] 2> 268143 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.u.PeerSync We are already in sync. No need to do a PeerSync
[junit4] 2> 268143 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 268143 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_collection r:core_node46) [n:127.0.0.1:60313_ c:tmp_collection s:shard1 r:core_node46 x:tmp_collection_shard1_replica_n45] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 268143 INFO (recoveryExecutor-458-thread-1-processing-n:127.0.0.1:60313_ x:tmp_collection_shard1_replica_n45 s:shard1 c:tmp_coll
[...truncated too long message...]
2> 96474 INFO (coreCloseExecutor-490-thread-1) [n:127.0.0.1:35056_solr c:replacenodetest_coll_notarget s:shard4 r:core_node14 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard4.leader, tag=1778159620
[junit4] 2> 96475 INFO (coreCloseExecutor-488-thread-2) [n:127.0.0.1:49714_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard2.leader, tag=1689847368
[junit4] 2> 96476 INFO (coreCloseExecutor-488-thread-1) [n:127.0.0.1:49714_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard5.leader, tag=2069932476
[junit4] 2> 96491 INFO (jetty-closer-394-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@76317a5c{/solr,null,UNAVAILABLE}
[junit4] 2> 96494 INFO (jetty-closer-394-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3598204a{/solr,null,UNAVAILABLE}
[junit4] 2> 96495 INFO (jetty-closer-394-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 96501 INFO (jetty-closer-394-thread-3) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 96510 INFO (jetty-closer-394-thread-5) [ ] o.a.s.c.Overseer Overseer (id=72252508539125773-127.0.0.1:49714_solr-n_0000000000) closing
[junit4] 2> 96510 INFO (OverseerStateUpdate-72252508539125773-127.0.0.1:49714_solr-n_0000000000) [n:127.0.0.1:49714_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:49714_solr
[junit4] 2> 96511 WARN (OverseerAutoScalingTriggerThread-72252508539125773-127.0.0.1:49714_solr-n_0000000000) [n:127.0.0.1:49714_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 96518 INFO (jetty-closer-394-thread-5) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3fde1dd1{/solr,null,UNAVAILABLE}
[junit4] 2> 96519 INFO (jetty-closer-394-thread-5) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 97154 WARN (zkCallback-437-thread-1-processing-n:127.0.0.1:58682_solr) [n:127.0.0.1:58682_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SyncStrategy Closed, skipping sync up.
[junit4] 2> 97155 INFO (zkCallback-437-thread-1-processing-n:127.0.0.1:58682_solr) [n:127.0.0.1:58682_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 97155 INFO (zkCallback-437-thread-1-processing-n:127.0.0.1:58682_solr) [n:127.0.0.1:58682_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrCore [replacenodetest_coll_notarget_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@301c95b5
[junit4] 2> 97155 INFO (zkCallback-437-thread-1-processing-n:127.0.0.1:58682_solr) [n:127.0.0.1:58682_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.replacenodetest_coll_notarget.shard1.replica_n1, tag=807179701
[junit4] 2> 97155 INFO (zkCallback-437-thread-1-processing-n:127.0.0.1:58682_solr) [n:127.0.0.1:58682_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@da5fe90: rootName = solr_58682, domain = solr.core.replacenodetest_coll_notarget.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.replacenodetest_coll_notarget.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@3fa53d31
[junit4] 2> 97162 INFO (zkCallback-437-thread-1-processing-n:127.0.0.1:58682_solr) [n:127.0.0.1:58682_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard1.leader, tag=807179701
[junit4] 2> 97643 WARN (zkCallback-437-thread-3-processing-n:127.0.0.1:58682_solr) [n:127.0.0.1:58682_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 97644 INFO (jetty-closer-394-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1d808534{/solr,null,UNAVAILABLE}
[junit4] 2> 97644 INFO (jetty-closer-394-thread-4) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 97646 ERROR (SUITE-ReplaceNodeNoTargetTest-seed#[6186D302DE8376C0]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 97646 INFO (SUITE-ReplaceNodeNoTargetTest-seed#[6186D302DE8376C0]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34660 34660
[junit4] 2> 97789 INFO (Thread-186) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34660 34660
[junit4] 2> 97790 WARN (Thread-186) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/collections/replacenodetest_coll_notarget/terms/shard1
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 6 /solr/configs/conf1
[junit4] 2> 5 /solr/collections/replacenodetest_coll_notarget/terms/shard2
[junit4] 2> 5 /solr/collections/replacenodetest_coll_notarget/terms/shard4
[junit4] 2> 5 /solr/collections/replacenodetest_coll_notarget/terms/shard3
[junit4] 2> 5 /solr/collections/replacenodetest_coll_notarget/terms/shard5
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 96 /solr/collections/replacenodetest_coll_notarget/state.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 2 /solr/overseer_elect/election/72252508539125774-127.0.0.1:35056_solr-n_0000000002
[junit4] 2> 2 /solr/overseer_elect/election/72252508539125776-127.0.0.1:57379_solr-n_0000000003
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_6186D302DE8376C0-001
[junit4] 2> Feb 24, 2018 7:45:48 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=ar-LB, timezone=Pacific/Easter
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=1,free=132547640,total=359661568
[junit4] 2> NOTE: All tests run in this JVM: [CdcrVersionReplicationTest, CdcrVersionReplicationTest, CdcrVersionReplicationTest, ReplaceNodeNoTargetTest, ReplaceNodeNoTargetTest]
[junit4] Completed [9/10 (1!)] on J0 in 10.98s, 1 test, 1 failure <<< FAILURES!
[...truncated 14 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1560: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1085: There were test failures: 10 suites, 10 tests, 1 failure [seed: 6186D302DE8376C0]
Total time: 1 minute 49 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.cdcr.CdcrVersionReplicationTest
[repro] 1/5 failed: org.apache.solr.cloud.ReplaceNodeNoTargetTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=d7f6cb93837e1bde1066c96606845c4ab04e50cf, workspace=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #459
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2